Aug 10 15:48:33 devstack cinder-volume[77572]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 10 15:48:33 devstack cinder-volume[77572]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 10 15:48:33 devstack cinder-volume[77572]: we strongly recommend against using it for new projects. Aug 10 15:48:33 devstack cinder-volume[77572]: If you are already using Eventlet, we recommend migrating to a different Aug 10 15:48:33 devstack cinder-volume[77572]: framework. For more detail see Aug 10 15:48:33 devstack cinder-volume[77572]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 10 15:48:33 devstack cinder-volume[77572]: import eventlet # noqa Aug 10 15:48:36 devstack cinder-volume[77572]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=77572) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 10 15:48:36 devstack cinder-volume[77572]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=77572) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 10 15:48:36 devstack cinder-volume[77572]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=77572) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 10 15:48:37 devstack cinder-volume[77572]: INFO dbcounter [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] Registered counter for database cinder Aug 10 15:48:37 devstack cinder-volume[77572]: DEBUG oslo_db.sqlalchemy.engines [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77572) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 10 15:48:37 devstack cinder-volume[77572]: DEBUG dbcounter [-] [77572] Writer thread running {{(pid=77572) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 10 15:48:37 devstack cinder-volume[77572]: INFO cinder.rpc [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 10 15:48:37 devstack cinder-volume[77572]: INFO cinder.rpc [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 10 15:48:37 devstack cinder-volume[77572]: DEBUG oslo_db.sqlalchemy.engines [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77572) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 10 15:48:37 devstack cinder-volume[77572]: INFO cinder.volume.manager [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] Determined volume DB was empty at startup. Aug 10 15:48:37 devstack cinder-volume[77572]: DEBUG cinder.volume.manager [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=77572) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 10 15:48:37 devstack cinder-volume[77572]: INFO cinder.volume.manager [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] Service not found for updating active_backend_id, assuming default for driver init. Aug 10 15:48:37 devstack cinder-volume[77572]: WARNING stevedore.named [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 10 15:48:37 devstack cinder-volume[77572]: WARNING castellan.key_manager [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 10 15:48:37 devstack cinder-volume[77572]: WARNING cinder.keymgr.conf_key_mgr [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 10 15:48:37 devstack cinder-volume[77572]: DEBUG cinder.volume.drivers.lvm [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=77572) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Aug 10 15:48:37 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_concurrency.processutils [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] CMD "cinder-rtstool verify" returned: 0 in 0.580s {{(pid=77572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_db.sqlalchemy.engines [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77572) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 10 15:48:38 devstack cinder-volume[77572]: INFO cinder.rpc [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Aug 10 15:48:38 devstack cinder-volume[77572]: INFO cinder.rpc [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Aug 10 15:48:38 devstack cinder-volume[77572]: WARNING stevedore.named [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 10 15:48:38 devstack cinder-volume[77572]: WARNING castellan.key_manager [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 10 15:48:38 devstack cinder-volume[77572]: INFO cinder.volume.manager [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_db.sqlalchemy.engines [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77572) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 10 15:48:38 devstack cinder-volume[77572]: INFO oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] Starting 1 workers Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] Started child 77758 {{(pid=77572) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] Full set of CONF: {{(pid=77572) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] ******************************************************************************** {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3518}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] Configuration options gathered from: {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3519}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3520}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3521}} Aug 10 15:48:38 devstack cinder-volume[77758]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] ================================================================================ {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3526}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] allow_availability_zone_fallback = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] allow_compression_on_image_upload = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] allowed_direct_url_schemes = [] {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] api_rate_limit = True {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] auth_strategy = keystone {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] az_cache_duration = 3600 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] backend_availability_zone = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] backend_host = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] backend_name = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] backend_stats_polling_interval = 60 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] backup_api_class = cinder.backup.api.API {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] backup_name_template = backup-%s {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] backup_use_same_host = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] backup_use_temp_snapshot = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] chap_password = **** {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] chap_username = {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] cinder_internal_tenant_project_id = 4366ef1be7ef4ad59265f9f8d1cf6cf2 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] cinder_internal_tenant_user_id = 48366b44f69249a7ab4fa19ac32a7326 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] cloned_volume_same_az = True {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] cluster = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] compression_format = gzip {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] compute_api_class = cinder.compute.nova.API {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] config_dir = [] {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] config_source = [] {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] control_exchange = openstack {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] debug = True {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] default_availability_zone = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] default_group_type = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] default_volume_type = lvmdriver-1 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] disk_geometry = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] driver_client_cert = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] driver_client_cert_key = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] driver_data_namespace = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] driver_ssl_cert_path = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] driver_ssl_cert_verify = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] driver_use_ssl = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] enable_force_upload = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] enable_new_services = True {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] enable_unsupported_driver = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] enabled_backends = ['lvmdriver-1'] {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] enforce_multipath_for_image_xfer = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] filter_function = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] glance_api_insecure = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] glance_api_servers = ['http://192.168.122.68/image'] {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] glance_api_ssl_compression = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] glance_ca_certificates_file = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] glance_catalog_info = image:glance:publicURL {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] glance_certfile = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] glance_keyfile = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] glance_num_retries = 3 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] glance_request_timeout = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] goodness_function = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] graceful_shutdown_timeout = 5 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] group_api_class = cinder.group.api.API {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] host = devstack {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] image_compress_on_upload = True {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] image_conversion_address_space_limit = 1 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] image_conversion_cpu_limit = 60 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] image_conversion_disable = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] image_upload_use_cinder_backend = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] image_upload_use_internal_tenant = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] image_volume_cache_enabled = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] image_volume_cache_max_count = 0 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] image_volume_cache_max_size_gb = 0 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] init_host_max_objects_retrieval = 0 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] instance_format = [instance: %(uuid)s] {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] iscsi_target_flags = {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] iscsi_write_cache = on {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77758]: INFO cinder.volume.manager [None req-41836fbe-dd89-490d-a066-1f40f1a818d6 None None] Starting volume driver LVMVolumeDriver (3.0.0) Aug 10 15:48:38 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-41836fbe-dd89-490d-a066-1f40f1a818d6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] iser_helper = tgtadm {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] iser_ip_address = 192.168.122.68 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] iser_port = 3260 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] log_color = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] log_config_append = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] log_dir = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] log_file = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] log_options = True {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] log_rotate_interval = 1 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] log_rotate_interval_type = days {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] log_rotation_type = none {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] max_age = 0 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] max_logfile_count = 30 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] max_logfile_size_mb = 200 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] max_over_subscription_ratio = 20.0 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] message_reap_interval = 86400 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] message_ttl = 2592000 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] migration_create_volume_timeout_secs = 300 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] monkey_patch = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] monkey_patch_modules = [] {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] my_ip = 192.168.122.68 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] no_snapshot_gb_quota = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] num_iser_scan_tries = 3 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] num_shell_tries = 3 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] num_volume_device_scan_tries = 3 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] nvmeof_conn_info_version = 1 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] nvmet_ns_id = 10 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] nvmet_port_id = 1 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] osapi_max_limit = 1000 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] osapi_volume_ext_list = [] {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] osapi_volume_listen = 0.0.0.0 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] osapi_volume_listen_port = 8776 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] osapi_volume_use_ssl = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] osapi_volume_workers = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] per_volume_size_limit = -1 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] periodic_fuzzy_delay = 60 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] periodic_interval = 60 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] project_id_regex = [0-9a-f\-]+ {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] public_endpoint = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] publish_errors = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] quota_backup_gigabytes = 1000 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] quota_backups = 10 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] quota_gigabytes = 1000 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] quota_groups = 10 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] quota_snapshots = 10 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] quota_volumes = 10 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] rate_limit_burst = 0 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] rate_limit_except_level = CRITICAL {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] rate_limit_interval = 0 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] reinit_driver_count = 3 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] replication_device = **** {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] report_discard_supported = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] report_interval = 120 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] reservation_clean_interval = 86400 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] reservation_expire = 86400 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] reserved_image_namespaces = [] {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] reserved_percentage = 0 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] rpc_response_timeout = 120 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] run_external_periodic_tasks = True {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] scst_target_driver = iscsi {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] scst_target_iqn_name = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] service_down_time = 720 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] shell_completion = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] snapshot_name_template = snapshot-%s {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] snapshot_same_host = True {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] split_loggers = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] state_path = /opt/stack/data/cinder {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-41836fbe-dd89-490d-a066-1f40f1a818d6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.056s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] storage_availability_zone = nova {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] storage_protocol = iSCSI {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] syslog_log_facility = LOG_USER {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] target_helper = lioadm {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] target_ip_address = 192.168.122.68 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] target_nvme_fc_traddrs = [] {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] target_port = 3260 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-41836fbe-dd89-490d-a066-1f40f1a818d6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] target_protocol = iscsi {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] target_secondary_ip_addresses = [] {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] trace_flags = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] transfer_api_class = cinder.transfer.api.API {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] transport_url = **** {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] until_refresh = 0 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] use_chap_auth = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] use_default_quota_class = True {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] use_journal = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] use_json = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] use_multipath_for_image_xfer = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] use_stderr = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] use_syslog = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] verify_glance_signatures = enabled {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] volume_api_class = cinder.volume.api.API {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] volume_backend_name = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] volume_clear = zero {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] volume_clear_ionice = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] volume_clear_size = 0 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] volume_copy_bps_limit = 0 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] volume_dd_blocksize = 1M {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] volume_name_template = volume-%s {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] volume_service_inithost_offload = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] volume_usage_audit_period = month {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] zoning_mode = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] oslo_concurrency.disable_process_locking = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] keystone_authtoken.auth_section = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] keystone_authtoken.auth_type = password {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] keystone_authtoken.auth_version = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] keystone_authtoken.cache = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] keystone_authtoken.certfile = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] keystone_authtoken.delay_auth_decision = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] keystone_authtoken.http_connect_timeout = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] keystone_authtoken.include_service_catalog = True {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] keystone_authtoken.insecure = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] keystone_authtoken.interface = public {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] keystone_authtoken.keyfile = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] keystone_authtoken.memcache_password = {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-41836fbe-dd89-490d-a066-1f40f1a818d6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.056s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-41836fbe-dd89-490d-a066-1f40f1a818d6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] keystone_authtoken.memcache_username = {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] keystone_authtoken.region_name = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] keystone_authtoken.service_token_roles_required = True {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] keystone_authtoken.service_type = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] keystone_authtoken.token_cache_time = 300 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.68/identity {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] cache.backend = dogpile.cache.null {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] cache.backend_argument = **** {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] cache.backend_expiration_time = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] cache.config_prefix = cache.oslo {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] cache.debug_cache_backend = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] cache.enable_retry_client = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] cache.enable_socket_keepalive = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] cache.enabled = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] cache.expiration_time = 600 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] cache.hashclient_retry_attempts = 2 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] cache.memcache_dead_retry = 300 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] cache.memcache_pool_maxsize = 10 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] cache.memcache_sasl_enabled = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] cache.password = **** {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] cache.proxies = [] {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] cache.redis_db = 0 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] cache.redis_sentinel_service_name = mymaster {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] cache.redis_server = localhost:6379 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] cache.retry_attempts = 2 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] cache.retry_delay = 0.0 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] cache.socket_keepalive_count = 1 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] cache.socket_keepalive_idle = 1 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] cache.socket_keepalive_interval = 1 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] cache.socket_timeout = 1.0 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] cache.tls_allowed_ciphers = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] cache.tls_cafile = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] cache.tls_certfile = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] cache.tls_enabled = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] cache.tls_keyfile = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] cache.username = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] coordination.backend_url = **** {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] database.asyncio_connection = **** {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] database.asyncio_slave_connection = **** {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] database.backend = sqlalchemy {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] database.connection = **** {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] database.connection_debug = 0 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] database.connection_parameters = {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] database.connection_recycle_time = 3600 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] database.connection_trace = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] database.db_inc_retry_interval = True {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] database.db_max_retries = 20 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] database.db_max_retry_interval = 10 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-41836fbe-dd89-490d-a066-1f40f1a818d6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.037s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] database.db_retry_interval = 1 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] database.max_overflow = 50 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-41836fbe-dd89-490d-a066-1f40f1a818d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] database.max_pool_size = 5 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] database.max_retries = 10 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] database.mysql_wsrep_sync_wait = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] database.pool_timeout = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] database.retry_interval = 10 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] database.slave_connection = **** {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] database.sqlite_synchronous = True {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] database.synchronous_reader = True {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] database.use_db_reconnect = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] profiler.connection_string = messaging:// {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] profiler.enabled = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] profiler.es_doc_type = notification {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] profiler.es_scroll_size = 10000 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] profiler.es_scroll_time = 2m {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] profiler.filter_error_trace = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] profiler.hmac_keys = **** {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] profiler.sentinel_service_name = mymaster {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] profiler.socket_timeout = 0.1 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] profiler.trace_requests = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] profiler.trace_sqlalchemy = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] profiler_jaeger.process_tags = {} {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] profiler_jaeger.service_name_prefix = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] profiler_otlp.service_name_prefix = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] oslo_policy.enforce_new_defaults = True {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] oslo_policy.policy_default_rule = default {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] oslo_policy.policy_file = policy.yaml {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] oslo_policy.remote_timeout = 60.0 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] privsep_osbrick.group = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] privsep_osbrick.helper_command = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] privsep_osbrick.user = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] cinder_sys_admin.group = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] cinder_sys_admin.helper_command = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] cinder_sys_admin.user = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] service_user.auth_section = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] service_user.auth_type = password {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack sudo[77763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] service_user.cafile = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] service_user.certfile = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] service_user.collect_timing = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] service_user.insecure = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] service_user.keyfile = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] service_user.send_service_user_token = True {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] service_user.split_loggers = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] service_user.timeout = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack sudo[77763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] glance.auth_section = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] glance.auth_type = password {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] glance.certfile = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] glance.collect_timing = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] glance.insecure = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] glance.keyfile = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] glance.region_name = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] glance.split_loggers = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] glance.timeout = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] backend_defaults.backend_availability_zone = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] backend_defaults.chap_password = **** {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] backend_defaults.chap_username = {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] backend_defaults.disk_geometry = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] backend_defaults.driver_client_cert = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] backend_defaults.driver_client_cert_key = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] backend_defaults.driver_data_namespace = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] backend_defaults.driver_use_ssl = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] backend_defaults.enable_unsupported_driver = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] backend_defaults.extra_capabilities = {} {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] backend_defaults.filter_function = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] backend_defaults.goodness_function = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] backend_defaults.iscsi_target_flags = {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] backend_defaults.iscsi_write_cache = on {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] backend_defaults.iser_helper = tgtadm {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] backend_defaults.iser_ip_address = 192.168.122.68 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] backend_defaults.iser_port = 3260 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] backend_defaults.lvm_mirrors = 0 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] backend_defaults.lvm_share_target = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] backend_defaults.lvm_type = auto {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] backend_defaults.num_shell_tries = 3 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] backend_defaults.nvmet_port_id = 1 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] backend_defaults.replication_device = **** {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] backend_defaults.report_discard_supported = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] backend_defaults.reserved_percentage = 0 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] backend_defaults.scst_target_driver = iscsi {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] backend_defaults.scst_target_iqn_name = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] backend_defaults.storage_protocol = iSCSI {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] backend_defaults.target_helper = tgtadm {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] backend_defaults.target_ip_address = 192.168.122.68 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] backend_defaults.target_nvme_fc_traddrs = [] {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] backend_defaults.target_port = 3260 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] backend_defaults.target_protocol = iscsi {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] backend_defaults.trace_flags = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] backend_defaults.unique_fqdn_network = True {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] backend_defaults.use_chap_auth = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] backend_defaults.volume_backend_name = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] backend_defaults.volume_clear = zero {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] backend_defaults.volume_clear_ionice = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] backend_defaults.volume_clear_size = 0 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] backend_defaults.volume_group = cinder-volumes {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] oslo_reports.file_event_handler = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] oslo_reports.log_dir = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] lvmdriver-1.backend_availability_zone = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] lvmdriver-1.backend_host = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] lvmdriver-1.chap_password = **** {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] lvmdriver-1.chap_username = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] lvmdriver-1.chiscsi_conf = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] lvmdriver-1.disk_geometry = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] lvmdriver-1.driver_client_cert = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] lvmdriver-1.driver_data_namespace = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] lvmdriver-1.driver_use_ssl = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] lvmdriver-1.extra_capabilities = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] lvmdriver-1.filter_function = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] lvmdriver-1.goodness_function = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] lvmdriver-1.iser_helper = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] lvmdriver-1.iser_ip_address = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] lvmdriver-1.iser_port = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] lvmdriver-1.iser_target_prefix = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] lvmdriver-1.lvm_conf_file = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] lvmdriver-1.lvm_mirrors = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] lvmdriver-1.lvm_share_target = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] lvmdriver-1.lvm_type = auto {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] lvmdriver-1.num_shell_tries = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] lvmdriver-1.nvmet_port_id = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] lvmdriver-1.replication_device = **** {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] lvmdriver-1.report_discard_supported = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] lvmdriver-1.reserved_percentage = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] lvmdriver-1.scst_target_driver = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] lvmdriver-1.storage_protocol = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] lvmdriver-1.target_helper = lioadm {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] lvmdriver-1.target_ip_address = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] lvmdriver-1.target_nvme_fc_traddrs = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] lvmdriver-1.target_port = 3260 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] lvmdriver-1.target_protocol = iscsi {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] lvmdriver-1.trace_flags = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] lvmdriver-1.use_chap_auth = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] lvmdriver-1.volume_clear = zero {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] lvmdriver-1.volume_clear_size = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] lvmdriver-1.volumes_dir = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] oslo_messaging_rabbit.ssl = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] oslo_messaging_rabbit.ssl_version = {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] oslo_messaging_notifications.driver = [] {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] oslo_messaging_notifications.retry = -1 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] oslo_messaging_notifications.transport_url = **** {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] key_manager.fixed_key = **** {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] barbican.barbican_api_version = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] barbican.barbican_endpoint = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] barbican.barbican_endpoint_type = public {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] barbican.barbican_region_name = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] barbican.cafile = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] barbican.certfile = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] barbican.collect_timing = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] barbican.insecure = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] barbican.keyfile = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] barbican.number_of_retries = 60 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] barbican.retry_delay = 1 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] barbican.send_service_user_token = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] barbican.split_loggers = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] barbican.timeout = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] barbican.verify_ssl = True {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] barbican.verify_ssl_path = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] barbican_service_user.auth_section = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] barbican_service_user.auth_type = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] barbican_service_user.cafile = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] barbican_service_user.certfile = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] barbican_service_user.collect_timing = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] barbican_service_user.insecure = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] barbican_service_user.keyfile = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] barbican_service_user.split_loggers = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] barbican_service_user.timeout = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] vault.approle_role_id = **** {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] vault.approle_secret_id = **** {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] vault.auth_method = approle {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] vault.auth_path = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] vault.kv_mountpoint = secret {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] vault.kv_path = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] vault.kv_version = 2 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] vault.namespace = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] vault.root_token_id = **** {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] vault.ssl_ca_crt_file = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] vault.timeout = 60.0 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] vault.token_file = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] vault.token_role = None {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] vault.use_ssl = False {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:48:38 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] ******************************************************************************** {{(pid=77572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3552}} Aug 10 15:48:39 devstack sudo[77763]: pam_unix(sudo:session): session closed for user root Aug 10 15:48:39 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-41836fbe-dd89-490d-a066-1f40f1a818d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.347s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:48:39 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-41836fbe-dd89-490d-a066-1f40f1a818d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:48:39 devstack sudo[77863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 10 15:48:39 devstack sudo[77863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:48:39 devstack sudo[77863]: pam_unix(sudo:session): session closed for user root Aug 10 15:48:39 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-41836fbe-dd89-490d-a066-1f40f1a818d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.255s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:48:39 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-41836fbe-dd89-490d-a066-1f40f1a818d6 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 10 15:48:39 devstack cinder-volume[77758]: INFO cinder.brick.local_dev.lvm [None req-41836fbe-dd89-490d-a066-1f40f1a818d6 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Aug 10 15:48:39 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-41836fbe-dd89-490d-a066-1f40f1a818d6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:48:39 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-41836fbe-dd89-490d-a066-1f40f1a818d6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:48:39 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-41836fbe-dd89-490d-a066-1f40f1a818d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:48:39 devstack sudo[77974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 10 15:48:39 devstack sudo[77974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:48:39 devstack sudo[77974]: pam_unix(sudo:session): session closed for user root Aug 10 15:48:39 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-41836fbe-dd89-490d-a066-1f40f1a818d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:48:39 devstack cinder-volume[77758]: DEBUG cinder.brick.local_dev.lvm [None req-41836fbe-dd89-490d-a066-1f40f1a818d6 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=77758) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Aug 10 15:48:39 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-41836fbe-dd89-490d-a066-1f40f1a818d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:48:39 devstack sudo[78058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 10 15:48:39 devstack sudo[78058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:48:40 devstack sudo[78058]: pam_unix(sudo:session): session closed for user root Aug 10 15:48:40 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-41836fbe-dd89-490d-a066-1f40f1a818d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.495s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:48:40 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-41836fbe-dd89-490d-a066-1f40f1a818d6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:48:40 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-41836fbe-dd89-490d-a066-1f40f1a818d6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:48:40 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-41836fbe-dd89-490d-a066-1f40f1a818d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:48:40 devstack sudo[78253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 10 15:48:40 devstack sudo[78253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:48:40 devstack sudo[78253]: pam_unix(sudo:session): session closed for user root Aug 10 15:48:40 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-41836fbe-dd89-490d-a066-1f40f1a818d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.304s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:48:40 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-41836fbe-dd89-490d-a066-1f40f1a818d6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:48:40 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-41836fbe-dd89-490d-a066-1f40f1a818d6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:48:40 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-41836fbe-dd89-490d-a066-1f40f1a818d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:48:40 devstack sudo[78374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Aug 10 15:48:40 devstack sudo[78374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:48:40 devstack sudo[78374]: pam_unix(sudo:session): session closed for user root Aug 10 15:48:40 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-41836fbe-dd89-490d-a066-1f40f1a818d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.291s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:48:40 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-41836fbe-dd89-490d-a066-1f40f1a818d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:48:40 devstack sudo[78377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 10 15:48:40 devstack sudo[78377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:48:41 devstack sudo[78377]: pam_unix(sudo:session): session closed for user root Aug 10 15:48:41 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-41836fbe-dd89-490d-a066-1f40f1a818d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.340s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:48:41 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-41836fbe-dd89-490d-a066-1f40f1a818d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:48:41 devstack sudo[78462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 10 15:48:41 devstack sudo[78462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:48:41 devstack sudo[78462]: pam_unix(sudo:session): session closed for user root Aug 10 15:48:41 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-41836fbe-dd89-490d-a066-1f40f1a818d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:48:41 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-41836fbe-dd89-490d-a066-1f40f1a818d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:48:41 devstack sudo[78465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 10 15:48:41 devstack sudo[78465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:48:41 devstack sudo[78465]: pam_unix(sudo:session): session closed for user root Aug 10 15:48:41 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-41836fbe-dd89-490d-a066-1f40f1a818d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.315s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:48:41 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-41836fbe-dd89-490d-a066-1f40f1a818d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:48:41 devstack sudo[78554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 10 15:48:41 devstack sudo[78554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:48:42 devstack sudo[78554]: pam_unix(sudo:session): session closed for user root Aug 10 15:48:42 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-41836fbe-dd89-490d-a066-1f40f1a818d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.275s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:48:42 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-41836fbe-dd89-490d-a066-1f40f1a818d6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:48:42 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-41836fbe-dd89-490d-a066-1f40f1a818d6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:48:42 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-41836fbe-dd89-490d-a066-1f40f1a818d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:48:42 devstack sudo[78558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 10 15:48:42 devstack sudo[78558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:48:42 devstack sudo[78558]: pam_unix(sudo:session): session closed for user root Aug 10 15:48:42 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-41836fbe-dd89-490d-a066-1f40f1a818d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.270s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:48:42 devstack cinder-volume[77758]: INFO cinder.volume.drivers.lvm [None req-41836fbe-dd89-490d-a066-1f40f1a818d6 None None] Enabling LVM thin provisioning by default because a thin pool exists. Aug 10 15:48:42 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-41836fbe-dd89-490d-a066-1f40f1a818d6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:48:42 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-41836fbe-dd89-490d-a066-1f40f1a818d6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:48:42 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-41836fbe-dd89-490d-a066-1f40f1a818d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:48:42 devstack sudo[78562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 10 15:48:42 devstack sudo[78562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:48:42 devstack sudo[78562]: pam_unix(sudo:session): session closed for user root Aug 10 15:48:42 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-41836fbe-dd89-490d-a066-1f40f1a818d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.273s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:48:42 devstack cinder-volume[77758]: DEBUG cinder.volume.drivers.lvm [None req-41836fbe-dd89-490d-a066-1f40f1a818d6 None None] Updating volume stats {{(pid=77758) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 10 15:48:42 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-41836fbe-dd89-490d-a066-1f40f1a818d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:48:42 devstack sudo[78565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 10 15:48:42 devstack sudo[78565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:48:42 devstack sudo[78565]: pam_unix(sudo:session): session closed for user root Aug 10 15:48:42 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-41836fbe-dd89-490d-a066-1f40f1a818d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:48:42 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-41836fbe-dd89-490d-a066-1f40f1a818d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:48:42 devstack sudo[78574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 10 15:48:42 devstack sudo[78574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:48:43 devstack sudo[78574]: pam_unix(sudo:session): session closed for user root Aug 10 15:48:43 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-41836fbe-dd89-490d-a066-1f40f1a818d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.337s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:48:43 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-41836fbe-dd89-490d-a066-1f40f1a818d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:48:43 devstack sudo[78577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 10 15:48:43 devstack sudo[78577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:48:43 devstack sudo[78577]: pam_unix(sudo:session): session closed for user root Aug 10 15:48:43 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-41836fbe-dd89-490d-a066-1f40f1a818d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.252s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:48:43 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-41836fbe-dd89-490d-a066-1f40f1a818d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:48:43 devstack sudo[78580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 10 15:48:43 devstack sudo[78580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:48:43 devstack sudo[78580]: pam_unix(sudo:session): session closed for user root Aug 10 15:48:43 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-41836fbe-dd89-490d-a066-1f40f1a818d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:48:43 devstack cinder-volume[77758]: INFO cinder.volume.driver [None req-41836fbe-dd89-490d-a066-1f40f1a818d6 None None] Driver hasn't implemented _init_vendor_properties() Aug 10 15:48:43 devstack cinder-volume[77758]: DEBUG cinder.volume.driver [None req-41836fbe-dd89-490d-a066-1f40f1a818d6 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=77758) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:887}} Aug 10 15:48:43 devstack cinder-volume[77758]: DEBUG oslo_db.sqlalchemy.engines [None req-41836fbe-dd89-490d-a066-1f40f1a818d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77758) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 10 15:48:43 devstack cinder-volume[77758]: DEBUG dbcounter [-] [77758] Writer thread running {{(pid=77758) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 10 15:48:43 devstack cinder-volume[77758]: DEBUG cinder.db.api [None req-41836fbe-dd89-490d-a066-1f40f1a818d6 None None] Building query based on filter {{(pid=77758) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 10 15:48:43 devstack cinder-volume[77758]: DEBUG cinder.image.image_utils [None req-41836fbe-dd89-490d-a066-1f40f1a818d6 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=77758) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 10 15:48:43 devstack cinder-volume[77758]: INFO cinder.keymgr.migration [None req-115a1246-6111-48ae-971e-25aead140640 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 10 15:48:43 devstack cinder-volume[77758]: DEBUG cinder.volume.drivers.lvm [None req-41836fbe-dd89-490d-a066-1f40f1a818d6 None None] Updating volume stats {{(pid=77758) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 10 15:48:43 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-41836fbe-dd89-490d-a066-1f40f1a818d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:48:43 devstack sudo[78584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 10 15:48:43 devstack sudo[78584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:48:44 devstack sudo[78584]: pam_unix(sudo:session): session closed for user root Aug 10 15:48:44 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-41836fbe-dd89-490d-a066-1f40f1a818d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.313s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:48:44 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-41836fbe-dd89-490d-a066-1f40f1a818d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:48:44 devstack sudo[78589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 10 15:48:44 devstack sudo[78589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:48:44 devstack sudo[78589]: pam_unix(sudo:session): session closed for user root Aug 10 15:48:44 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-41836fbe-dd89-490d-a066-1f40f1a818d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:48:44 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-41836fbe-dd89-490d-a066-1f40f1a818d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:48:44 devstack sudo[78592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 10 15:48:44 devstack sudo[78592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:48:44 devstack sudo[78592]: pam_unix(sudo:session): session closed for user root Aug 10 15:48:44 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-41836fbe-dd89-490d-a066-1f40f1a818d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.258s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:48:44 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-41836fbe-dd89-490d-a066-1f40f1a818d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:48:44 devstack sudo[78596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 10 15:48:44 devstack sudo[78596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:48:44 devstack sudo[78596]: pam_unix(sudo:session): session closed for user root Aug 10 15:48:44 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-41836fbe-dd89-490d-a066-1f40f1a818d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:48:44 devstack cinder-volume[77758]: DEBUG cinder.manager [None req-41836fbe-dd89-490d-a066-1f40f1a818d6 None None] Notifying Schedulers of capabilities ... {{(pid=77758) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 15:48:44 devstack cinder-volume[77758]: INFO cinder.volume.manager [None req-41836fbe-dd89-490d-a066-1f40f1a818d6 None None] Driver initialization completed successfully. Aug 10 15:48:44 devstack cinder-volume[77758]: INFO cinder.manager [None req-41836fbe-dd89-490d-a066-1f40f1a818d6 None None] Initiating service 2 cleanup Aug 10 15:48:45 devstack cinder-volume[77758]: INFO cinder.manager [None req-41836fbe-dd89-490d-a066-1f40f1a818d6 None None] Service 2 cleanup completed. Aug 10 15:48:45 devstack cinder-volume[77758]: DEBUG cinder.service [None req-41836fbe-dd89-490d-a066-1f40f1a818d6 None None] Creating RPC server for service cinder-volume {{(pid=77758) start /opt/stack/cinder/cinder/service.py:231}} Aug 10 15:48:45 devstack cinder-volume[77758]: DEBUG cinder.service [None req-41836fbe-dd89-490d-a066-1f40f1a818d6 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=77758) start /opt/stack/cinder/cinder/service.py:237}} Aug 10 15:48:45 devstack cinder-volume[77758]: INFO cinder.volume.manager [None req-41836fbe-dd89-490d-a066-1f40f1a818d6 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Aug 10 15:48:45 devstack cinder-volume[77758]: DEBUG cinder.volume.drivers.lvm [None req-41836fbe-dd89-490d-a066-1f40f1a818d6 None None] Updating volume stats {{(pid=77758) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 10 15:48:45 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-41836fbe-dd89-490d-a066-1f40f1a818d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:48:45 devstack sudo[78600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 10 15:48:45 devstack sudo[78600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:48:45 devstack sudo[78600]: pam_unix(sudo:session): session closed for user root Aug 10 15:48:45 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-41836fbe-dd89-490d-a066-1f40f1a818d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:48:45 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-41836fbe-dd89-490d-a066-1f40f1a818d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:48:45 devstack sudo[78603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 10 15:48:45 devstack sudo[78603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:48:45 devstack sudo[78603]: pam_unix(sudo:session): session closed for user root Aug 10 15:48:45 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-41836fbe-dd89-490d-a066-1f40f1a818d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:48:45 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-41836fbe-dd89-490d-a066-1f40f1a818d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:48:45 devstack sudo[78606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 10 15:48:45 devstack sudo[78606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:48:45 devstack sudo[78606]: pam_unix(sudo:session): session closed for user root Aug 10 15:48:45 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-41836fbe-dd89-490d-a066-1f40f1a818d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.273s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:48:45 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-41836fbe-dd89-490d-a066-1f40f1a818d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:48:45 devstack sudo[78609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 10 15:48:46 devstack sudo[78609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:48:46 devstack sudo[78609]: pam_unix(sudo:session): session closed for user root Aug 10 15:48:46 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-41836fbe-dd89-490d-a066-1f40f1a818d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:48:46 devstack cinder-volume[77758]: INFO cinder.volume.manager [None req-41836fbe-dd89-490d-a066-1f40f1a818d6 None None] Driver post RPC initialization completed successfully. Aug 10 15:48:48 devstack cinder-volume[77572]: DEBUG dbcounter [-] [77572] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=77572) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 15:48:55 devstack cinder-volume[77758]: DEBUG dbcounter [-] [77758] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=77758) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 15:48:56 devstack cinder-volume[77758]: DEBUG dbcounter [-] [77758] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=77758) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 15:49:38 devstack cinder-volume[77758]: DEBUG oslo_service.periodic_task [None req-ce3a358c-fbae-473e-9ea8-681825b12711 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77758) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 15:49:38 devstack cinder-volume[77758]: DEBUG cinder.volume.drivers.lvm [None req-ce3a358c-fbae-473e-9ea8-681825b12711 None None] Updating volume stats {{(pid=77758) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 10 15:49:38 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-ce3a358c-fbae-473e-9ea8-681825b12711 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:49:38 devstack sudo[80507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 10 15:49:38 devstack sudo[80507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:49:38 devstack sudo[80507]: pam_unix(sudo:session): session closed for user root Aug 10 15:49:38 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-ce3a358c-fbae-473e-9ea8-681825b12711 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:49:38 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-ce3a358c-fbae-473e-9ea8-681825b12711 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:49:38 devstack sudo[80544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 10 15:49:38 devstack sudo[80544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:49:38 devstack sudo[80544]: pam_unix(sudo:session): session closed for user root Aug 10 15:49:38 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-ce3a358c-fbae-473e-9ea8-681825b12711 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.288s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:49:38 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-ce3a358c-fbae-473e-9ea8-681825b12711 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:49:38 devstack sudo[80549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 10 15:49:38 devstack sudo[80549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:49:39 devstack sudo[80549]: pam_unix(sudo:session): session closed for user root Aug 10 15:49:39 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-ce3a358c-fbae-473e-9ea8-681825b12711 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.250s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:49:39 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-ce3a358c-fbae-473e-9ea8-681825b12711 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:49:39 devstack sudo[80552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 10 15:49:39 devstack sudo[80552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:49:39 devstack sudo[80552]: pam_unix(sudo:session): session closed for user root Aug 10 15:49:39 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-ce3a358c-fbae-473e-9ea8-681825b12711 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:49:39 devstack cinder-volume[77758]: DEBUG cinder.manager [None req-ce3a358c-fbae-473e-9ea8-681825b12711 None None] Notifying Schedulers of capabilities ... {{(pid=77758) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 15:49:39 devstack cinder-volume[77758]: DEBUG oslo_service.periodic_task [None req-ce3a358c-fbae-473e-9ea8-681825b12711 None None] Running periodic task VolumeManager._thread_info {{(pid=77758) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 15:49:39 devstack cinder-volume[77758]: DEBUG cinder.volume.manager [None req-ce3a358c-fbae-473e-9ea8-681825b12711 None None] thread count: 6 {{(pid=77758) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 10 15:49:39 devstack cinder-volume[77758]: DEBUG cinder.volume.manager [None req-ce3a358c-fbae-473e-9ea8-681825b12711 None None] thread info: [<_MainThread(MainThread, started 140343487639680)>, , , , , ] {{(pid=77758) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 10 15:50:38 devstack cinder-volume[77758]: DEBUG oslo_service.periodic_task [None req-ce3a358c-fbae-473e-9ea8-681825b12711 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77758) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 15:50:38 devstack cinder-volume[77758]: DEBUG cinder.volume.drivers.lvm [None req-ce3a358c-fbae-473e-9ea8-681825b12711 None None] Updating volume stats {{(pid=77758) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 10 15:50:38 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-ce3a358c-fbae-473e-9ea8-681825b12711 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:50:38 devstack sudo[83819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 10 15:50:38 devstack sudo[83819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:50:38 devstack sudo[83819]: pam_unix(sudo:session): session closed for user root Aug 10 15:50:38 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-ce3a358c-fbae-473e-9ea8-681825b12711 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:50:38 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-ce3a358c-fbae-473e-9ea8-681825b12711 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:50:38 devstack sudo[83822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 10 15:50:38 devstack sudo[83822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:50:38 devstack sudo[83822]: pam_unix(sudo:session): session closed for user root Aug 10 15:50:38 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-ce3a358c-fbae-473e-9ea8-681825b12711 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:50:38 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-ce3a358c-fbae-473e-9ea8-681825b12711 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:50:38 devstack sudo[83856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 10 15:50:38 devstack sudo[83856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:50:39 devstack sudo[83856]: pam_unix(sudo:session): session closed for user root Aug 10 15:50:39 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-ce3a358c-fbae-473e-9ea8-681825b12711 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:50:39 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-ce3a358c-fbae-473e-9ea8-681825b12711 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:50:39 devstack sudo[83864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 10 15:50:39 devstack sudo[83864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:50:39 devstack sudo[83864]: pam_unix(sudo:session): session closed for user root Aug 10 15:50:39 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-ce3a358c-fbae-473e-9ea8-681825b12711 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:50:39 devstack cinder-volume[77758]: DEBUG cinder.manager [None req-ce3a358c-fbae-473e-9ea8-681825b12711 None None] Notifying Schedulers of capabilities ... {{(pid=77758) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 15:50:39 devstack cinder-volume[77758]: DEBUG oslo_service.periodic_task [None req-ce3a358c-fbae-473e-9ea8-681825b12711 None None] Running periodic task VolumeManager._thread_info {{(pid=77758) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 15:50:39 devstack cinder-volume[77758]: DEBUG cinder.volume.manager [None req-ce3a358c-fbae-473e-9ea8-681825b12711 None None] thread count: 6 {{(pid=77758) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 10 15:50:39 devstack cinder-volume[77758]: DEBUG cinder.volume.manager [None req-ce3a358c-fbae-473e-9ea8-681825b12711 None None] thread info: [<_MainThread(MainThread, started 140343487639680)>, , , , , ] {{(pid=77758) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 10 15:50:56 devstack cinder-volume[77758]: DEBUG dbcounter [-] [77758] Writing DB stats cinder:SELECT=1 {{(pid=77758) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 15:50:56 devstack cinder-volume[77758]: DEBUG dbcounter [-] [77758] Writing DB stats cinder:UPDATE=1 {{(pid=77758) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 15:51:38 devstack cinder-volume[77758]: DEBUG oslo_service.periodic_task [None req-ce3a358c-fbae-473e-9ea8-681825b12711 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77758) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 15:51:38 devstack cinder-volume[77758]: DEBUG cinder.volume.drivers.lvm [None req-ce3a358c-fbae-473e-9ea8-681825b12711 None None] Updating volume stats {{(pid=77758) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 10 15:51:38 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-ce3a358c-fbae-473e-9ea8-681825b12711 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:51:38 devstack sudo[85717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 10 15:51:38 devstack sudo[85717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:51:38 devstack sudo[85717]: pam_unix(sudo:session): session closed for user root Aug 10 15:51:38 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-ce3a358c-fbae-473e-9ea8-681825b12711 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:51:38 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-ce3a358c-fbae-473e-9ea8-681825b12711 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:51:38 devstack sudo[85734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 10 15:51:38 devstack sudo[85734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:51:38 devstack sudo[85734]: pam_unix(sudo:session): session closed for user root Aug 10 15:51:38 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-ce3a358c-fbae-473e-9ea8-681825b12711 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.289s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:51:38 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-ce3a358c-fbae-473e-9ea8-681825b12711 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:51:38 devstack sudo[85740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 10 15:51:38 devstack sudo[85740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:51:39 devstack sudo[85740]: pam_unix(sudo:session): session closed for user root Aug 10 15:51:39 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-ce3a358c-fbae-473e-9ea8-681825b12711 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:51:39 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-ce3a358c-fbae-473e-9ea8-681825b12711 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:51:39 devstack sudo[85752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 10 15:51:39 devstack sudo[85752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:51:39 devstack sudo[85752]: pam_unix(sudo:session): session closed for user root Aug 10 15:51:39 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-ce3a358c-fbae-473e-9ea8-681825b12711 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.305s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:51:39 devstack cinder-volume[77758]: DEBUG cinder.manager [None req-ce3a358c-fbae-473e-9ea8-681825b12711 None None] Notifying Schedulers of capabilities ... {{(pid=77758) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 15:52:38 devstack cinder-volume[77758]: DEBUG oslo_service.periodic_task [None req-ce3a358c-fbae-473e-9ea8-681825b12711 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77758) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 15:52:38 devstack cinder-volume[77758]: DEBUG cinder.volume.drivers.lvm [None req-ce3a358c-fbae-473e-9ea8-681825b12711 None None] Updating volume stats {{(pid=77758) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 10 15:52:38 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-ce3a358c-fbae-473e-9ea8-681825b12711 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:52:38 devstack sudo[87082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 10 15:52:38 devstack sudo[87082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:52:38 devstack sudo[87082]: pam_unix(sudo:session): session closed for user root Aug 10 15:52:38 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-ce3a358c-fbae-473e-9ea8-681825b12711 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:52:38 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-ce3a358c-fbae-473e-9ea8-681825b12711 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:52:38 devstack sudo[87103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 10 15:52:38 devstack sudo[87103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:52:38 devstack sudo[87103]: pam_unix(sudo:session): session closed for user root Aug 10 15:52:38 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-ce3a358c-fbae-473e-9ea8-681825b12711 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:52:38 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-ce3a358c-fbae-473e-9ea8-681825b12711 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:52:38 devstack sudo[87111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 10 15:52:38 devstack sudo[87111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:52:39 devstack sudo[87111]: pam_unix(sudo:session): session closed for user root Aug 10 15:52:39 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-ce3a358c-fbae-473e-9ea8-681825b12711 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.248s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:52:39 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-ce3a358c-fbae-473e-9ea8-681825b12711 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:52:39 devstack sudo[87114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 10 15:52:39 devstack sudo[87114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:52:39 devstack sudo[87114]: pam_unix(sudo:session): session closed for user root Aug 10 15:52:39 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-ce3a358c-fbae-473e-9ea8-681825b12711 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:52:39 devstack cinder-volume[77758]: DEBUG cinder.manager [None req-ce3a358c-fbae-473e-9ea8-681825b12711 None None] Notifying Schedulers of capabilities ... {{(pid=77758) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 15:52:39 devstack cinder-volume[77758]: DEBUG oslo_service.periodic_task [None req-ce3a358c-fbae-473e-9ea8-681825b12711 None None] Running periodic task VolumeManager._thread_info {{(pid=77758) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 15:52:39 devstack cinder-volume[77758]: DEBUG cinder.volume.manager [None req-ce3a358c-fbae-473e-9ea8-681825b12711 None None] thread count: 6 {{(pid=77758) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 10 15:52:39 devstack cinder-volume[77758]: DEBUG cinder.volume.manager [None req-ce3a358c-fbae-473e-9ea8-681825b12711 None None] thread info: [<_MainThread(MainThread, started 140343487639680)>, , , , , ] {{(pid=77758) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 10 15:52:56 devstack cinder-volume[77758]: DEBUG dbcounter [-] [77758] Writing DB stats cinder:SELECT=1 {{(pid=77758) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 15:52:56 devstack cinder-volume[77758]: DEBUG dbcounter [-] [77758] Writing DB stats cinder:UPDATE=1 {{(pid=77758) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 15:53:08 devstack cinder-volume[77572]: INFO oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] Caught SIGTERM, stopping children Aug 10 15:53:08 devstack cinder-volume[77572]: DEBUG oslo_concurrency.lockutils [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] Acquiring lock "singleton_lock" {{(pid=77572) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 10 15:53:08 devstack cinder-volume[77572]: DEBUG oslo_concurrency.lockutils [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] Acquired lock "singleton_lock" {{(pid=77572) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 10 15:53:08 devstack cinder-volume[77572]: DEBUG oslo_concurrency.lockutils [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] Releasing lock "singleton_lock" {{(pid=77572) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 10 15:53:08 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] Stop services. {{(pid=77572) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Aug 10 15:53:08 devstack cinder-volume[77572]: DEBUG oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] Killing children. {{(pid=77572) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Aug 10 15:53:08 devstack cinder-volume[77572]: INFO oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] Waiting on 1 children to exit Aug 10 15:53:10 devstack cinder-volume[77758]: DEBUG oslo_concurrency.lockutils [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] Acquiring lock "singleton_lock" {{(pid=77758) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 10 15:53:10 devstack cinder-volume[77758]: DEBUG oslo_concurrency.lockutils [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] Acquired lock "singleton_lock" {{(pid=77758) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 10 15:53:10 devstack cinder-volume[77758]: DEBUG oslo_concurrency.lockutils [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] Releasing lock "singleton_lock" {{(pid=77758) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 10 15:53:10 devstack cinder-volume[77758]: WARNING amqp [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 10 15:53:10 devstack cinder-volume[77758]: WARNING amqp [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 10 15:53:10 devstack cinder-volume[77572]: INFO oslo_service.backend._eventlet.service [None req-e4f11e60-f277-4f61-9a07-9b8cd80e57e2 None None] Child 77758 exited with status 0 Aug 10 15:53:10 devstack cinder-volume[87845]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 10 15:53:10 devstack cinder-volume[87845]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 10 15:53:10 devstack cinder-volume[87845]: we strongly recommend against using it for new projects. Aug 10 15:53:10 devstack cinder-volume[87845]: If you are already using Eventlet, we recommend migrating to a different Aug 10 15:53:10 devstack cinder-volume[87845]: framework. For more detail see Aug 10 15:53:10 devstack cinder-volume[87845]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 10 15:53:10 devstack cinder-volume[87845]: import eventlet # noqa Aug 10 15:53:12 devstack cinder-volume[87845]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87845) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 10 15:53:12 devstack cinder-volume[87845]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87845) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 10 15:53:12 devstack cinder-volume[87845]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87845) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 10 15:53:13 devstack cinder-volume[87845]: INFO dbcounter [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] Registered counter for database cinder Aug 10 15:53:13 devstack cinder-volume[87845]: DEBUG oslo_db.sqlalchemy.engines [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87845) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 10 15:53:13 devstack cinder-volume[87845]: DEBUG dbcounter [-] [87845] Writer thread running {{(pid=87845) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 10 15:53:13 devstack cinder-volume[87845]: INFO cinder.rpc [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 10 15:53:13 devstack cinder-volume[87845]: INFO cinder.rpc [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 10 15:53:13 devstack cinder-volume[87845]: DEBUG oslo_db.sqlalchemy.engines [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87845) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 10 15:53:13 devstack cinder-volume[87845]: INFO cinder.volume.manager [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] Determined volume DB was empty at startup. Aug 10 15:53:13 devstack cinder-volume[87845]: DEBUG cinder.volume.manager [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87845) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 10 15:53:13 devstack cinder-volume[87845]: INFO cinder.volume.manager [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] Service not found for updating active_backend_id, assuming default for driver init. Aug 10 15:53:13 devstack cinder-volume[87845]: WARNING stevedore.named [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 10 15:53:13 devstack cinder-volume[87845]: WARNING castellan.key_manager [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 10 15:53:13 devstack cinder-volume[87845]: WARNING cinder.keymgr.conf_key_mgr [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 10 15:53:13 devstack cinder-volume[87845]: INFO cinder.volume.manager [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] Image-volume cache disabled for host devstack@QuobyteHD. Aug 10 15:53:13 devstack cinder-volume[87845]: DEBUG oslo_db.sqlalchemy.engines [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87845) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 10 15:53:13 devstack cinder-volume[87845]: INFO oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] Starting 1 workers Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] Started child 88062 {{(pid=87845) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] Full set of CONF: {{(pid=87845) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] ******************************************************************************** {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3518}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] Configuration options gathered from: {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3519}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3520}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3521}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] ================================================================================ {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3526}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] allow_availability_zone_fallback = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] allow_compression_on_image_upload = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] allowed_direct_url_schemes = [] {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] api_rate_limit = True {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] auth_strategy = keystone {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backend_availability_zone = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backend_host = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backend_name = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backend_stats_polling_interval = 60 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[88062]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backup_api_class = cinder.backup.api.API {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backup_name_template = backup-%s {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backup_use_same_host = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backup_use_temp_snapshot = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] chap_password = **** {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] chap_username = {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] cinder_internal_tenant_project_id = 4366ef1be7ef4ad59265f9f8d1cf6cf2 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] cinder_internal_tenant_user_id = 48366b44f69249a7ab4fa19ac32a7326 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] cluster = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] compression_format = gzip {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] compute_api_class = cinder.compute.nova.API {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] config_dir = [] {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] config_source = [] {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] control_exchange = openstack {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] debug = True {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] default_availability_zone = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] default_group_type = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] default_volume_type = QuobyteHD {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] disk_geometry = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] driver_client_cert = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] driver_client_cert_key = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] driver_data_namespace = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] driver_ssl_cert_path = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] driver_ssl_cert_verify = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] driver_use_ssl = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] enable_new_services = True {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] enable_unsupported_driver = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] enabled_backends = ['QuobyteHD'] {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] enforce_multipath_for_image_xfer = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] filter_function = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] glance_api_insecure = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] glance_api_servers = ['http://192.168.122.68/image'] {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] glance_api_ssl_compression = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] glance_ca_certificates_file = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] glance_catalog_info = image:glance:publicURL {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] glance_certfile = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] glance_keyfile = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] glance_num_retries = 3 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] glance_request_timeout = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] goodness_function = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] graceful_shutdown_timeout = 5 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] group_api_class = cinder.group.api.API {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] host = devstack {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] image_compress_on_upload = True {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] image_conversion_address_space_limit = 1 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] image_conversion_cpu_limit = 60 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] image_conversion_disable = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] image_upload_use_cinder_backend = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] image_upload_use_internal_tenant = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] image_volume_cache_enabled = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] image_volume_cache_max_count = 0 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] image_volume_cache_max_size_gb = 0 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] init_host_max_objects_retrieval = 0 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] instance_format = [instance: %(uuid)s] {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] iscsi_target_flags = {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] iscsi_write_cache = on {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] iser_helper = tgtadm {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] iser_ip_address = 192.168.122.68 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] iser_port = 3260 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] log_color = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] log_config_append = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] log_dir = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] log_file = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] log_options = True {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] log_rotate_interval = 1 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] log_rotate_interval_type = days {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] log_rotation_type = none {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] max_age = 0 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] max_logfile_count = 30 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] max_logfile_size_mb = 200 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] max_over_subscription_ratio = 20.0 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] message_reap_interval = 86400 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] message_ttl = 2592000 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] migration_create_volume_timeout_secs = 300 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] monkey_patch = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] monkey_patch_modules = [] {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] my_ip = 192.168.122.68 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] no_snapshot_gb_quota = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] num_iser_scan_tries = 3 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] num_shell_tries = 3 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] num_volume_device_scan_tries = 3 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] nvmeof_conn_info_version = 1 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] nvmet_ns_id = 10 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] nvmet_port_id = 1 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] osapi_max_limit = 1000 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] osapi_volume_ext_list = [] {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] osapi_volume_listen = 0.0.0.0 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] osapi_volume_listen_port = 8776 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] osapi_volume_use_ssl = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] osapi_volume_workers = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] per_volume_size_limit = -1 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] periodic_fuzzy_delay = 60 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] periodic_interval = 60 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] project_id_regex = [0-9a-f\-]+ {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] public_endpoint = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] publish_errors = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] quota_backup_gigabytes = 1000 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] quota_backups = 10 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] quota_gigabytes = 1000 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] quota_groups = 10 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] quota_snapshots = 10 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] quota_volumes = 10 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] rate_limit_burst = 0 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] rate_limit_except_level = CRITICAL {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] rate_limit_interval = 0 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] reinit_driver_count = 3 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] replication_device = **** {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] report_discard_supported = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] report_interval = 120 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] reservation_clean_interval = 86400 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] reservation_expire = 86400 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] reserved_image_namespaces = [] {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] reserved_percentage = 0 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] rpc_response_timeout = 120 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] run_external_periodic_tasks = True {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] scst_target_driver = iscsi {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] scst_target_iqn_name = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] service_down_time = 720 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] shell_completion = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] snapshot_name_template = snapshot-%s {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] split_loggers = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] state_path = /opt/stack/data/cinder {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] storage_availability_zone = nova {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] storage_protocol = iSCSI {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] syslog_log_facility = LOG_USER {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] target_helper = lioadm {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] target_ip_address = 192.168.122.68 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] target_nvme_fc_traddrs = [] {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] target_port = 3260 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] target_protocol = iscsi {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] target_secondary_ip_addresses = [] {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] trace_flags = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] transfer_api_class = cinder.transfer.api.API {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] transport_url = **** {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] until_refresh = 0 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] use_chap_auth = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] use_default_quota_class = True {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] use_journal = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] use_json = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] use_multipath_for_image_xfer = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] use_stderr = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] use_syslog = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] verify_glance_signatures = enabled {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] volume_api_class = cinder.volume.api.API {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] volume_backend_name = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] volume_clear = zero {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] volume_clear_ionice = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] volume_clear_size = 0 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[88062]: INFO cinder.volume.manager [None req-7b7500d3-215d-4840-a664-81e60b0a5f8f None None] Starting volume driver QuobyteDriver (1.2) Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] volume_copy_bps_limit = 0 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[88062]: DEBUG cinder.volume.drivers.remotefs [None req-7b7500d3-215d-4840-a664-81e60b0a5f8f None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=88062) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] volume_dd_blocksize = 1M {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] volume_name_template = volume-%s {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] volume_service_inithost_offload = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] volume_usage_audit_period = month {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] zoning_mode = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] oslo_concurrency.disable_process_locking = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] keystone_authtoken.auth_section = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] keystone_authtoken.auth_type = password {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] keystone_authtoken.auth_version = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] keystone_authtoken.cache = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] keystone_authtoken.certfile = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] keystone_authtoken.include_service_catalog = True {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] keystone_authtoken.insecure = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] keystone_authtoken.interface = public {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] keystone_authtoken.keyfile = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] keystone_authtoken.memcache_password = {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] keystone_authtoken.memcache_username = {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] keystone_authtoken.region_name = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] keystone_authtoken.service_type = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.68/identity {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] cache.backend = dogpile.cache.null {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] cache.backend_argument = **** {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] cache.backend_expiration_time = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] cache.config_prefix = cache.oslo {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] cache.debug_cache_backend = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] cache.enable_retry_client = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] cache.enable_socket_keepalive = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] cache.enabled = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] cache.expiration_time = 600 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] cache.hashclient_retry_attempts = 2 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] cache.memcache_dead_retry = 300 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] cache.memcache_pool_maxsize = 10 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] cache.memcache_sasl_enabled = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] cache.password = **** {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] cache.proxies = [] {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] cache.redis_db = 0 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] cache.redis_server = localhost:6379 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] cache.retry_attempts = 2 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] cache.retry_delay = 0.0 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] cache.socket_keepalive_count = 1 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] cache.socket_keepalive_idle = 1 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] cache.socket_keepalive_interval = 1 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] cache.socket_timeout = 1.0 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] cache.tls_allowed_ciphers = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] cache.tls_cafile = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] cache.tls_certfile = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] cache.tls_enabled = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] cache.tls_keyfile = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] cache.username = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] coordination.backend_url = **** {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] database.asyncio_connection = **** {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] database.asyncio_slave_connection = **** {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] database.backend = sqlalchemy {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] database.connection = **** {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] database.connection_debug = 0 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] database.connection_parameters = {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] database.connection_recycle_time = 3600 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] database.connection_trace = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] database.db_inc_retry_interval = True {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] database.db_max_retries = 20 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] database.db_max_retry_interval = 10 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] database.db_retry_interval = 1 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] database.max_overflow = 50 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] database.max_pool_size = 5 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] database.max_retries = 10 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] database.mysql_wsrep_sync_wait = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] database.pool_timeout = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] database.retry_interval = 10 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] database.slave_connection = **** {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] database.sqlite_synchronous = True {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] database.synchronous_reader = True {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] database.use_db_reconnect = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] profiler.connection_string = messaging:// {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] profiler.enabled = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] profiler.es_doc_type = notification {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] profiler.es_scroll_size = 10000 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] profiler.es_scroll_time = 2m {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] profiler.filter_error_trace = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] profiler.hmac_keys = **** {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] profiler.sentinel_service_name = mymaster {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] profiler.socket_timeout = 0.1 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] profiler.trace_requests = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] profiler.trace_sqlalchemy = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] profiler_jaeger.process_tags = {} {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] profiler_jaeger.service_name_prefix = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] profiler_otlp.service_name_prefix = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] oslo_policy.enforce_new_defaults = True {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] oslo_policy.policy_default_rule = default {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] oslo_policy.policy_file = policy.yaml {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] oslo_policy.remote_timeout = 60.0 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] privsep_osbrick.group = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] privsep_osbrick.helper_command = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] privsep_osbrick.user = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] cinder_sys_admin.group = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] cinder_sys_admin.helper_command = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] cinder_sys_admin.user = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] service_user.auth_section = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] service_user.auth_type = password {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] service_user.cafile = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] service_user.certfile = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] service_user.collect_timing = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] service_user.insecure = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] service_user.keyfile = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] service_user.send_service_user_token = True {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] service_user.split_loggers = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] service_user.timeout = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] glance.auth_section = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] glance.auth_type = password {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] glance.certfile = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] glance.collect_timing = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] glance.insecure = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] glance.keyfile = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] glance.region_name = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] glance.split_loggers = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] glance.timeout = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backend_defaults.backend_availability_zone = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backend_defaults.chap_password = **** {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backend_defaults.chap_username = {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backend_defaults.disk_geometry = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backend_defaults.driver_client_cert = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backend_defaults.driver_client_cert_key = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backend_defaults.driver_data_namespace = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backend_defaults.driver_use_ssl = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backend_defaults.extra_capabilities = {} {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backend_defaults.filter_function = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backend_defaults.goodness_function = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backend_defaults.iscsi_target_flags = {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backend_defaults.iscsi_write_cache = on {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backend_defaults.iser_helper = tgtadm {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backend_defaults.iser_ip_address = 192.168.122.68 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backend_defaults.iser_port = 3260 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backend_defaults.nas_host = {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backend_defaults.nas_login = admin {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backend_defaults.nas_mount_options = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backend_defaults.nas_password = **** {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backend_defaults.nas_private_key = {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backend_defaults.nas_share_path = {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backend_defaults.nas_ssh_port = 22 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backend_defaults.num_shell_tries = 3 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backend_defaults.quobyte_volume_url = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backend_defaults.replication_device = **** {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backend_defaults.report_discard_supported = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backend_defaults.reserved_percentage = 0 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backend_defaults.target_helper = tgtadm {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backend_defaults.target_ip_address = 192.168.122.68 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backend_defaults.target_nvme_fc_traddrs = [] {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backend_defaults.target_port = 3260 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backend_defaults.target_protocol = iscsi {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backend_defaults.trace_flags = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backend_defaults.unique_fqdn_network = True {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backend_defaults.use_chap_auth = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backend_defaults.volume_backend_name = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backend_defaults.volume_clear = zero {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backend_defaults.volume_clear_ionice = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backend_defaults.volume_clear_size = 0 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] oslo_reports.file_event_handler = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] oslo_reports.log_dir = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] QuobyteHD.backend_availability_zone = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] QuobyteHD.backend_host = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] QuobyteHD.chap_password = **** {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] QuobyteHD.chap_username = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] QuobyteHD.chiscsi_conf = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] QuobyteHD.disk_geometry = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] QuobyteHD.driver_client_cert = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] QuobyteHD.driver_data_namespace = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] QuobyteHD.driver_use_ssl = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] QuobyteHD.extra_capabilities = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] QuobyteHD.filter_function = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] QuobyteHD.goodness_function = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] QuobyteHD.iscsi_target_flags = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] QuobyteHD.iscsi_write_cache = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] QuobyteHD.iser_helper = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] QuobyteHD.iser_ip_address = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] QuobyteHD.iser_port = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] QuobyteHD.iser_target_prefix = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] QuobyteHD.nas_host = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] QuobyteHD.nas_login = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] QuobyteHD.nas_mount_options = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] QuobyteHD.nas_password = **** {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] QuobyteHD.nas_private_key = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] QuobyteHD.nas_share_path = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] QuobyteHD.nas_ssh_port = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] QuobyteHD.num_shell_tries = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] QuobyteHD.nvmet_ns_id = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] QuobyteHD.nvmet_port_id = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[88062]: DEBUG cinder.volume.drivers.quobyte [None req-7b7500d3-215d-4840-a664-81e60b0a5f8f None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=88062) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Aug 10 15:53:14 devstack cinder-volume[88062]: WARNING cinder.volume.drivers.quobyte [None req-7b7500d3-215d-4840-a664-81e60b0a5f8f None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Aug 10 15:53:14 devstack cinder-volume[88062]: WARNING cinder.volume.drivers.quobyte [None req-7b7500d3-215d-4840-a664-81e60b0a5f8f None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] QuobyteHD.replication_device = **** {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] QuobyteHD.report_discard_supported = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] QuobyteHD.reserved_percentage = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[88062]: DEBUG oslo_concurrency.processutils [None req-7b7500d3-215d-4840-a664-81e60b0a5f8f None None] Running cmd (subprocess): mount.quobyte {{(pid=88062) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] QuobyteHD.scst_target_driver = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] QuobyteHD.storage_protocol = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] QuobyteHD.target_helper = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] QuobyteHD.target_ip_address = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] QuobyteHD.target_nvme_fc_traddrs = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] QuobyteHD.target_port = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] QuobyteHD.target_prefix = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] QuobyteHD.target_protocol = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] QuobyteHD.trace_flags = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] QuobyteHD.unique_fqdn_network = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] QuobyteHD.use_chap_auth = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] QuobyteHD.volume_clear = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] QuobyteHD.volume_clear_ionice = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] QuobyteHD.volume_clear_size = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] QuobyteHD.volumes_dir = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] oslo_messaging_rabbit.ssl = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] oslo_messaging_rabbit.ssl_version = {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] oslo_messaging_notifications.driver = [] {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] oslo_messaging_notifications.retry = -1 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] key_manager.fixed_key = **** {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] barbican.barbican_api_version = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] barbican.barbican_endpoint = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] barbican.barbican_endpoint_type = public {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] barbican.barbican_region_name = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] barbican.cafile = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] barbican.certfile = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] barbican.collect_timing = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] barbican.insecure = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] barbican.keyfile = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] barbican.number_of_retries = 60 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] barbican.retry_delay = 1 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] barbican.send_service_user_token = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] barbican.split_loggers = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] barbican.timeout = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] barbican.verify_ssl = True {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] barbican.verify_ssl_path = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] barbican_service_user.auth_section = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] barbican_service_user.auth_type = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] barbican_service_user.cafile = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] barbican_service_user.certfile = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] barbican_service_user.collect_timing = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] barbican_service_user.insecure = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] barbican_service_user.keyfile = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] barbican_service_user.split_loggers = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] barbican_service_user.timeout = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] vault.approle_role_id = **** {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] vault.approle_secret_id = **** {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] vault.auth_method = approle {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] vault.auth_path = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] vault.kv_mountpoint = secret {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] vault.kv_path = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] vault.kv_version = 2 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] vault.namespace = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] vault.root_token_id = **** {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] vault.ssl_ca_crt_file = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] vault.timeout = 60.0 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] vault.token_file = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] vault.token_role = None {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] vault.use_ssl = False {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:14 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] ******************************************************************************** {{(pid=87845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3552}} Aug 10 15:53:14 devstack quobyte-client[88065]: Reading configuration file: /etc/quobyte/client.cfg Aug 10 15:53:14 devstack quobyte-client[88065]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Aug 10 15:53:14 devstack cinder-volume[88062]: DEBUG oslo_concurrency.processutils [None req-7b7500d3-215d-4840-a664-81e60b0a5f8f None None] CMD "mount.quobyte" returned: 1 in 0.125s {{(pid=88062) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:53:14 devstack cinder-volume[88062]: DEBUG oslo_concurrency.lockutils [None req-7b7500d3-215d-4840-a664-81e60b0a5f8f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88062) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:53:14 devstack cinder-volume[88062]: DEBUG oslo_concurrency.lockutils [None req-7b7500d3-215d-4840-a664-81e60b0a5f8f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88062) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:53:14 devstack cinder-volume[88062]: DEBUG cinder.volume.drivers.quobyte [None req-7b7500d3-215d-4840-a664-81e60b0a5f8f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88062) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 15:53:14 devstack cinder-volume[88062]: INFO cinder.volume.drivers.quobyte [None req-7b7500d3-215d-4840-a664-81e60b0a5f8f None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc ... Aug 10 15:53:14 devstack cinder-volume[88062]: DEBUG oslo_concurrency.processutils [None req-7b7500d3-215d-4840-a664-81e60b0a5f8f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f -c /etc/quobyte/client-cinder.cfg {{(pid=88062) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:53:14 devstack sudo[88068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f -c /etc/quobyte/client-cinder.cfg Aug 10 15:53:14 devstack sudo[88068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:53:14 devstack sudo[88068]: pam_unix(sudo:session): session closed for user root Aug 10 15:53:14 devstack cinder-volume[88062]: DEBUG oslo_concurrency.processutils [None req-7b7500d3-215d-4840-a664-81e60b0a5f8f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.383s {{(pid=88062) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:53:14 devstack cinder-volume[88062]: INFO cinder.volume.drivers.quobyte [None req-7b7500d3-215d-4840-a664-81e60b0a5f8f None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc succeeded Aug 10 15:53:14 devstack cinder-volume[88062]: DEBUG cinder.volume.drivers.quobyte [None req-7b7500d3-215d-4840-a664-81e60b0a5f8f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88062) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 15:53:14 devstack cinder-volume[88062]: DEBUG oslo_concurrency.lockutils [None req-7b7500d3-215d-4840-a664-81e60b0a5f8f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.396s {{(pid=88062) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:53:14 devstack cinder-volume[88062]: DEBUG oslo_concurrency.processutils [None req-7b7500d3-215d-4840-a664-81e60b0a5f8f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88062) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:53:14 devstack sudo[88137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 15:53:14 devstack sudo[88137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:53:14 devstack sudo[88137]: pam_unix(sudo:session): session closed for user root Aug 10 15:53:14 devstack cinder-volume[88062]: DEBUG oslo_concurrency.processutils [None req-7b7500d3-215d-4840-a664-81e60b0a5f8f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.233s {{(pid=88062) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:53:14 devstack cinder-volume[88062]: INFO cinder.volume.driver [None req-7b7500d3-215d-4840-a664-81e60b0a5f8f None None] Driver hasn't implemented _init_vendor_properties() Aug 10 15:53:14 devstack cinder-volume[88062]: DEBUG cinder.volume.driver [None req-7b7500d3-215d-4840-a664-81e60b0a5f8f None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7576522827148, 'free_capacity_gb': 1775.7576522827148, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88062) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:887}} Aug 10 15:53:15 devstack cinder-volume[88062]: DEBUG oslo_db.sqlalchemy.engines [None req-7b7500d3-215d-4840-a664-81e60b0a5f8f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88062) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 10 15:53:15 devstack cinder-volume[88062]: DEBUG dbcounter [-] [88062] Writer thread running {{(pid=88062) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 10 15:53:15 devstack cinder-volume[88062]: DEBUG cinder.db.api [None req-7b7500d3-215d-4840-a664-81e60b0a5f8f None None] Building query based on filter {{(pid=88062) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 10 15:53:15 devstack cinder-volume[88062]: DEBUG cinder.image.image_utils [None req-7b7500d3-215d-4840-a664-81e60b0a5f8f None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=88062) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 10 15:53:15 devstack cinder-volume[88062]: INFO cinder.keymgr.migration [None req-216bc5de-d15b-42f5-81c4-a893a7b9b5b3 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 10 15:53:15 devstack cinder-volume[88062]: DEBUG oslo_concurrency.lockutils [None req-7b7500d3-215d-4840-a664-81e60b0a5f8f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88062) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:53:15 devstack cinder-volume[88062]: DEBUG oslo_concurrency.lockutils [None req-7b7500d3-215d-4840-a664-81e60b0a5f8f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88062) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:53:15 devstack cinder-volume[88062]: DEBUG cinder.volume.drivers.quobyte [None req-7b7500d3-215d-4840-a664-81e60b0a5f8f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88062) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 15:53:15 devstack cinder-volume[88062]: DEBUG cinder.volume.drivers.quobyte [None req-7b7500d3-215d-4840-a664-81e60b0a5f8f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88062) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 15:53:15 devstack cinder-volume[88062]: DEBUG oslo_concurrency.lockutils [None req-7b7500d3-215d-4840-a664-81e60b0a5f8f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88062) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:53:15 devstack cinder-volume[88062]: DEBUG oslo_concurrency.processutils [None req-7b7500d3-215d-4840-a664-81e60b0a5f8f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88062) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:53:15 devstack sudo[88140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 15:53:15 devstack sudo[88140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:53:15 devstack sudo[88140]: pam_unix(sudo:session): session closed for user root Aug 10 15:53:15 devstack cinder-volume[88062]: DEBUG oslo_concurrency.processutils [None req-7b7500d3-215d-4840-a664-81e60b0a5f8f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.235s {{(pid=88062) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:53:15 devstack cinder-volume[88062]: DEBUG cinder.manager [None req-7b7500d3-215d-4840-a664-81e60b0a5f8f None None] Notifying Schedulers of capabilities ... {{(pid=88062) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 15:53:15 devstack cinder-volume[88062]: INFO cinder.volume.manager [None req-7b7500d3-215d-4840-a664-81e60b0a5f8f None None] Driver initialization completed successfully. Aug 10 15:53:15 devstack cinder-volume[88062]: INFO cinder.manager [None req-7b7500d3-215d-4840-a664-81e60b0a5f8f None None] Initiating service 3 cleanup Aug 10 15:53:15 devstack cinder-volume[88062]: INFO cinder.manager [None req-7b7500d3-215d-4840-a664-81e60b0a5f8f None None] Service 3 cleanup completed. Aug 10 15:53:15 devstack cinder-volume[88062]: DEBUG cinder.service [None req-7b7500d3-215d-4840-a664-81e60b0a5f8f None None] Creating RPC server for service cinder-volume {{(pid=88062) start /opt/stack/cinder/cinder/service.py:231}} Aug 10 15:53:15 devstack cinder-volume[88062]: DEBUG cinder.service [None req-7b7500d3-215d-4840-a664-81e60b0a5f8f None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=88062) start /opt/stack/cinder/cinder/service.py:237}} Aug 10 15:53:15 devstack cinder-volume[88062]: INFO cinder.volume.manager [None req-7b7500d3-215d-4840-a664-81e60b0a5f8f None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Aug 10 15:53:15 devstack cinder-volume[88062]: DEBUG oslo_concurrency.lockutils [None req-7b7500d3-215d-4840-a664-81e60b0a5f8f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88062) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:53:15 devstack cinder-volume[88062]: DEBUG oslo_concurrency.lockutils [None req-7b7500d3-215d-4840-a664-81e60b0a5f8f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88062) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:53:15 devstack cinder-volume[88062]: DEBUG cinder.volume.drivers.quobyte [None req-7b7500d3-215d-4840-a664-81e60b0a5f8f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88062) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 15:53:15 devstack cinder-volume[88062]: DEBUG cinder.volume.drivers.quobyte [None req-7b7500d3-215d-4840-a664-81e60b0a5f8f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88062) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 15:53:15 devstack cinder-volume[88062]: DEBUG oslo_concurrency.lockutils [None req-7b7500d3-215d-4840-a664-81e60b0a5f8f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88062) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:53:15 devstack cinder-volume[88062]: DEBUG oslo_concurrency.processutils [None req-7b7500d3-215d-4840-a664-81e60b0a5f8f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88062) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:53:15 devstack sudo[88144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 15:53:15 devstack sudo[88144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:53:15 devstack sudo[88144]: pam_unix(sudo:session): session closed for user root Aug 10 15:53:15 devstack cinder-volume[88062]: DEBUG oslo_concurrency.processutils [None req-7b7500d3-215d-4840-a664-81e60b0a5f8f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.239s {{(pid=88062) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:53:15 devstack cinder-volume[88062]: INFO cinder.volume.manager [None req-7b7500d3-215d-4840-a664-81e60b0a5f8f None None] Driver post RPC initialization completed successfully. Aug 10 15:53:20 devstack cinder-volume[87845]: INFO oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] Caught SIGTERM, stopping children Aug 10 15:53:20 devstack cinder-volume[87845]: DEBUG oslo_concurrency.lockutils [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] Acquiring lock "singleton_lock" {{(pid=87845) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 10 15:53:20 devstack cinder-volume[87845]: DEBUG oslo_concurrency.lockutils [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] Acquired lock "singleton_lock" {{(pid=87845) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 10 15:53:20 devstack cinder-volume[87845]: DEBUG oslo_concurrency.lockutils [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] Releasing lock "singleton_lock" {{(pid=87845) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 10 15:53:20 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] Stop services. {{(pid=87845) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Aug 10 15:53:20 devstack cinder-volume[87845]: DEBUG oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] Killing children. {{(pid=87845) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Aug 10 15:53:20 devstack cinder-volume[87845]: INFO oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] Waiting on 1 children to exit Aug 10 15:53:23 devstack cinder-volume[88062]: DEBUG oslo_concurrency.lockutils [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] Acquiring lock "singleton_lock" {{(pid=88062) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 10 15:53:23 devstack cinder-volume[88062]: DEBUG oslo_concurrency.lockutils [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] Acquired lock "singleton_lock" {{(pid=88062) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 10 15:53:23 devstack cinder-volume[88062]: DEBUG oslo_concurrency.lockutils [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] Releasing lock "singleton_lock" {{(pid=88062) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 10 15:53:23 devstack cinder-volume[88062]: WARNING amqp [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 10 15:53:23 devstack cinder-volume[88062]: WARNING amqp [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 10 15:53:23 devstack cinder-volume[87845]: INFO oslo_service.backend._eventlet.service [None req-cd47080c-c094-447e-9168-1aa992edc671 None None] Child 88062 exited with status 0 Aug 10 15:53:24 devstack cinder-volume[88350]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 10 15:53:24 devstack cinder-volume[88350]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 10 15:53:24 devstack cinder-volume[88350]: we strongly recommend against using it for new projects. Aug 10 15:53:24 devstack cinder-volume[88350]: If you are already using Eventlet, we recommend migrating to a different Aug 10 15:53:24 devstack cinder-volume[88350]: framework. For more detail see Aug 10 15:53:24 devstack cinder-volume[88350]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 10 15:53:24 devstack cinder-volume[88350]: import eventlet # noqa Aug 10 15:53:26 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=88350) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 10 15:53:26 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=88350) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 10 15:53:26 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=88350) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 10 15:53:27 devstack cinder-volume[88350]: INFO dbcounter [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] Registered counter for database cinder Aug 10 15:53:27 devstack cinder-volume[88350]: DEBUG oslo_db.sqlalchemy.engines [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88350) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG dbcounter [-] [88350] Writer thread running {{(pid=88350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 10 15:53:28 devstack cinder-volume[88350]: INFO cinder.rpc [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 10 15:53:28 devstack cinder-volume[88350]: INFO cinder.rpc [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_db.sqlalchemy.engines [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88350) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 10 15:53:28 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] Determined volume DB was empty at startup. Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] Cinder Volume DB check: vol_db_empty=True {{(pid=88350) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 10 15:53:28 devstack cinder-volume[88350]: WARNING stevedore.named [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 10 15:53:28 devstack cinder-volume[88350]: WARNING castellan.key_manager [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 10 15:53:28 devstack cinder-volume[88350]: WARNING cinder.keymgr.conf_key_mgr [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 10 15:53:28 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] Image-volume cache disabled for host devstack@QuobyteHD. Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_db.sqlalchemy.engines [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88350) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 10 15:53:28 devstack cinder-volume[88350]: INFO oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] Starting 1 workers Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] Started child 88641 {{(pid=88350) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] Full set of CONF: {{(pid=88350) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] ******************************************************************************** {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3518}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] Configuration options gathered from: {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3519}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3520}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3521}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] ================================================================================ {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3526}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] allow_availability_zone_fallback = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] allow_compression_on_image_upload = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] allowed_direct_url_schemes = [] {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] api_rate_limit = True {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] auth_strategy = keystone {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backend_availability_zone = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backend_host = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backend_name = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backend_stats_polling_interval = 60 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backup_api_class = cinder.backup.api.API {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backup_name_template = backup-%s {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backup_use_same_host = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backup_use_temp_snapshot = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] chap_password = **** {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] chap_username = {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88641]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] cinder_internal_tenant_project_id = 4366ef1be7ef4ad59265f9f8d1cf6cf2 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] cinder_internal_tenant_user_id = 48366b44f69249a7ab4fa19ac32a7326 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] cluster = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] compression_format = gzip {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] compute_api_class = cinder.compute.nova.API {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] config_dir = [] {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] config_source = [] {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] control_exchange = openstack {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] debug = True {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] default_availability_zone = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] default_group_type = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] default_volume_type = QuobyteHD {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] disk_geometry = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] driver_client_cert = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] driver_client_cert_key = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] driver_data_namespace = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] driver_ssl_cert_path = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] driver_ssl_cert_verify = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] driver_use_ssl = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] enable_new_services = True {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] enable_unsupported_driver = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] enabled_backends = ['QuobyteHD'] {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] enforce_multipath_for_image_xfer = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] filter_function = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] glance_api_insecure = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] glance_api_servers = ['http://192.168.122.68/image'] {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] glance_api_ssl_compression = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] glance_ca_certificates_file = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] glance_catalog_info = image:glance:publicURL {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] glance_certfile = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] glance_keyfile = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] glance_num_retries = 3 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] glance_request_timeout = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] goodness_function = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] graceful_shutdown_timeout = 5 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] group_api_class = cinder.group.api.API {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] host = devstack {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] image_compress_on_upload = True {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] image_conversion_address_space_limit = 1 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] image_conversion_cpu_limit = 60 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] image_conversion_disable = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] image_upload_use_cinder_backend = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] image_upload_use_internal_tenant = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] image_volume_cache_enabled = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] image_volume_cache_max_count = 0 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] image_volume_cache_max_size_gb = 0 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] init_host_max_objects_retrieval = 0 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] instance_format = [instance: %(uuid)s] {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] iscsi_target_flags = {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] iscsi_write_cache = on {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] iser_helper = tgtadm {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] iser_ip_address = 192.168.122.68 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] iser_port = 3260 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] log_color = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] log_config_append = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] log_dir = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] log_file = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] log_options = True {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] log_rotate_interval = 1 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] log_rotate_interval_type = days {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] log_rotation_type = none {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] max_age = 0 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] max_logfile_count = 30 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] max_logfile_size_mb = 200 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] max_over_subscription_ratio = 20.0 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] message_reap_interval = 86400 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] message_ttl = 2592000 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] migration_create_volume_timeout_secs = 300 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] monkey_patch = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] monkey_patch_modules = [] {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] my_ip = 192.168.122.68 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] no_snapshot_gb_quota = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] num_iser_scan_tries = 3 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] num_shell_tries = 3 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] num_volume_device_scan_tries = 3 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] nvmeof_conn_info_version = 1 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] nvmet_ns_id = 10 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] nvmet_port_id = 1 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] osapi_max_limit = 1000 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] osapi_volume_ext_list = [] {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] osapi_volume_listen = 0.0.0.0 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] osapi_volume_listen_port = 8776 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] osapi_volume_use_ssl = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] osapi_volume_workers = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] per_volume_size_limit = -1 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] periodic_fuzzy_delay = 60 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] periodic_interval = 60 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] project_id_regex = [0-9a-f\-]+ {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] public_endpoint = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] publish_errors = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] quota_backup_gigabytes = 1000 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] quota_backups = 10 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] quota_gigabytes = 1000 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] quota_groups = 10 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] quota_snapshots = 10 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] quota_volumes = 10 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] rate_limit_burst = 0 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] rate_limit_except_level = CRITICAL {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] rate_limit_interval = 0 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] reinit_driver_count = 3 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] replication_device = **** {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] report_discard_supported = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-75eeaa42-3c30-4e2e-947f-773b6666f2c5 None None] Starting volume driver QuobyteDriver (1.2) Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] report_interval = 120 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] reservation_clean_interval = 86400 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] reservation_expire = 86400 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] reserved_image_namespaces = [] {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] reserved_percentage = 0 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] rpc_response_timeout = 120 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] run_external_periodic_tasks = True {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-75eeaa42-3c30-4e2e-947f-773b6666f2c5 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=88641) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] scst_target_driver = iscsi {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] scst_target_iqn_name = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] service_down_time = 720 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] shell_completion = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] snapshot_name_template = snapshot-%s {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] split_loggers = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] state_path = /opt/stack/data/cinder {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] storage_availability_zone = nova {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] storage_protocol = iSCSI {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] syslog_log_facility = LOG_USER {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] target_helper = lioadm {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] target_ip_address = 192.168.122.68 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] target_nvme_fc_traddrs = [] {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] target_port = 3260 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] target_protocol = iscsi {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] target_secondary_ip_addresses = [] {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] trace_flags = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] transfer_api_class = cinder.transfer.api.API {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] transport_url = **** {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] until_refresh = 0 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] use_chap_auth = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] use_default_quota_class = True {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] use_journal = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] use_json = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] use_multipath_for_image_xfer = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] use_stderr = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] use_syslog = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] verify_glance_signatures = enabled {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] volume_api_class = cinder.volume.api.API {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] volume_backend_name = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] volume_clear = zero {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] volume_clear_ionice = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] volume_clear_size = 0 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] volume_copy_bps_limit = 0 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] volume_dd_blocksize = 1M {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] volume_name_template = volume-%s {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] volume_service_inithost_offload = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] volume_usage_audit_period = month {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] zoning_mode = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] oslo_concurrency.disable_process_locking = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] os_brick.lightos_discovery_client_address = localhost {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] os_brick.wait_mpath_device_interval = 1 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] keystone_authtoken.auth_section = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] keystone_authtoken.auth_type = password {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] keystone_authtoken.auth_version = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] keystone_authtoken.cache = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] keystone_authtoken.certfile = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] keystone_authtoken.delay_auth_decision = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] keystone_authtoken.http_connect_timeout = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] keystone_authtoken.include_service_catalog = True {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] keystone_authtoken.insecure = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] keystone_authtoken.interface = public {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] keystone_authtoken.keyfile = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] keystone_authtoken.memcache_password = {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] keystone_authtoken.memcache_secret_key = **** {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] keystone_authtoken.memcache_security_strategy = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] keystone_authtoken.memcache_username = {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] keystone_authtoken.region_name = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] keystone_authtoken.service_token_roles_required = True {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] keystone_authtoken.service_type = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] keystone_authtoken.token_cache_time = 300 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.68/identity {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] cache.backend = dogpile.cache.null {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] cache.backend_argument = **** {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] cache.backend_expiration_time = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] cache.config_prefix = cache.oslo {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] cache.debug_cache_backend = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] cache.enable_retry_client = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] cache.enable_socket_keepalive = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] cache.enabled = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] cache.expiration_time = 600 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] cache.hashclient_dead_timeout = 60.0 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] cache.hashclient_retry_attempts = 2 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] cache.hashclient_retry_timeout = 1.0 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] cache.memcache_dead_retry = 300 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] cache.memcache_pool_maxsize = 10 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] cache.memcache_pool_unused_timeout = 60 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] cache.memcache_sasl_enabled = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] cache.memcache_servers = ['localhost:11211'] {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] cache.password = **** {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] cache.proxies = [] {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] cache.redis_db = 0 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] cache.redis_sentinel_service_name = mymaster {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] cache.redis_server = localhost:6379 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] cache.retry_attempts = 2 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] cache.retry_delay = 0.0 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] cache.socket_keepalive_count = 1 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] cache.socket_keepalive_idle = 1 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] cache.socket_keepalive_interval = 1 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] cache.socket_timeout = 1.0 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] cache.tls_allowed_ciphers = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] cache.tls_cafile = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] cache.tls_certfile = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] cache.tls_enabled = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] cache.tls_keyfile = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] cache.username = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] coordination.backend_url = **** {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] database.asyncio_connection = **** {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] database.asyncio_slave_connection = **** {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] database.backend = sqlalchemy {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] database.connection = **** {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] database.connection_debug = 0 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] database.connection_parameters = {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] database.connection_recycle_time = 3600 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] database.connection_trace = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] database.db_inc_retry_interval = True {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] database.db_max_retries = 20 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] database.db_max_retry_interval = 10 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] database.db_retry_interval = 1 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] database.max_overflow = 50 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] database.max_pool_size = 5 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] database.max_retries = 10 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] database.mysql_sql_mode = TRADITIONAL {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] database.mysql_wsrep_sync_wait = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] database.pool_timeout = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] database.retry_interval = 10 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] database.slave_connection = **** {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] database.sqlite_synchronous = True {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] database.synchronous_reader = True {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] database.use_db_reconnect = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] oslo_messaging_metrics.metrics_process_name = {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] profiler.connection_string = messaging:// {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] profiler.enabled = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] profiler.es_doc_type = notification {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] profiler.es_scroll_size = 10000 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] profiler.es_scroll_time = 2m {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] profiler.filter_error_trace = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] profiler.hmac_keys = **** {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] profiler.sentinel_service_name = mymaster {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] profiler.socket_timeout = 0.1 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] profiler.trace_requests = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] profiler.trace_sqlalchemy = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] profiler_jaeger.process_tags = {} {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] profiler_jaeger.service_name_prefix = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] profiler_otlp.service_name_prefix = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] oslo_policy.enforce_new_defaults = True {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] oslo_policy.policy_default_rule = default {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] oslo_policy.policy_file = policy.yaml {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] oslo_policy.remote_timeout = 60.0 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] privsep_osbrick.capabilities = [21, 2] {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] privsep_osbrick.group = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] privsep_osbrick.helper_command = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] privsep_osbrick.log_daemon_traceback = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] privsep_osbrick.thread_pool_size = 4 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] privsep_osbrick.user = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] cinder_sys_admin.group = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] cinder_sys_admin.helper_command = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] cinder_sys_admin.user = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] service_user.auth_section = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] service_user.auth_type = password {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] service_user.cafile = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] service_user.certfile = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] service_user.collect_timing = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] service_user.insecure = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] service_user.keyfile = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] service_user.send_service_user_token = True {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] service_user.split_loggers = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] service_user.timeout = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] glance.auth_section = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] glance.auth_type = password {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] glance.certfile = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] glance.collect_timing = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] glance.insecure = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] glance.keyfile = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] glance.region_name = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] glance.split_loggers = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] glance.timeout = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backend_defaults.backend_availability_zone = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backend_defaults.chap_password = **** {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-75eeaa42-3c30-4e2e-947f-773b6666f2c5 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=88641) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Aug 10 15:53:28 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.quobyte [None req-75eeaa42-3c30-4e2e-947f-773b6666f2c5 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backend_defaults.chap_username = {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.quobyte [None req-75eeaa42-3c30-4e2e-947f-773b6666f2c5 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backend_defaults.disk_geometry = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backend_defaults.driver_client_cert = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backend_defaults.driver_client_cert_key = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backend_defaults.driver_data_namespace = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backend_defaults.driver_ssl_cert_path = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-75eeaa42-3c30-4e2e-947f-773b6666f2c5 None None] Running cmd (subprocess): mount.quobyte {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backend_defaults.driver_use_ssl = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backend_defaults.enable_unsupported_driver = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backend_defaults.extra_capabilities = {} {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backend_defaults.filter_function = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backend_defaults.goodness_function = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backend_defaults.image_volume_cache_enabled = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backend_defaults.iscsi_target_flags = {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backend_defaults.iscsi_write_cache = on {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backend_defaults.iser_helper = tgtadm {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backend_defaults.iser_ip_address = 192.168.122.68 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backend_defaults.iser_port = 3260 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backend_defaults.nas_host = {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backend_defaults.nas_login = admin {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backend_defaults.nas_mount_options = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backend_defaults.nas_password = **** {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backend_defaults.nas_private_key = {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backend_defaults.nas_secure_file_operations = auto {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backend_defaults.nas_share_path = {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backend_defaults.nas_ssh_port = 22 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backend_defaults.nas_volume_prov_type = thin {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backend_defaults.num_shell_tries = 3 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backend_defaults.nvmet_ns_id = 10 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backend_defaults.nvmet_port_id = 1 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backend_defaults.quobyte_client_cfg = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backend_defaults.quobyte_volume_url = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backend_defaults.replication_device = **** {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backend_defaults.report_discard_supported = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backend_defaults.reserved_percentage = 0 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backend_defaults.scst_target_driver = iscsi {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backend_defaults.scst_target_iqn_name = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backend_defaults.storage_protocol = iSCSI {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backend_defaults.target_helper = tgtadm {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backend_defaults.target_ip_address = 192.168.122.68 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backend_defaults.target_nvme_fc_traddrs = [] {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backend_defaults.target_port = 3260 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backend_defaults.target_protocol = iscsi {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backend_defaults.trace_flags = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backend_defaults.unique_fqdn_network = True {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backend_defaults.use_chap_auth = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backend_defaults.volume_backend_name = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backend_defaults.volume_clear = zero {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backend_defaults.volume_clear_ionice = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backend_defaults.volume_clear_size = 0 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] oslo_reports.file_event_handler = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] oslo_reports.file_event_handler_interval = 1 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] oslo_reports.log_dir = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] QuobyteHD.backend_availability_zone = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] QuobyteHD.backend_host = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] QuobyteHD.chap_password = **** {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] QuobyteHD.chap_username = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] QuobyteHD.chiscsi_conf = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] QuobyteHD.disk_geometry = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] QuobyteHD.driver_client_cert = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] QuobyteHD.driver_client_cert_key = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] QuobyteHD.driver_data_namespace = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] QuobyteHD.driver_use_ssl = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] QuobyteHD.enable_unsupported_driver = True {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] QuobyteHD.extra_capabilities = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] QuobyteHD.filter_function = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] QuobyteHD.goodness_function = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] QuobyteHD.iscsi_target_flags = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] QuobyteHD.iscsi_write_cache = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] QuobyteHD.iser_helper = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] QuobyteHD.iser_ip_address = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] QuobyteHD.iser_port = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] QuobyteHD.iser_target_prefix = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] QuobyteHD.nas_host = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] QuobyteHD.nas_login = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] QuobyteHD.nas_mount_options = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] QuobyteHD.nas_password = **** {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] QuobyteHD.nas_private_key = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] QuobyteHD.nas_secure_file_operations = false {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] QuobyteHD.nas_share_path = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] QuobyteHD.nas_ssh_port = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] QuobyteHD.nas_volume_prov_type = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] QuobyteHD.num_iser_scan_tries = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] QuobyteHD.num_shell_tries = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] QuobyteHD.nvmet_ns_id = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] QuobyteHD.nvmet_port_id = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack quobyte-client[88642]: Reading configuration file: /etc/quobyte/client.cfg Aug 10 15:53:28 devstack quobyte-client[88642]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] QuobyteHD.replication_device = **** {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] QuobyteHD.report_discard_supported = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] QuobyteHD.reserved_percentage = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] QuobyteHD.scst_target_driver = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] QuobyteHD.scst_target_iqn_name = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] QuobyteHD.storage_protocol = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] QuobyteHD.target_helper = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-75eeaa42-3c30-4e2e-947f-773b6666f2c5 None None] CMD "mount.quobyte" returned: 1 in 0.083s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:53:28 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-75eeaa42-3c30-4e2e-947f-773b6666f2c5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] QuobyteHD.target_ip_address = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-75eeaa42-3c30-4e2e-947f-773b6666f2c5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:53:28 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-75eeaa42-3c30-4e2e-947f-773b6666f2c5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] QuobyteHD.target_nvme_fc_traddrs = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] QuobyteHD.target_port = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] QuobyteHD.target_prefix = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] QuobyteHD.target_protocol = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] QuobyteHD.trace_flags = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] QuobyteHD.unique_fqdn_network = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] QuobyteHD.use_chap_auth = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-75eeaa42-3c30-4e2e-947f-773b6666f2c5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] QuobyteHD.volume_clear = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-75eeaa42-3c30-4e2e-947f-773b6666f2c5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] QuobyteHD.volume_clear_ionice = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] QuobyteHD.volume_clear_size = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-75eeaa42-3c30-4e2e-947f-773b6666f2c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] QuobyteHD.volume_dd_blocksize = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] QuobyteHD.volumes_dir = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] oslo_messaging_rabbit.hostname = devstack {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] oslo_messaging_rabbit.ssl = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] oslo_messaging_rabbit.ssl_version = {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] oslo_messaging_notifications.driver = [] {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] oslo_messaging_notifications.retry = -1 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] oslo_messaging_notifications.transport_url = **** {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] key_manager.fixed_key = **** {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] barbican.barbican_api_version = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] barbican.barbican_endpoint = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] barbican.barbican_endpoint_type = public {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] barbican.barbican_region_name = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] barbican.cafile = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] barbican.certfile = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] barbican.collect_timing = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] barbican.insecure = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] barbican.keyfile = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] barbican.number_of_retries = 60 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] barbican.retry_delay = 1 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] barbican.send_service_user_token = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] barbican.split_loggers = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] barbican.timeout = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] barbican.verify_ssl = True {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] barbican.verify_ssl_path = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] barbican_service_user.auth_section = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] barbican_service_user.auth_type = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] barbican_service_user.cafile = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] barbican_service_user.certfile = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack sudo[88651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] barbican_service_user.collect_timing = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] barbican_service_user.insecure = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] barbican_service_user.keyfile = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] barbican_service_user.split_loggers = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] barbican_service_user.timeout = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] vault.approle_role_id = **** {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] vault.approle_secret_id = **** {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack sudo[88651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] vault.auth_method = approle {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] vault.auth_path = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] vault.kv_mountpoint = secret {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] vault.kv_path = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] vault.kv_version = 2 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] vault.namespace = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] vault.root_token_id = **** {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] vault.ssl_ca_crt_file = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] vault.timeout = 60.0 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] vault.token_file = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] vault.token_role = None {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] vault.use_ssl = False {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 10 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_service.backend._eventlet.service [None req-217c8f19-bbe0-48f9-9cb6-4fdd5f4f63dc None None] ******************************************************************************** {{(pid=88350) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3552}} Aug 10 15:53:28 devstack sudo[88651]: pam_unix(sudo:session): session closed for user root Aug 10 15:53:28 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-75eeaa42-3c30-4e2e-947f-773b6666f2c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.240s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:53:28 devstack cinder-volume[88641]: INFO cinder.volume.driver [None req-75eeaa42-3c30-4e2e-947f-773b6666f2c5 None None] Driver hasn't implemented _init_vendor_properties() Aug 10 15:53:28 devstack cinder-volume[88641]: DEBUG cinder.volume.driver [None req-75eeaa42-3c30-4e2e-947f-773b6666f2c5 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7576522827148, 'free_capacity_gb': 1775.7576522827148, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88641) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:887}} Aug 10 15:53:28 devstack cinder-volume[88641]: DEBUG oslo_db.sqlalchemy.engines [None req-75eeaa42-3c30-4e2e-947f-773b6666f2c5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88641) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 10 15:53:28 devstack cinder-volume[88641]: DEBUG dbcounter [-] [88641] Writer thread running {{(pid=88641) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 10 15:53:28 devstack cinder-volume[88641]: DEBUG cinder.db.api [None req-75eeaa42-3c30-4e2e-947f-773b6666f2c5 None None] Building query based on filter {{(pid=88641) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 10 15:53:28 devstack cinder-volume[88641]: DEBUG cinder.image.image_utils [None req-75eeaa42-3c30-4e2e-947f-773b6666f2c5 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=88641) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 10 15:53:28 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-75eeaa42-3c30-4e2e-947f-773b6666f2c5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:53:28 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-75eeaa42-3c30-4e2e-947f-773b6666f2c5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:53:28 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-75eeaa42-3c30-4e2e-947f-773b6666f2c5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 15:53:28 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-75eeaa42-3c30-4e2e-947f-773b6666f2c5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 15:53:28 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-75eeaa42-3c30-4e2e-947f-773b6666f2c5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:53:28 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-75eeaa42-3c30-4e2e-947f-773b6666f2c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:53:28 devstack cinder-volume[88641]: INFO cinder.keymgr.migration [None req-e90593da-9e1d-415b-a09f-140f7d9edfaf None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 10 15:53:28 devstack sudo[88656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 15:53:28 devstack sudo[88656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:53:29 devstack sudo[88656]: pam_unix(sudo:session): session closed for user root Aug 10 15:53:29 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-75eeaa42-3c30-4e2e-947f-773b6666f2c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.228s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:53:29 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-75eeaa42-3c30-4e2e-947f-773b6666f2c5 None None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 15:53:29 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-75eeaa42-3c30-4e2e-947f-773b6666f2c5 None None] Driver initialization completed successfully. Aug 10 15:53:29 devstack cinder-volume[88641]: INFO cinder.manager [None req-75eeaa42-3c30-4e2e-947f-773b6666f2c5 None None] Initiating service 3 cleanup Aug 10 15:53:29 devstack cinder-volume[88641]: INFO cinder.manager [None req-75eeaa42-3c30-4e2e-947f-773b6666f2c5 None None] Service 3 cleanup completed. Aug 10 15:53:29 devstack cinder-volume[88641]: DEBUG cinder.service [None req-75eeaa42-3c30-4e2e-947f-773b6666f2c5 None None] Creating RPC server for service cinder-volume {{(pid=88641) start /opt/stack/cinder/cinder/service.py:231}} Aug 10 15:53:29 devstack cinder-volume[88641]: DEBUG cinder.service [None req-75eeaa42-3c30-4e2e-947f-773b6666f2c5 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=88641) start /opt/stack/cinder/cinder/service.py:237}} Aug 10 15:53:29 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-75eeaa42-3c30-4e2e-947f-773b6666f2c5 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Aug 10 15:53:29 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-75eeaa42-3c30-4e2e-947f-773b6666f2c5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:53:29 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-75eeaa42-3c30-4e2e-947f-773b6666f2c5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:53:29 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-75eeaa42-3c30-4e2e-947f-773b6666f2c5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 15:53:29 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-75eeaa42-3c30-4e2e-947f-773b6666f2c5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 15:53:29 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-75eeaa42-3c30-4e2e-947f-773b6666f2c5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:53:29 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-75eeaa42-3c30-4e2e-947f-773b6666f2c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:53:29 devstack sudo[88665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 15:53:29 devstack sudo[88665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:53:29 devstack sudo[88665]: pam_unix(sudo:session): session closed for user root Aug 10 15:53:29 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-75eeaa42-3c30-4e2e-947f-773b6666f2c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.242s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:53:29 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-75eeaa42-3c30-4e2e-947f-773b6666f2c5 None None] Driver post RPC initialization completed successfully. Aug 10 15:53:36 devstack cinder-volume[88641]: DEBUG oslo_service.periodic_task [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Running periodic task VolumeManager._thread_info {{(pid=88641) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 15:53:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] thread count: 6 {{(pid=88641) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 10 15:53:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] thread info: [<_MainThread(MainThread, started 127361545748608)>, , , , , ] {{(pid=88641) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 10 15:53:38 devstack cinder-volume[88350]: DEBUG dbcounter [-] [88350] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=88350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 15:53:39 devstack cinder-volume[88641]: DEBUG dbcounter [-] [88641] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=88641) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 15:53:39 devstack cinder-volume[88641]: DEBUG dbcounter [-] [88641] Writing DB stats cinder:SELECT=2 {{(pid=88641) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 15:54:32 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0bc6c56-f50f-4303-b64d-cf111174815d tempest-DeleteServersTestJSON-1203566962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 15:54:32 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d0bc6c56-f50f-4303-b64d-cf111174815d tempest-DeleteServersTestJSON-1203566962 None] Flow 'volume_create_manager' (94af7b88-e8cd-4982-9f02-471346ced83d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 15:54:32 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d0bc6c56-f50f-4303-b64d-cf111174815d tempest-DeleteServersTestJSON-1203566962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0e885a9-9576-4908-8c70-2efcac814954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:54:32 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d0bc6c56-f50f-4303-b64d-cf111174815d tempest-DeleteServersTestJSON-1203566962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0e885a9-9576-4908-8c70-2efcac814954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T13:54:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-909466966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5839486-6fb5-401e-a052-6bc353b99aa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a54ace1e828448fb560ddb6abcf59cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T13:54:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T13:54:32Z,use_quota=True,user_id='34c2addea48348f294973dfc98d1702a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:54:32 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d0bc6c56-f50f-4303-b64d-cf111174815d tempest-DeleteServersTestJSON-1203566962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d3962ea-14eb-4825-8216-559c4de5c964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:54:32 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d0bc6c56-f50f-4303-b64d-cf111174815d tempest-DeleteServersTestJSON-1203566962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d3962ea-14eb-4825-8216-559c4de5c964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:54:32 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d0bc6c56-f50f-4303-b64d-cf111174815d tempest-DeleteServersTestJSON-1203566962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff23839f-5015-41f9-a14c-54403b1037e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:54:32 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d0bc6c56-f50f-4303-b64d-cf111174815d tempest-DeleteServersTestJSON-1203566962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff23839f-5015-41f9-a14c-54403b1037e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5839486-6fb5-401e-a052-6bc353b99aa3', 'volume_name': 'volume-f5839486-6fb5-401e-a052-6bc353b99aa3', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:54:32 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d0bc6c56-f50f-4303-b64d-cf111174815d tempest-DeleteServersTestJSON-1203566962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e3a2fe7-2a20-413c-9bac-6faf08bd05b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:54:32 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d0bc6c56-f50f-4303-b64d-cf111174815d tempest-DeleteServersTestJSON-1203566962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e3a2fe7-2a20-413c-9bac-6faf08bd05b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:54:32 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d0bc6c56-f50f-4303-b64d-cf111174815d tempest-DeleteServersTestJSON-1203566962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaca9b02-b011-4a27-9bf6-fd038e4cbd91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:54:32 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-d0bc6c56-f50f-4303-b64d-cf111174815d tempest-DeleteServersTestJSON-1203566962 None] Volume f5839486-6fb5-401e-a052-6bc353b99aa3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5839486-6fb5-401e-a052-6bc353b99aa3', 'volume_size': 1} Aug 10 15:54:32 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-d0bc6c56-f50f-4303-b64d-cf111174815d tempest-DeleteServersTestJSON-1203566962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:54:32 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-d0bc6c56-f50f-4303-b64d-cf111174815d tempest-DeleteServersTestJSON-1203566962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:54:32 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-d0bc6c56-f50f-4303-b64d-cf111174815d tempest-DeleteServersTestJSON-1203566962 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T13:54:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-909466966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5839486-6fb5-401e-a052-6bc353b99aa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a54ace1e828448fb560ddb6abcf59cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T13:54:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T13:54:32Z,use_quota=True,user_id='34c2addea48348f294973dfc98d1702a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 15:54:32 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-d0bc6c56-f50f-4303-b64d-cf111174815d tempest-DeleteServersTestJSON-1203566962 None] Creating volume f5839486-6fb5-401e-a052-6bc353b99aa3 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 15:54:32 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-d0bc6c56-f50f-4303-b64d-cf111174815d tempest-DeleteServersTestJSON-1203566962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:54:32 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-d0bc6c56-f50f-4303-b64d-cf111174815d tempest-DeleteServersTestJSON-1203566962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:54:32 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-d0bc6c56-f50f-4303-b64d-cf111174815d tempest-DeleteServersTestJSON-1203566962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 15:54:32 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-d0bc6c56-f50f-4303-b64d-cf111174815d tempest-DeleteServersTestJSON-1203566962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 15:54:32 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-d0bc6c56-f50f-4303-b64d-cf111174815d tempest-DeleteServersTestJSON-1203566962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:54:32 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-d0bc6c56-f50f-4303-b64d-cf111174815d tempest-DeleteServersTestJSON-1203566962 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 15:54:32 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-d0bc6c56-f50f-4303-b64d-cf111174815d tempest-DeleteServersTestJSON-1203566962 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 15:54:32 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d0bc6c56-f50f-4303-b64d-cf111174815d tempest-DeleteServersTestJSON-1203566962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f5839486-6fb5-401e-a052-6bc353b99aa3 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:54:32 devstack sudo[89557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f5839486-6fb5-401e-a052-6bc353b99aa3 1073741824 Aug 10 15:54:32 devstack sudo[89557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:54:33 devstack sudo[89557]: pam_unix(sudo:session): session closed for user root Aug 10 15:54:33 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d0bc6c56-f50f-4303-b64d-cf111174815d tempest-DeleteServersTestJSON-1203566962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f5839486-6fb5-401e-a052-6bc353b99aa3 1073741824" returned: 0 in 1.520s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:54:34 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d0bc6c56-f50f-4303-b64d-cf111174815d tempest-DeleteServersTestJSON-1203566962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f5839486-6fb5-401e-a052-6bc353b99aa3 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:54:34 devstack sudo[89877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f5839486-6fb5-401e-a052-6bc353b99aa3 Aug 10 15:54:34 devstack sudo[89877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:54:34 devstack sudo[89877]: pam_unix(sudo:session): session closed for user root Aug 10 15:54:34 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d0bc6c56-f50f-4303-b64d-cf111174815d tempest-DeleteServersTestJSON-1203566962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f5839486-6fb5-401e-a052-6bc353b99aa3" returned: 0 in 0.485s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:54:34 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-d0bc6c56-f50f-4303-b64d-cf111174815d tempest-DeleteServersTestJSON-1203566962 None] <== create_volume: return (2148ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 15:54:34 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-d0bc6c56-f50f-4303-b64d-cf111174815d tempest-DeleteServersTestJSON-1203566962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.168s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:54:34 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d0bc6c56-f50f-4303-b64d-cf111174815d tempest-DeleteServersTestJSON-1203566962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaca9b02-b011-4a27-9bf6-fd038e4cbd91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5839486-6fb5-401e-a052-6bc353b99aa3', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:54:34 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d0bc6c56-f50f-4303-b64d-cf111174815d tempest-DeleteServersTestJSON-1203566962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f7f917d-f3bd-46a5-a3bc-4563c9cf568f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:54:34 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-d0bc6c56-f50f-4303-b64d-cf111174815d tempest-DeleteServersTestJSON-1203566962 None] Volume volume-f5839486-6fb5-401e-a052-6bc353b99aa3 (f5839486-6fb5-401e-a052-6bc353b99aa3): created successfully Aug 10 15:54:34 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d0bc6c56-f50f-4303-b64d-cf111174815d tempest-DeleteServersTestJSON-1203566962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f7f917d-f3bd-46a5-a3bc-4563c9cf568f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:54:34 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d0bc6c56-f50f-4303-b64d-cf111174815d tempest-DeleteServersTestJSON-1203566962 None] Flow 'volume_create_manager' (94af7b88-e8cd-4982-9f02-471346ced83d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 15:54:34 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-d0bc6c56-f50f-4303-b64d-cf111174815d tempest-DeleteServersTestJSON-1203566962 None] Created volume successfully. Aug 10 15:54:36 devstack cinder-volume[88641]: DEBUG oslo_service.periodic_task [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88641) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 15:54:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:54:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:54:36 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 15:54:36 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 15:54:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:54:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:54:36 devstack sudo[89886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 15:54:36 devstack sudo[89886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:54:37 devstack sudo[89886]: pam_unix(sudo:session): session closed for user root Aug 10 15:54:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.586s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:54:37 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 15:54:37 devstack cinder-volume[88641]: DEBUG oslo_service.periodic_task [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Running periodic task VolumeManager._thread_info {{(pid=88641) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 15:54:37 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] thread count: 6 {{(pid=88641) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 10 15:54:37 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] thread info: [<_MainThread(MainThread, started 127361545748608)>, , , , , ] {{(pid=88641) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 10 15:54:43 devstack cinder-volume[88641]: WARNING py.warnings [req-cd5d4c37-e554-45b3-9865-4a5dd3be43fc req-8ea419ba-e8fb-4939-b588-9cb1972429ed tempest-DeleteServersTestJSON-1203566962 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Aug 10 15:54:43 devstack cinder-volume[88641]: .first() Aug 10 15:54:43 devstack cinder-volume[88641]: Aug 10 15:54:43 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-cd5d4c37-e554-45b3-9865-4a5dd3be43fc req-8ea419ba-e8fb-4939-b588-9cb1972429ed tempest-DeleteServersTestJSON-1203566962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:54:43 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-cd5d4c37-e554-45b3-9865-4a5dd3be43fc req-8ea419ba-e8fb-4939-b588-9cb1972429ed tempest-DeleteServersTestJSON-1203566962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:54:43 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-cd5d4c37-e554-45b3-9865-4a5dd3be43fc req-8ea419ba-e8fb-4939-b588-9cb1972429ed tempest-DeleteServersTestJSON-1203566962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:54:43 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [req-cd5d4c37-e554-45b3-9865-4a5dd3be43fc req-8ea419ba-e8fb-4939-b588-9cb1972429ed tempest-DeleteServersTestJSON-1203566962 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc', 'name': 'volume-f5839486-6fb5-401e-a052-6bc353b99aa3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ffff9fcf-9693-4871-a562-b37ce09457e2', 'enforce_multipath': True} {{(pid=88641) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 10 15:54:43 devstack cinder-volume[88641]: INFO cinder.volume.manager [req-cd5d4c37-e554-45b3-9865-4a5dd3be43fc req-8ea419ba-e8fb-4939-b588-9cb1972429ed tempest-DeleteServersTestJSON-1203566962 None] attachment_update completed successfully. Aug 10 15:54:50 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-08ecbb57-01fb-4ad2-bd7c-b57ce69c4bf5 tempest-ServerRescueNegativeTestJSON-1662775418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 15:54:50 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-08ecbb57-01fb-4ad2-bd7c-b57ce69c4bf5 tempest-ServerRescueNegativeTestJSON-1662775418 None] Flow 'volume_create_manager' (c0835529-ac8a-4151-97ca-07940a6664c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 15:54:50 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-08ecbb57-01fb-4ad2-bd7c-b57ce69c4bf5 tempest-ServerRescueNegativeTestJSON-1662775418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8d33891-5738-43d7-b9f2-dec780e83296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:54:50 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-08ecbb57-01fb-4ad2-bd7c-b57ce69c4bf5 tempest-ServerRescueNegativeTestJSON-1662775418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8d33891-5738-43d7-b9f2-dec780e83296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T13:54:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-24442853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f794c3a0-497a-43cb-a568-0d8d49387797,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='895cd60908e74b708a7a2ea059b13a0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T13:54:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T13:54:51Z,use_quota=True,user_id='80c5b9b657ae434696c34076b5d50ec3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:54:50 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-08ecbb57-01fb-4ad2-bd7c-b57ce69c4bf5 tempest-ServerRescueNegativeTestJSON-1662775418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0deacc5e-2e88-42b7-b0a1-17deb90a0c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:54:50 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-08ecbb57-01fb-4ad2-bd7c-b57ce69c4bf5 tempest-ServerRescueNegativeTestJSON-1662775418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0deacc5e-2e88-42b7-b0a1-17deb90a0c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:54:50 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-08ecbb57-01fb-4ad2-bd7c-b57ce69c4bf5 tempest-ServerRescueNegativeTestJSON-1662775418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3615026a-5a42-4b3b-9c58-35b64513a609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:54:50 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-08ecbb57-01fb-4ad2-bd7c-b57ce69c4bf5 tempest-ServerRescueNegativeTestJSON-1662775418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3615026a-5a42-4b3b-9c58-35b64513a609) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f794c3a0-497a-43cb-a568-0d8d49387797', 'volume_name': 'volume-f794c3a0-497a-43cb-a568-0d8d49387797', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:54:50 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-08ecbb57-01fb-4ad2-bd7c-b57ce69c4bf5 tempest-ServerRescueNegativeTestJSON-1662775418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b0b99a5-983d-4265-96b4-0c23d1bdd7ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:54:50 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-08ecbb57-01fb-4ad2-bd7c-b57ce69c4bf5 tempest-ServerRescueNegativeTestJSON-1662775418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b0b99a5-983d-4265-96b4-0c23d1bdd7ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:54:50 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-08ecbb57-01fb-4ad2-bd7c-b57ce69c4bf5 tempest-ServerRescueNegativeTestJSON-1662775418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eca7991-a1ba-41dc-8e22-cfd4c4a283d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:54:50 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-08ecbb57-01fb-4ad2-bd7c-b57ce69c4bf5 tempest-ServerRescueNegativeTestJSON-1662775418 None] Volume f794c3a0-497a-43cb-a568-0d8d49387797: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f794c3a0-497a-43cb-a568-0d8d49387797', 'volume_size': 1} Aug 10 15:54:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-08ecbb57-01fb-4ad2-bd7c-b57ce69c4bf5 tempest-ServerRescueNegativeTestJSON-1662775418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:54:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-08ecbb57-01fb-4ad2-bd7c-b57ce69c4bf5 tempest-ServerRescueNegativeTestJSON-1662775418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:54:50 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-08ecbb57-01fb-4ad2-bd7c-b57ce69c4bf5 tempest-ServerRescueNegativeTestJSON-1662775418 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T13:54:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-24442853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f794c3a0-497a-43cb-a568-0d8d49387797,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='895cd60908e74b708a7a2ea059b13a0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T13:54:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T13:54:51Z,use_quota=True,user_id='80c5b9b657ae434696c34076b5d50ec3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 15:54:50 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-08ecbb57-01fb-4ad2-bd7c-b57ce69c4bf5 tempest-ServerRescueNegativeTestJSON-1662775418 None] Creating volume f794c3a0-497a-43cb-a568-0d8d49387797 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 15:54:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-08ecbb57-01fb-4ad2-bd7c-b57ce69c4bf5 tempest-ServerRescueNegativeTestJSON-1662775418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:54:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-08ecbb57-01fb-4ad2-bd7c-b57ce69c4bf5 tempest-ServerRescueNegativeTestJSON-1662775418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:54:50 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-08ecbb57-01fb-4ad2-bd7c-b57ce69c4bf5 tempest-ServerRescueNegativeTestJSON-1662775418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 15:54:50 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-08ecbb57-01fb-4ad2-bd7c-b57ce69c4bf5 tempest-ServerRescueNegativeTestJSON-1662775418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 15:54:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-08ecbb57-01fb-4ad2-bd7c-b57ce69c4bf5 tempest-ServerRescueNegativeTestJSON-1662775418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:54:50 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-08ecbb57-01fb-4ad2-bd7c-b57ce69c4bf5 tempest-ServerRescueNegativeTestJSON-1662775418 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 15:54:50 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-08ecbb57-01fb-4ad2-bd7c-b57ce69c4bf5 tempest-ServerRescueNegativeTestJSON-1662775418 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 15:54:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-08ecbb57-01fb-4ad2-bd7c-b57ce69c4bf5 tempest-ServerRescueNegativeTestJSON-1662775418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f794c3a0-497a-43cb-a568-0d8d49387797 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:54:50 devstack sudo[90481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f794c3a0-497a-43cb-a568-0d8d49387797 1073741824 Aug 10 15:54:50 devstack sudo[90481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:54:51 devstack cinder-volume[88641]: INFO cinder.volume.manager [req-aeabf3b3-2f97-47ab-9ea3-871b797eae2c req-50e3f274-5703-4723-b3a7-056d59d7ecbf tempest-DeleteServersTestJSON-1203566962 None] Terminate volume connection completed successfully. Aug 10 15:54:51 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [req-aeabf3b3-2f97-47ab-9ea3-871b797eae2c req-50e3f274-5703-4723-b3a7-056d59d7ecbf tempest-DeleteServersTestJSON-1203566962 None] Deleting attachment ffff9fcf-9693-4871-a562-b37ce09457e2. {{(pid=88641) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 10 15:54:52 devstack sudo[90481]: pam_unix(sudo:session): session closed for user root Aug 10 15:54:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-08ecbb57-01fb-4ad2-bd7c-b57ce69c4bf5 tempest-ServerRescueNegativeTestJSON-1662775418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f794c3a0-497a-43cb-a568-0d8d49387797 1073741824" returned: 0 in 1.190s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:54:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-08ecbb57-01fb-4ad2-bd7c-b57ce69c4bf5 tempest-ServerRescueNegativeTestJSON-1662775418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f794c3a0-497a-43cb-a568-0d8d49387797 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:54:52 devstack sudo[90550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f794c3a0-497a-43cb-a568-0d8d49387797 Aug 10 15:54:52 devstack sudo[90550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:54:52 devstack sudo[90550]: pam_unix(sudo:session): session closed for user root Aug 10 15:54:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-08ecbb57-01fb-4ad2-bd7c-b57ce69c4bf5 tempest-ServerRescueNegativeTestJSON-1662775418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f794c3a0-497a-43cb-a568-0d8d49387797" returned: 0 in 0.524s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:54:52 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-08ecbb57-01fb-4ad2-bd7c-b57ce69c4bf5 tempest-ServerRescueNegativeTestJSON-1662775418 None] <== create_volume: return (1781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 15:54:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-08ecbb57-01fb-4ad2-bd7c-b57ce69c4bf5 tempest-ServerRescueNegativeTestJSON-1662775418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.784s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:54:52 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-08ecbb57-01fb-4ad2-bd7c-b57ce69c4bf5 tempest-ServerRescueNegativeTestJSON-1662775418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eca7991-a1ba-41dc-8e22-cfd4c4a283d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f794c3a0-497a-43cb-a568-0d8d49387797', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:54:52 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-08ecbb57-01fb-4ad2-bd7c-b57ce69c4bf5 tempest-ServerRescueNegativeTestJSON-1662775418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f590c93b-d79d-4e24-88a6-15af2d79ab00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:54:52 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-08ecbb57-01fb-4ad2-bd7c-b57ce69c4bf5 tempest-ServerRescueNegativeTestJSON-1662775418 None] Volume volume-f794c3a0-497a-43cb-a568-0d8d49387797 (f794c3a0-497a-43cb-a568-0d8d49387797): created successfully Aug 10 15:54:52 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-08ecbb57-01fb-4ad2-bd7c-b57ce69c4bf5 tempest-ServerRescueNegativeTestJSON-1662775418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f590c93b-d79d-4e24-88a6-15af2d79ab00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:54:52 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-08ecbb57-01fb-4ad2-bd7c-b57ce69c4bf5 tempest-ServerRescueNegativeTestJSON-1662775418 None] Flow 'volume_create_manager' (c0835529-ac8a-4151-97ca-07940a6664c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 15:54:52 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-08ecbb57-01fb-4ad2-bd7c-b57ce69c4bf5 tempest-ServerRescueNegativeTestJSON-1662775418 None] Created volume successfully. Aug 10 15:54:54 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-ebce9b36-14b7-47de-ae88-7a606404d70c tempest-DeleteServersTestJSON-1203566962 None] Acquiring lock "cinder-f5839486-6fb5-401e-a052-6bc353b99aa3-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 15:54:54 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-ebce9b36-14b7-47de-ae88-7a606404d70c tempest-DeleteServersTestJSON-1203566962 None] Lock "cinder-f5839486-6fb5-401e-a052-6bc353b99aa3-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 15:54:54 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-ebce9b36-14b7-47de-ae88-7a606404d70c tempest-DeleteServersTestJSON-1203566962 None] Acquiring lock "cinder-quobyte-f5839486-6fb5-401e-a052-6bc353b99aa3" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 15:54:54 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-ebce9b36-14b7-47de-ae88-7a606404d70c tempest-DeleteServersTestJSON-1203566962 None] Lock "cinder-quobyte-f5839486-6fb5-401e-a052-6bc353b99aa3" acquired by "delete_volume" :: waited 0.021s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 15:54:54 devstack cinder-volume[88641]: INFO oslo.privsep.daemon [None req-ebce9b36-14b7-47de-ae88-7a606404d70c tempest-DeleteServersTestJSON-1203566962 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpsrzljsr7/privsep.sock'] Aug 10 15:54:54 devstack sudo[90555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpsrzljsr7/privsep.sock Aug 10 15:54:54 devstack sudo[90555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:54:55 devstack cinder-volume[88641]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Aug 10 15:54:55 devstack cinder-volume[88641]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 10 15:54:55 devstack cinder-volume[88641]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Aug 10 15:54:55 devstack cinder-volume[88641]: WARNING oslo.privsep.daemon [-] privsep log: Aug 10 15:54:55 devstack cinder-volume[88641]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Aug 10 15:54:55 devstack cinder-volume[88641]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Aug 10 15:54:55 devstack cinder-volume[88641]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 10 15:54:55 devstack cinder-volume[88641]: WARNING oslo.privsep.daemon [-] privsep log: Aug 10 15:54:55 devstack cinder-volume[88641]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Aug 10 15:54:55 devstack sudo[90555]: pam_unix(sudo:session): session closed for user root Aug 10 15:54:55 devstack cinder-volume[88641]: INFO oslo.privsep.daemon [None req-ebce9b36-14b7-47de-ae88-7a606404d70c tempest-DeleteServersTestJSON-1203566962 None] Spawned new privsep daemon via rootwrap Aug 10 15:54:55 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [None req-ebce9b36-14b7-47de-ae88-7a606404d70c tempest-DeleteServersTestJSON-1203566962 None] Accepted privsep connection to /tmp/tmpsrzljsr7/privsep.sock {{(pid=88641) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Aug 10 15:54:55 devstack cinder-volume[88641]: INFO oslo.privsep.daemon [-] privsep daemon starting Aug 10 15:54:55 devstack cinder-volume[88641]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Aug 10 15:54:55 devstack cinder-volume[88641]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Aug 10 15:54:55 devstack cinder-volume[88641]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 90565 Aug 10 15:54:55 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b51490b-1b59-4ddc-b212-cc1a36e1480f]: (2,) {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 15:54:55 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b0c6292-a39d-4d83-9af3-b6b6f97f9b3f]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 15:54:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ebce9b36-14b7-47de-ae88-7a606404d70c tempest-DeleteServersTestJSON-1203566962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f5839486-6fb5-401e-a052-6bc353b99aa3 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:54:56 devstack sudo[90572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f5839486-6fb5-401e-a052-6bc353b99aa3 Aug 10 15:54:56 devstack sudo[90572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:54:56 devstack sudo[90572]: pam_unix(sudo:session): session closed for user root Aug 10 15:54:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ebce9b36-14b7-47de-ae88-7a606404d70c tempest-DeleteServersTestJSON-1203566962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f5839486-6fb5-401e-a052-6bc353b99aa3" returned: 0 in 0.641s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:54:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ebce9b36-14b7-47de-ae88-7a606404d70c tempest-DeleteServersTestJSON-1203566962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f5839486-6fb5-401e-a052-6bc353b99aa3 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:54:56 devstack sudo[90584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f5839486-6fb5-401e-a052-6bc353b99aa3 Aug 10 15:54:56 devstack sudo[90584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:54:56 devstack sudo[90584]: pam_unix(sudo:session): session closed for user root Aug 10 15:54:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ebce9b36-14b7-47de-ae88-7a606404d70c tempest-DeleteServersTestJSON-1203566962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f5839486-6fb5-401e-a052-6bc353b99aa3" returned: 0 in 0.378s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:54:56 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-ebce9b36-14b7-47de-ae88-7a606404d70c tempest-DeleteServersTestJSON-1203566962 None] Lock "cinder-quobyte-f5839486-6fb5-401e-a052-6bc353b99aa3" released by "delete_volume" :: held 2.553s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 15:54:56 devstack cinder-volume[88641]: WARNING cinder.quota [None req-ebce9b36-14b7-47de-ae88-7a606404d70c tempest-DeleteServersTestJSON-1203566962 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 10 15:54:56 devstack cinder-volume[88641]: WARNING cinder.quota [None req-ebce9b36-14b7-47de-ae88-7a606404d70c tempest-DeleteServersTestJSON-1203566962 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 10 15:54:56 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-ebce9b36-14b7-47de-ae88-7a606404d70c tempest-DeleteServersTestJSON-1203566962 None] Created reservations ['51ba823b-08f9-4c24-b98d-61ace4cb3e80', '4aeb4a54-b11f-4fa0-ac86-93d4df758acf', 'a01ca93a-66bb-479e-85ca-df76539ba4cb', '7e243d47-5f7f-4d2e-a4b5-43ca7b2eeded'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 15:54:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-ebce9b36-14b7-47de-ae88-7a606404d70c tempest-DeleteServersTestJSON-1203566962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:54:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-ebce9b36-14b7-47de-ae88-7a606404d70c tempest-DeleteServersTestJSON-1203566962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:54:57 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-ebce9b36-14b7-47de-ae88-7a606404d70c tempest-DeleteServersTestJSON-1203566962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 15:54:57 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-ebce9b36-14b7-47de-ae88-7a606404d70c tempest-DeleteServersTestJSON-1203566962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 15:54:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-ebce9b36-14b7-47de-ae88-7a606404d70c tempest-DeleteServersTestJSON-1203566962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:54:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ebce9b36-14b7-47de-ae88-7a606404d70c tempest-DeleteServersTestJSON-1203566962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:54:57 devstack sudo[90601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 15:54:57 devstack sudo[90601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:54:57 devstack sudo[90601]: pam_unix(sudo:session): session closed for user root Aug 10 15:54:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ebce9b36-14b7-47de-ae88-7a606404d70c tempest-DeleteServersTestJSON-1203566962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.344s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:54:57 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-ebce9b36-14b7-47de-ae88-7a606404d70c tempest-DeleteServersTestJSON-1203566962 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 15:54:57 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-ebce9b36-14b7-47de-ae88-7a606404d70c tempest-DeleteServersTestJSON-1203566962 None] Deleted volume successfully. Aug 10 15:54:57 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-ebce9b36-14b7-47de-ae88-7a606404d70c tempest-DeleteServersTestJSON-1203566962 None] Lock "cinder-f5839486-6fb5-401e-a052-6bc353b99aa3-delete_volume" released by "delete_volume" :: held 3.365s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 15:55:07 devstack cinder-volume[88641]: DEBUG dbcounter [-] [88641] Writing DB stats cinder:SELECT=22,cinder:UPDATE=17,cinder:INSERT=3,cinder:DELETE=1 {{(pid=88641) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 15:55:07 devstack cinder-volume[88641]: DEBUG dbcounter [-] [88641] Writing DB stats cinder:UPDATE=14,cinder:SELECT=11,cinder:INSERT=3,cinder:DELETE=2 {{(pid=88641) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 15:55:09 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-a04af79b-462e-4c0c-909e-5f737d4789f0 tempest-ServerRescueNegativeTestJSON-1662775418 None] Acquiring lock "cinder-f794c3a0-497a-43cb-a568-0d8d49387797-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 15:55:09 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-a04af79b-462e-4c0c-909e-5f737d4789f0 tempest-ServerRescueNegativeTestJSON-1662775418 None] Lock "cinder-f794c3a0-497a-43cb-a568-0d8d49387797-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 15:55:09 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-a04af79b-462e-4c0c-909e-5f737d4789f0 tempest-ServerRescueNegativeTestJSON-1662775418 None] Acquiring lock "cinder-quobyte-f794c3a0-497a-43cb-a568-0d8d49387797" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 15:55:09 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-a04af79b-462e-4c0c-909e-5f737d4789f0 tempest-ServerRescueNegativeTestJSON-1662775418 None] Lock "cinder-quobyte-f794c3a0-497a-43cb-a568-0d8d49387797" acquired by "delete_volume" :: waited 0.036s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 15:55:09 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[a51decfe-85dd-4630-9e6f-0481cf6bdb9f]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 15:55:09 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a04af79b-462e-4c0c-909e-5f737d4789f0 tempest-ServerRescueNegativeTestJSON-1662775418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f794c3a0-497a-43cb-a568-0d8d49387797 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:55:09 devstack sudo[91049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f794c3a0-497a-43cb-a568-0d8d49387797 Aug 10 15:55:09 devstack sudo[91049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:55:10 devstack sudo[91049]: pam_unix(sudo:session): session closed for user root Aug 10 15:55:10 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a04af79b-462e-4c0c-909e-5f737d4789f0 tempest-ServerRescueNegativeTestJSON-1662775418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f794c3a0-497a-43cb-a568-0d8d49387797" returned: 0 in 0.774s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:55:10 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a04af79b-462e-4c0c-909e-5f737d4789f0 tempest-ServerRescueNegativeTestJSON-1662775418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f794c3a0-497a-43cb-a568-0d8d49387797 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:55:10 devstack sudo[91055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f794c3a0-497a-43cb-a568-0d8d49387797 Aug 10 15:55:10 devstack sudo[91055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:55:10 devstack sudo[91055]: pam_unix(sudo:session): session closed for user root Aug 10 15:55:10 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a04af79b-462e-4c0c-909e-5f737d4789f0 tempest-ServerRescueNegativeTestJSON-1662775418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f794c3a0-497a-43cb-a568-0d8d49387797" returned: 0 in 0.435s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:55:10 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-a04af79b-462e-4c0c-909e-5f737d4789f0 tempest-ServerRescueNegativeTestJSON-1662775418 None] Lock "cinder-quobyte-f794c3a0-497a-43cb-a568-0d8d49387797" released by "delete_volume" :: held 1.292s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 15:55:10 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-a04af79b-462e-4c0c-909e-5f737d4789f0 tempest-ServerRescueNegativeTestJSON-1662775418 None] Created reservations ['0c9e066a-5594-4112-85fe-f9beffd94972', 'cce6a06a-3c74-4d5e-a9ef-1928fd8635f3', 'b4195c3e-1108-4eba-9293-c3d93cc1324d', '4165b09a-8a9a-4556-94eb-b4c1cfa16774'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 15:55:10 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-a04af79b-462e-4c0c-909e-5f737d4789f0 tempest-ServerRescueNegativeTestJSON-1662775418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:55:10 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-a04af79b-462e-4c0c-909e-5f737d4789f0 tempest-ServerRescueNegativeTestJSON-1662775418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:55:10 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-a04af79b-462e-4c0c-909e-5f737d4789f0 tempest-ServerRescueNegativeTestJSON-1662775418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 15:55:10 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-a04af79b-462e-4c0c-909e-5f737d4789f0 tempest-ServerRescueNegativeTestJSON-1662775418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 15:55:10 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-a04af79b-462e-4c0c-909e-5f737d4789f0 tempest-ServerRescueNegativeTestJSON-1662775418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:55:10 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a04af79b-462e-4c0c-909e-5f737d4789f0 tempest-ServerRescueNegativeTestJSON-1662775418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:55:10 devstack sudo[91058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 15:55:10 devstack sudo[91058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:55:11 devstack sudo[91058]: pam_unix(sudo:session): session closed for user root Aug 10 15:55:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a04af79b-462e-4c0c-909e-5f737d4789f0 tempest-ServerRescueNegativeTestJSON-1662775418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.423s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:55:11 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-a04af79b-462e-4c0c-909e-5f737d4789f0 tempest-ServerRescueNegativeTestJSON-1662775418 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 15:55:11 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-a04af79b-462e-4c0c-909e-5f737d4789f0 tempest-ServerRescueNegativeTestJSON-1662775418 None] Deleted volume successfully. Aug 10 15:55:11 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-a04af79b-462e-4c0c-909e-5f737d4789f0 tempest-ServerRescueNegativeTestJSON-1662775418 None] Lock "cinder-f794c3a0-497a-43cb-a568-0d8d49387797-delete_volume" released by "delete_volume" :: held 2.047s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 15:55:14 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c597a20-3761-45ad-ad0f-b7e13197a8f5 tempest-AttachVolumeShelveTestJSON-1860253489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 15:55:14 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-6c597a20-3761-45ad-ad0f-b7e13197a8f5 tempest-AttachVolumeShelveTestJSON-1860253489 None] Flow 'volume_create_manager' (c3ba1dfa-4ab3-4488-92ef-0e54cac8315b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 15:55:14 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-6c597a20-3761-45ad-ad0f-b7e13197a8f5 tempest-AttachVolumeShelveTestJSON-1860253489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88aae7cd-f07b-4411-b68d-2c43664cd1cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:55:14 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-6c597a20-3761-45ad-ad0f-b7e13197a8f5 tempest-AttachVolumeShelveTestJSON-1860253489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88aae7cd-f07b-4411-b68d-2c43664cd1cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T13:55:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-191026101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8ef19d0-009a-4533-99d8-8ab783c8fb2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77b3992084e04401a79694c43cfc17bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T13:55:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T13:55:15Z,use_quota=True,user_id='ee16334aed5c4063a86a8fe298b167c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:55:14 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-6c597a20-3761-45ad-ad0f-b7e13197a8f5 tempest-AttachVolumeShelveTestJSON-1860253489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c223a651-ee6c-4e05-b3c8-bc2748bdc142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:55:14 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-6c597a20-3761-45ad-ad0f-b7e13197a8f5 tempest-AttachVolumeShelveTestJSON-1860253489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c223a651-ee6c-4e05-b3c8-bc2748bdc142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:55:14 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-6c597a20-3761-45ad-ad0f-b7e13197a8f5 tempest-AttachVolumeShelveTestJSON-1860253489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2825cf66-b5bb-41d3-8215-4cd22d7437f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:55:14 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-6c597a20-3761-45ad-ad0f-b7e13197a8f5 tempest-AttachVolumeShelveTestJSON-1860253489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2825cf66-b5bb-41d3-8215-4cd22d7437f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8ef19d0-009a-4533-99d8-8ab783c8fb2b', 'volume_name': 'volume-c8ef19d0-009a-4533-99d8-8ab783c8fb2b', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:55:14 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-6c597a20-3761-45ad-ad0f-b7e13197a8f5 tempest-AttachVolumeShelveTestJSON-1860253489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4736910d-d967-4bac-88f7-7d843de874d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:55:14 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-6c597a20-3761-45ad-ad0f-b7e13197a8f5 tempest-AttachVolumeShelveTestJSON-1860253489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4736910d-d967-4bac-88f7-7d843de874d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:55:14 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-6c597a20-3761-45ad-ad0f-b7e13197a8f5 tempest-AttachVolumeShelveTestJSON-1860253489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (810da9be-a31f-46ae-8394-e54488bf787e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:55:14 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-6c597a20-3761-45ad-ad0f-b7e13197a8f5 tempest-AttachVolumeShelveTestJSON-1860253489 None] Volume c8ef19d0-009a-4533-99d8-8ab783c8fb2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8ef19d0-009a-4533-99d8-8ab783c8fb2b', 'volume_size': 1} Aug 10 15:55:14 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-6c597a20-3761-45ad-ad0f-b7e13197a8f5 tempest-AttachVolumeShelveTestJSON-1860253489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:55:14 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-6c597a20-3761-45ad-ad0f-b7e13197a8f5 tempest-AttachVolumeShelveTestJSON-1860253489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:55:14 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-6c597a20-3761-45ad-ad0f-b7e13197a8f5 tempest-AttachVolumeShelveTestJSON-1860253489 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T13:55:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-191026101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8ef19d0-009a-4533-99d8-8ab783c8fb2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77b3992084e04401a79694c43cfc17bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T13:55:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T13:55:15Z,use_quota=True,user_id='ee16334aed5c4063a86a8fe298b167c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 15:55:14 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-6c597a20-3761-45ad-ad0f-b7e13197a8f5 tempest-AttachVolumeShelveTestJSON-1860253489 None] Creating volume c8ef19d0-009a-4533-99d8-8ab783c8fb2b {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 15:55:14 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-6c597a20-3761-45ad-ad0f-b7e13197a8f5 tempest-AttachVolumeShelveTestJSON-1860253489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:55:14 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-6c597a20-3761-45ad-ad0f-b7e13197a8f5 tempest-AttachVolumeShelveTestJSON-1860253489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:55:14 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-6c597a20-3761-45ad-ad0f-b7e13197a8f5 tempest-AttachVolumeShelveTestJSON-1860253489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 15:55:14 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-6c597a20-3761-45ad-ad0f-b7e13197a8f5 tempest-AttachVolumeShelveTestJSON-1860253489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 15:55:14 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-6c597a20-3761-45ad-ad0f-b7e13197a8f5 tempest-AttachVolumeShelveTestJSON-1860253489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:55:14 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-6c597a20-3761-45ad-ad0f-b7e13197a8f5 tempest-AttachVolumeShelveTestJSON-1860253489 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 15:55:14 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-6c597a20-3761-45ad-ad0f-b7e13197a8f5 tempest-AttachVolumeShelveTestJSON-1860253489 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 15:55:14 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6c597a20-3761-45ad-ad0f-b7e13197a8f5 tempest-AttachVolumeShelveTestJSON-1860253489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c8ef19d0-009a-4533-99d8-8ab783c8fb2b 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:55:14 devstack sudo[91182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c8ef19d0-009a-4533-99d8-8ab783c8fb2b 1073741824 Aug 10 15:55:14 devstack sudo[91182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:55:15 devstack sudo[91182]: pam_unix(sudo:session): session closed for user root Aug 10 15:55:15 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6c597a20-3761-45ad-ad0f-b7e13197a8f5 tempest-AttachVolumeShelveTestJSON-1860253489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c8ef19d0-009a-4533-99d8-8ab783c8fb2b 1073741824" returned: 0 in 0.884s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:55:15 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6c597a20-3761-45ad-ad0f-b7e13197a8f5 tempest-AttachVolumeShelveTestJSON-1860253489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c8ef19d0-009a-4533-99d8-8ab783c8fb2b {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:55:15 devstack sudo[91191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c8ef19d0-009a-4533-99d8-8ab783c8fb2b Aug 10 15:55:15 devstack sudo[91191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:55:16 devstack sudo[91191]: pam_unix(sudo:session): session closed for user root Aug 10 15:55:16 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6c597a20-3761-45ad-ad0f-b7e13197a8f5 tempest-AttachVolumeShelveTestJSON-1860253489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c8ef19d0-009a-4533-99d8-8ab783c8fb2b" returned: 0 in 0.543s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:55:16 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-6c597a20-3761-45ad-ad0f-b7e13197a8f5 tempest-AttachVolumeShelveTestJSON-1860253489 None] <== create_volume: return (1509ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 15:55:16 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-6c597a20-3761-45ad-ad0f-b7e13197a8f5 tempest-AttachVolumeShelveTestJSON-1860253489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.512s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:55:16 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-6c597a20-3761-45ad-ad0f-b7e13197a8f5 tempest-AttachVolumeShelveTestJSON-1860253489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (810da9be-a31f-46ae-8394-e54488bf787e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8ef19d0-009a-4533-99d8-8ab783c8fb2b', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:55:16 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-6c597a20-3761-45ad-ad0f-b7e13197a8f5 tempest-AttachVolumeShelveTestJSON-1860253489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e35ab4fa-9632-4fb3-8b10-caf69cc0dab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:55:16 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-6c597a20-3761-45ad-ad0f-b7e13197a8f5 tempest-AttachVolumeShelveTestJSON-1860253489 None] Volume volume-c8ef19d0-009a-4533-99d8-8ab783c8fb2b (c8ef19d0-009a-4533-99d8-8ab783c8fb2b): created successfully Aug 10 15:55:16 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-6c597a20-3761-45ad-ad0f-b7e13197a8f5 tempest-AttachVolumeShelveTestJSON-1860253489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e35ab4fa-9632-4fb3-8b10-caf69cc0dab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:55:16 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-6c597a20-3761-45ad-ad0f-b7e13197a8f5 tempest-AttachVolumeShelveTestJSON-1860253489 None] Flow 'volume_create_manager' (c3ba1dfa-4ab3-4488-92ef-0e54cac8315b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 15:55:16 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-6c597a20-3761-45ad-ad0f-b7e13197a8f5 tempest-AttachVolumeShelveTestJSON-1860253489 None] Created volume successfully. Aug 10 15:55:26 devstack cinder-volume[88641]: DEBUG dbcounter [-] [88641] Writing DB stats cinder:SELECT=6,cinder:INSERT=3,cinder:UPDATE=11 {{(pid=88641) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 15:55:26 devstack cinder-volume[88641]: DEBUG dbcounter [-] [88641] Writing DB stats cinder:UPDATE=11,cinder:SELECT=8,cinder:INSERT=2,cinder:DELETE=2 {{(pid=88641) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 15:55:36 devstack cinder-volume[88641]: DEBUG oslo_service.periodic_task [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88641) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 15:55:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:55:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:55:36 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 15:55:36 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 15:55:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:55:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:55:36 devstack sudo[91284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 15:55:36 devstack sudo[91284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:55:36 devstack sudo[91284]: pam_unix(sudo:session): session closed for user root Aug 10 15:55:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.331s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:55:36 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 15:55:39 devstack cinder-volume[88641]: DEBUG dbcounter [-] [88641] Writing DB stats cinder:SELECT=1 {{(pid=88641) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 15:55:39 devstack cinder-volume[88641]: DEBUG dbcounter [-] [88641] Writing DB stats cinder:UPDATE=1 {{(pid=88641) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 15:55:42 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [req-5f42c798-26da-46e0-a7bb-79cd9e17a778 req-55e9a508-1f12-4b4a-93f1-32c7a11dab58 tempest-AttachVolumeShelveTestJSON-1860253489 None] No connector for attachment ce54641f-78c4-46d5-85a3-d3ecedd126ee; skipping storage backend terminate_connection call. {{(pid=88641) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Aug 10 15:55:42 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [req-5f42c798-26da-46e0-a7bb-79cd9e17a778 req-55e9a508-1f12-4b4a-93f1-32c7a11dab58 tempest-AttachVolumeShelveTestJSON-1860253489 None] Deleting attachment ce54641f-78c4-46d5-85a3-d3ecedd126ee. {{(pid=88641) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 10 15:55:44 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-a07d19ad-d75b-44e7-b21f-d9ca0a890e7a tempest-TaggedAttachmentsTest-1292559499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 15:55:44 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-a07d19ad-d75b-44e7-b21f-d9ca0a890e7a tempest-TaggedAttachmentsTest-1292559499 None] Flow 'volume_create_manager' (f35c801f-513e-457a-ac59-e6ea7f0b77da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 15:55:44 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-a07d19ad-d75b-44e7-b21f-d9ca0a890e7a tempest-TaggedAttachmentsTest-1292559499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a23c81a-8701-4fbc-bf41-fa3af3d2e72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:55:44 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-a07d19ad-d75b-44e7-b21f-d9ca0a890e7a tempest-TaggedAttachmentsTest-1292559499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a23c81a-8701-4fbc-bf41-fa3af3d2e72b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T13:55:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-569647540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcae10d0-3fa5-46e1-b0a9-0d0e2faf3eb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='639bcc6d584645fd8faf7b726095e911',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T13:55:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T13:55:44Z,use_quota=True,user_id='b8827d4004a5410eb793378091b33ee9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:55:44 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-a07d19ad-d75b-44e7-b21f-d9ca0a890e7a tempest-TaggedAttachmentsTest-1292559499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78029124-791f-4f88-bfdb-2baad2025403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:55:44 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-a07d19ad-d75b-44e7-b21f-d9ca0a890e7a tempest-TaggedAttachmentsTest-1292559499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78029124-791f-4f88-bfdb-2baad2025403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:55:44 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-a07d19ad-d75b-44e7-b21f-d9ca0a890e7a tempest-TaggedAttachmentsTest-1292559499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a290810c-bdab-4eea-8cbb-cd35fe839d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:55:44 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-a07d19ad-d75b-44e7-b21f-d9ca0a890e7a tempest-TaggedAttachmentsTest-1292559499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a290810c-bdab-4eea-8cbb-cd35fe839d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcae10d0-3fa5-46e1-b0a9-0d0e2faf3eb8', 'volume_name': 'volume-dcae10d0-3fa5-46e1-b0a9-0d0e2faf3eb8', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:55:44 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-a07d19ad-d75b-44e7-b21f-d9ca0a890e7a tempest-TaggedAttachmentsTest-1292559499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47b3c906-084b-48ba-8583-1063f49114ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:55:44 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-a07d19ad-d75b-44e7-b21f-d9ca0a890e7a tempest-TaggedAttachmentsTest-1292559499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47b3c906-084b-48ba-8583-1063f49114ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:55:44 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-a07d19ad-d75b-44e7-b21f-d9ca0a890e7a tempest-TaggedAttachmentsTest-1292559499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f33d8ad-7bbf-42ea-9315-47f4927155a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:55:44 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-a07d19ad-d75b-44e7-b21f-d9ca0a890e7a tempest-TaggedAttachmentsTest-1292559499 None] Volume dcae10d0-3fa5-46e1-b0a9-0d0e2faf3eb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcae10d0-3fa5-46e1-b0a9-0d0e2faf3eb8', 'volume_size': 1} Aug 10 15:55:44 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-a07d19ad-d75b-44e7-b21f-d9ca0a890e7a tempest-TaggedAttachmentsTest-1292559499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:55:44 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-a07d19ad-d75b-44e7-b21f-d9ca0a890e7a tempest-TaggedAttachmentsTest-1292559499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:55:44 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-a07d19ad-d75b-44e7-b21f-d9ca0a890e7a tempest-TaggedAttachmentsTest-1292559499 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T13:55:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-569647540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcae10d0-3fa5-46e1-b0a9-0d0e2faf3eb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='639bcc6d584645fd8faf7b726095e911',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T13:55:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T13:55:44Z,use_quota=True,user_id='b8827d4004a5410eb793378091b33ee9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 15:55:44 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-a07d19ad-d75b-44e7-b21f-d9ca0a890e7a tempest-TaggedAttachmentsTest-1292559499 None] Creating volume dcae10d0-3fa5-46e1-b0a9-0d0e2faf3eb8 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 15:55:44 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-a07d19ad-d75b-44e7-b21f-d9ca0a890e7a tempest-TaggedAttachmentsTest-1292559499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:55:44 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-a07d19ad-d75b-44e7-b21f-d9ca0a890e7a tempest-TaggedAttachmentsTest-1292559499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:55:44 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-a07d19ad-d75b-44e7-b21f-d9ca0a890e7a tempest-TaggedAttachmentsTest-1292559499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 15:55:44 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-a07d19ad-d75b-44e7-b21f-d9ca0a890e7a tempest-TaggedAttachmentsTest-1292559499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 15:55:44 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-a07d19ad-d75b-44e7-b21f-d9ca0a890e7a tempest-TaggedAttachmentsTest-1292559499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:55:44 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-a07d19ad-d75b-44e7-b21f-d9ca0a890e7a tempest-TaggedAttachmentsTest-1292559499 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 15:55:44 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-a07d19ad-d75b-44e7-b21f-d9ca0a890e7a tempest-TaggedAttachmentsTest-1292559499 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 15:55:44 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a07d19ad-d75b-44e7-b21f-d9ca0a890e7a tempest-TaggedAttachmentsTest-1292559499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-dcae10d0-3fa5-46e1-b0a9-0d0e2faf3eb8 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:55:44 devstack sudo[91327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-dcae10d0-3fa5-46e1-b0a9-0d0e2faf3eb8 1073741824 Aug 10 15:55:44 devstack sudo[91327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:55:44 devstack sudo[91327]: pam_unix(sudo:session): session closed for user root Aug 10 15:55:44 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a07d19ad-d75b-44e7-b21f-d9ca0a890e7a tempest-TaggedAttachmentsTest-1292559499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-dcae10d0-3fa5-46e1-b0a9-0d0e2faf3eb8 1073741824" returned: 0 in 0.575s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:55:44 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a07d19ad-d75b-44e7-b21f-d9ca0a890e7a tempest-TaggedAttachmentsTest-1292559499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-dcae10d0-3fa5-46e1-b0a9-0d0e2faf3eb8 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:55:45 devstack sudo[91333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-dcae10d0-3fa5-46e1-b0a9-0d0e2faf3eb8 Aug 10 15:55:45 devstack sudo[91333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:55:45 devstack sudo[91333]: pam_unix(sudo:session): session closed for user root Aug 10 15:55:45 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a07d19ad-d75b-44e7-b21f-d9ca0a890e7a tempest-TaggedAttachmentsTest-1292559499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-dcae10d0-3fa5-46e1-b0a9-0d0e2faf3eb8" returned: 0 in 0.413s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:55:45 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-a07d19ad-d75b-44e7-b21f-d9ca0a890e7a tempest-TaggedAttachmentsTest-1292559499 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 15:55:45 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-a07d19ad-d75b-44e7-b21f-d9ca0a890e7a tempest-TaggedAttachmentsTest-1292559499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:55:45 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-a07d19ad-d75b-44e7-b21f-d9ca0a890e7a tempest-TaggedAttachmentsTest-1292559499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f33d8ad-7bbf-42ea-9315-47f4927155a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcae10d0-3fa5-46e1-b0a9-0d0e2faf3eb8', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:55:45 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-a07d19ad-d75b-44e7-b21f-d9ca0a890e7a tempest-TaggedAttachmentsTest-1292559499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4799cb5-204f-44cc-b988-c89fe0544e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:55:45 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-a07d19ad-d75b-44e7-b21f-d9ca0a890e7a tempest-TaggedAttachmentsTest-1292559499 None] Volume volume-dcae10d0-3fa5-46e1-b0a9-0d0e2faf3eb8 (dcae10d0-3fa5-46e1-b0a9-0d0e2faf3eb8): created successfully Aug 10 15:55:45 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-a07d19ad-d75b-44e7-b21f-d9ca0a890e7a tempest-TaggedAttachmentsTest-1292559499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4799cb5-204f-44cc-b988-c89fe0544e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:55:45 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-a07d19ad-d75b-44e7-b21f-d9ca0a890e7a tempest-TaggedAttachmentsTest-1292559499 None] Flow 'volume_create_manager' (f35c801f-513e-457a-ac59-e6ea7f0b77da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 15:55:45 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-a07d19ad-d75b-44e7-b21f-d9ca0a890e7a tempest-TaggedAttachmentsTest-1292559499 None] Created volume successfully. Aug 10 15:55:55 devstack cinder-volume[88641]: DEBUG dbcounter [-] [88641] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=88641) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 15:55:55 devstack cinder-volume[88641]: DEBUG dbcounter [-] [88641] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=88641) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 15:56:17 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-c313f632-0ad9-4f8f-9202-3e934fb8d9a6 tempest-VolumesAdminNegativeTest-349362875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 15:56:17 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c313f632-0ad9-4f8f-9202-3e934fb8d9a6 tempest-VolumesAdminNegativeTest-349362875 None] Flow 'volume_create_manager' (53a41e70-4421-4796-920c-ac758be60dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 15:56:17 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c313f632-0ad9-4f8f-9202-3e934fb8d9a6 tempest-VolumesAdminNegativeTest-349362875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (133ee600-1c81-48ac-91b6-4cf9a5c93463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:56:17 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c313f632-0ad9-4f8f-9202-3e934fb8d9a6 tempest-VolumesAdminNegativeTest-349362875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (133ee600-1c81-48ac-91b6-4cf9a5c93463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T13:56:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1004739613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80ba163f-6a8e-46b5-8ee5-be21d0c27943,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b7673ca28fb47e0812558a2edeef1f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T13:56:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T13:56:18Z,use_quota=True,user_id='ffe9ac51423742fab89a91086da66c92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:56:17 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c313f632-0ad9-4f8f-9202-3e934fb8d9a6 tempest-VolumesAdminNegativeTest-349362875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f552d03-e8fd-4dbf-bac0-effefffdb4b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:56:17 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c313f632-0ad9-4f8f-9202-3e934fb8d9a6 tempest-VolumesAdminNegativeTest-349362875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f552d03-e8fd-4dbf-bac0-effefffdb4b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:56:17 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c313f632-0ad9-4f8f-9202-3e934fb8d9a6 tempest-VolumesAdminNegativeTest-349362875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81effa22-7bcd-4469-a266-ec524bbf3810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:56:17 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c313f632-0ad9-4f8f-9202-3e934fb8d9a6 tempest-VolumesAdminNegativeTest-349362875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81effa22-7bcd-4469-a266-ec524bbf3810) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80ba163f-6a8e-46b5-8ee5-be21d0c27943', 'volume_name': 'volume-80ba163f-6a8e-46b5-8ee5-be21d0c27943', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:56:17 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c313f632-0ad9-4f8f-9202-3e934fb8d9a6 tempest-VolumesAdminNegativeTest-349362875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df4f0ab3-990b-43a9-824a-7a76c7466638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:56:17 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c313f632-0ad9-4f8f-9202-3e934fb8d9a6 tempest-VolumesAdminNegativeTest-349362875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df4f0ab3-990b-43a9-824a-7a76c7466638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:56:17 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c313f632-0ad9-4f8f-9202-3e934fb8d9a6 tempest-VolumesAdminNegativeTest-349362875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5950fb47-7344-4215-b213-7b79ca9e6aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:56:17 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-c313f632-0ad9-4f8f-9202-3e934fb8d9a6 tempest-VolumesAdminNegativeTest-349362875 None] Volume 80ba163f-6a8e-46b5-8ee5-be21d0c27943: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80ba163f-6a8e-46b5-8ee5-be21d0c27943', 'volume_size': 1} Aug 10 15:56:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-c313f632-0ad9-4f8f-9202-3e934fb8d9a6 tempest-VolumesAdminNegativeTest-349362875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:56:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-c313f632-0ad9-4f8f-9202-3e934fb8d9a6 tempest-VolumesAdminNegativeTest-349362875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:56:17 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-c313f632-0ad9-4f8f-9202-3e934fb8d9a6 tempest-VolumesAdminNegativeTest-349362875 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T13:56:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1004739613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80ba163f-6a8e-46b5-8ee5-be21d0c27943,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b7673ca28fb47e0812558a2edeef1f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T13:56:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T13:56:18Z,use_quota=True,user_id='ffe9ac51423742fab89a91086da66c92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 15:56:17 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-c313f632-0ad9-4f8f-9202-3e934fb8d9a6 tempest-VolumesAdminNegativeTest-349362875 None] Creating volume 80ba163f-6a8e-46b5-8ee5-be21d0c27943 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 15:56:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-c313f632-0ad9-4f8f-9202-3e934fb8d9a6 tempest-VolumesAdminNegativeTest-349362875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:56:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-c313f632-0ad9-4f8f-9202-3e934fb8d9a6 tempest-VolumesAdminNegativeTest-349362875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:56:17 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-c313f632-0ad9-4f8f-9202-3e934fb8d9a6 tempest-VolumesAdminNegativeTest-349362875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 15:56:17 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-c313f632-0ad9-4f8f-9202-3e934fb8d9a6 tempest-VolumesAdminNegativeTest-349362875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 15:56:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-c313f632-0ad9-4f8f-9202-3e934fb8d9a6 tempest-VolumesAdminNegativeTest-349362875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:56:17 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-c313f632-0ad9-4f8f-9202-3e934fb8d9a6 tempest-VolumesAdminNegativeTest-349362875 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 15:56:17 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-c313f632-0ad9-4f8f-9202-3e934fb8d9a6 tempest-VolumesAdminNegativeTest-349362875 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 15:56:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c313f632-0ad9-4f8f-9202-3e934fb8d9a6 tempest-VolumesAdminNegativeTest-349362875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-80ba163f-6a8e-46b5-8ee5-be21d0c27943 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:56:18 devstack sudo[91774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-80ba163f-6a8e-46b5-8ee5-be21d0c27943 1073741824 Aug 10 15:56:18 devstack sudo[91774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:56:18 devstack sudo[91774]: pam_unix(sudo:session): session closed for user root Aug 10 15:56:18 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c313f632-0ad9-4f8f-9202-3e934fb8d9a6 tempest-VolumesAdminNegativeTest-349362875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-80ba163f-6a8e-46b5-8ee5-be21d0c27943 1073741824" returned: 0 in 1.004s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:56:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c313f632-0ad9-4f8f-9202-3e934fb8d9a6 tempest-VolumesAdminNegativeTest-349362875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-80ba163f-6a8e-46b5-8ee5-be21d0c27943 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:56:19 devstack sudo[91784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-80ba163f-6a8e-46b5-8ee5-be21d0c27943 Aug 10 15:56:19 devstack sudo[91784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:56:19 devstack sudo[91784]: pam_unix(sudo:session): session closed for user root Aug 10 15:56:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c313f632-0ad9-4f8f-9202-3e934fb8d9a6 tempest-VolumesAdminNegativeTest-349362875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-80ba163f-6a8e-46b5-8ee5-be21d0c27943" returned: 0 in 0.658s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:56:19 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-c313f632-0ad9-4f8f-9202-3e934fb8d9a6 tempest-VolumesAdminNegativeTest-349362875 None] <== create_volume: return (1796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 15:56:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-c313f632-0ad9-4f8f-9202-3e934fb8d9a6 tempest-VolumesAdminNegativeTest-349362875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.800s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:56:19 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c313f632-0ad9-4f8f-9202-3e934fb8d9a6 tempest-VolumesAdminNegativeTest-349362875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5950fb47-7344-4215-b213-7b79ca9e6aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80ba163f-6a8e-46b5-8ee5-be21d0c27943', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:56:19 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c313f632-0ad9-4f8f-9202-3e934fb8d9a6 tempest-VolumesAdminNegativeTest-349362875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efcf2a22-594c-490c-a6d0-90e724461ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:56:19 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-c313f632-0ad9-4f8f-9202-3e934fb8d9a6 tempest-VolumesAdminNegativeTest-349362875 None] Volume volume-80ba163f-6a8e-46b5-8ee5-be21d0c27943 (80ba163f-6a8e-46b5-8ee5-be21d0c27943): created successfully Aug 10 15:56:19 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c313f632-0ad9-4f8f-9202-3e934fb8d9a6 tempest-VolumesAdminNegativeTest-349362875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efcf2a22-594c-490c-a6d0-90e724461ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:56:19 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c313f632-0ad9-4f8f-9202-3e934fb8d9a6 tempest-VolumesAdminNegativeTest-349362875 None] Flow 'volume_create_manager' (53a41e70-4421-4796-920c-ac758be60dbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 15:56:19 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-c313f632-0ad9-4f8f-9202-3e934fb8d9a6 tempest-VolumesAdminNegativeTest-349362875 None] Created volume successfully. Aug 10 15:56:21 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-1d21dbe6-fb6d-48ed-b7d2-ac6c61c94c79 tempest-VolumesAdminNegativeTest-349362875 None] Acquiring lock "cinder-80ba163f-6a8e-46b5-8ee5-be21d0c27943-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 15:56:21 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-1d21dbe6-fb6d-48ed-b7d2-ac6c61c94c79 tempest-VolumesAdminNegativeTest-349362875 None] Lock "cinder-80ba163f-6a8e-46b5-8ee5-be21d0c27943-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 15:56:21 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-1d21dbe6-fb6d-48ed-b7d2-ac6c61c94c79 tempest-VolumesAdminNegativeTest-349362875 None] Acquiring lock "cinder-quobyte-80ba163f-6a8e-46b5-8ee5-be21d0c27943" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 15:56:21 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-1d21dbe6-fb6d-48ed-b7d2-ac6c61c94c79 tempest-VolumesAdminNegativeTest-349362875 None] Lock "cinder-quobyte-80ba163f-6a8e-46b5-8ee5-be21d0c27943" acquired by "delete_volume" :: waited 0.021s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 15:56:21 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[b051d8e3-ba58-4bcb-bac1-fef3c15d01e1]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 15:56:21 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-1d21dbe6-fb6d-48ed-b7d2-ac6c61c94c79 tempest-VolumesAdminNegativeTest-349362875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-80ba163f-6a8e-46b5-8ee5-be21d0c27943 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:56:21 devstack sudo[91792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-80ba163f-6a8e-46b5-8ee5-be21d0c27943 Aug 10 15:56:21 devstack sudo[91792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:56:22 devstack sudo[91792]: pam_unix(sudo:session): session closed for user root Aug 10 15:56:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-1d21dbe6-fb6d-48ed-b7d2-ac6c61c94c79 tempest-VolumesAdminNegativeTest-349362875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-80ba163f-6a8e-46b5-8ee5-be21d0c27943" returned: 0 in 0.495s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:56:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-1d21dbe6-fb6d-48ed-b7d2-ac6c61c94c79 tempest-VolumesAdminNegativeTest-349362875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-80ba163f-6a8e-46b5-8ee5-be21d0c27943 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:56:22 devstack sudo[91797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-80ba163f-6a8e-46b5-8ee5-be21d0c27943 Aug 10 15:56:22 devstack sudo[91797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:56:22 devstack sudo[91797]: pam_unix(sudo:session): session closed for user root Aug 10 15:56:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-1d21dbe6-fb6d-48ed-b7d2-ac6c61c94c79 tempest-VolumesAdminNegativeTest-349362875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-80ba163f-6a8e-46b5-8ee5-be21d0c27943" returned: 0 in 0.354s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:56:22 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-1d21dbe6-fb6d-48ed-b7d2-ac6c61c94c79 tempest-VolumesAdminNegativeTest-349362875 None] Lock "cinder-quobyte-80ba163f-6a8e-46b5-8ee5-be21d0c27943" released by "delete_volume" :: held 0.924s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 15:56:22 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-1d21dbe6-fb6d-48ed-b7d2-ac6c61c94c79 tempest-VolumesAdminNegativeTest-349362875 None] Created reservations ['01e75186-3f01-4c88-9318-ffd277fea6be', '75ad270a-b292-47f1-815d-f2c7cd82cc76', '5ceff9b7-f102-4e1b-8512-91e09d53845e', 'f8bb6f67-2232-4dde-9e5f-180401ea272d'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 15:56:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-1d21dbe6-fb6d-48ed-b7d2-ac6c61c94c79 tempest-VolumesAdminNegativeTest-349362875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:56:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-1d21dbe6-fb6d-48ed-b7d2-ac6c61c94c79 tempest-VolumesAdminNegativeTest-349362875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:56:22 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-1d21dbe6-fb6d-48ed-b7d2-ac6c61c94c79 tempest-VolumesAdminNegativeTest-349362875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 15:56:23 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-1d21dbe6-fb6d-48ed-b7d2-ac6c61c94c79 tempest-VolumesAdminNegativeTest-349362875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 15:56:23 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-1d21dbe6-fb6d-48ed-b7d2-ac6c61c94c79 tempest-VolumesAdminNegativeTest-349362875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:56:23 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-1d21dbe6-fb6d-48ed-b7d2-ac6c61c94c79 tempest-VolumesAdminNegativeTest-349362875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:56:23 devstack sudo[91804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 15:56:23 devstack sudo[91804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:56:23 devstack sudo[91804]: pam_unix(sudo:session): session closed for user root Aug 10 15:56:23 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-1d21dbe6-fb6d-48ed-b7d2-ac6c61c94c79 tempest-VolumesAdminNegativeTest-349362875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.713s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:56:23 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-1d21dbe6-fb6d-48ed-b7d2-ac6c61c94c79 tempest-VolumesAdminNegativeTest-349362875 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 15:56:23 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-1d21dbe6-fb6d-48ed-b7d2-ac6c61c94c79 tempest-VolumesAdminNegativeTest-349362875 None] Deleted volume successfully. Aug 10 15:56:23 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-1d21dbe6-fb6d-48ed-b7d2-ac6c61c94c79 tempest-VolumesAdminNegativeTest-349362875 None] Lock "cinder-80ba163f-6a8e-46b5-8ee5-be21d0c27943-delete_volume" released by "delete_volume" :: held 2.137s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 15:56:32 devstack cinder-volume[88641]: DEBUG dbcounter [-] [88641] Writing DB stats cinder:SELECT=7,cinder:UPDATE=14,cinder:DELETE=1,cinder:INSERT=2 {{(pid=88641) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 15:56:33 devstack cinder-volume[88641]: DEBUG dbcounter [-] [88641] Writing DB stats cinder:SELECT=7,cinder:INSERT=3,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=88641) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 15:56:36 devstack cinder-volume[88641]: DEBUG oslo_service.periodic_task [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88641) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 15:56:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:56:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:56:36 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 15:56:36 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 15:56:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:56:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:56:36 devstack sudo[91976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 15:56:36 devstack sudo[91976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:56:36 devstack sudo[91976]: pam_unix(sudo:session): session closed for user root Aug 10 15:56:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.521s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:56:36 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 15:56:36 devstack cinder-volume[88641]: DEBUG oslo_service.periodic_task [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Running periodic task VolumeManager._thread_info {{(pid=88641) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 15:56:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] thread count: 8 {{(pid=88641) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 10 15:56:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] thread info: [<_MainThread(MainThread, started 127361545748608)>, , , , , , , ] {{(pid=88641) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 10 15:56:40 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed893b0d-ac19-431f-a5d4-834c036e666e tempest-ServersNegativeTestJSON-1343817191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 15:56:40 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-ed893b0d-ac19-431f-a5d4-834c036e666e tempest-ServersNegativeTestJSON-1343817191 None] Flow 'volume_create_manager' (cbd2b8f5-4217-445b-8b55-42398b0da9a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 15:56:40 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-ed893b0d-ac19-431f-a5d4-834c036e666e tempest-ServersNegativeTestJSON-1343817191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07695189-c88c-45f6-8f51-acf3e936a2a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:56:40 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-ed893b0d-ac19-431f-a5d4-834c036e666e tempest-ServersNegativeTestJSON-1343817191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07695189-c88c-45f6-8f51-acf3e936a2a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T13:56:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-903805706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a0f4bec-73b3-4b25-bbad-d6a6b8085dbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef9b4eec61c647d1ba64630819ec410f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T13:56:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T13:56:41Z,use_quota=True,user_id='9ef90e84dc11424c80325163f1b8d7d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:56:40 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-ed893b0d-ac19-431f-a5d4-834c036e666e tempest-ServersNegativeTestJSON-1343817191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5b4fe01-d50a-4c75-a585-393fc1d6d528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:56:40 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-ed893b0d-ac19-431f-a5d4-834c036e666e tempest-ServersNegativeTestJSON-1343817191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5b4fe01-d50a-4c75-a585-393fc1d6d528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:56:40 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-ed893b0d-ac19-431f-a5d4-834c036e666e tempest-ServersNegativeTestJSON-1343817191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdc1ebc2-3cfc-4906-aef1-87f8440b1e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:56:40 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-ed893b0d-ac19-431f-a5d4-834c036e666e tempest-ServersNegativeTestJSON-1343817191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdc1ebc2-3cfc-4906-aef1-87f8440b1e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a0f4bec-73b3-4b25-bbad-d6a6b8085dbf', 'volume_name': 'volume-3a0f4bec-73b3-4b25-bbad-d6a6b8085dbf', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:56:40 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-ed893b0d-ac19-431f-a5d4-834c036e666e tempest-ServersNegativeTestJSON-1343817191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d77ca986-42ee-4838-a395-6078f329ebc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:56:40 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-ed893b0d-ac19-431f-a5d4-834c036e666e tempest-ServersNegativeTestJSON-1343817191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d77ca986-42ee-4838-a395-6078f329ebc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:56:40 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-ed893b0d-ac19-431f-a5d4-834c036e666e tempest-ServersNegativeTestJSON-1343817191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0aaab1ec-c18c-4666-92b5-a9ed09fc528f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:56:40 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-ed893b0d-ac19-431f-a5d4-834c036e666e tempest-ServersNegativeTestJSON-1343817191 None] Volume 3a0f4bec-73b3-4b25-bbad-d6a6b8085dbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a0f4bec-73b3-4b25-bbad-d6a6b8085dbf', 'volume_size': 1} Aug 10 15:56:40 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-ed893b0d-ac19-431f-a5d4-834c036e666e tempest-ServersNegativeTestJSON-1343817191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:56:40 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-ed893b0d-ac19-431f-a5d4-834c036e666e tempest-ServersNegativeTestJSON-1343817191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:56:40 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-ed893b0d-ac19-431f-a5d4-834c036e666e tempest-ServersNegativeTestJSON-1343817191 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T13:56:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-903805706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a0f4bec-73b3-4b25-bbad-d6a6b8085dbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef9b4eec61c647d1ba64630819ec410f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T13:56:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T13:56:41Z,use_quota=True,user_id='9ef90e84dc11424c80325163f1b8d7d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 15:56:40 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-ed893b0d-ac19-431f-a5d4-834c036e666e tempest-ServersNegativeTestJSON-1343817191 None] Creating volume 3a0f4bec-73b3-4b25-bbad-d6a6b8085dbf {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 15:56:40 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-ed893b0d-ac19-431f-a5d4-834c036e666e tempest-ServersNegativeTestJSON-1343817191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:56:40 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-ed893b0d-ac19-431f-a5d4-834c036e666e tempest-ServersNegativeTestJSON-1343817191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:56:40 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-ed893b0d-ac19-431f-a5d4-834c036e666e tempest-ServersNegativeTestJSON-1343817191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 15:56:40 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-ed893b0d-ac19-431f-a5d4-834c036e666e tempest-ServersNegativeTestJSON-1343817191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 15:56:40 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-ed893b0d-ac19-431f-a5d4-834c036e666e tempest-ServersNegativeTestJSON-1343817191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:56:40 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-ed893b0d-ac19-431f-a5d4-834c036e666e tempest-ServersNegativeTestJSON-1343817191 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 15:56:40 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-ed893b0d-ac19-431f-a5d4-834c036e666e tempest-ServersNegativeTestJSON-1343817191 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 15:56:40 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ed893b0d-ac19-431f-a5d4-834c036e666e tempest-ServersNegativeTestJSON-1343817191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3a0f4bec-73b3-4b25-bbad-d6a6b8085dbf 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:56:40 devstack sudo[92045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3a0f4bec-73b3-4b25-bbad-d6a6b8085dbf 1073741824 Aug 10 15:56:40 devstack sudo[92045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:56:41 devstack sudo[92045]: pam_unix(sudo:session): session closed for user root Aug 10 15:56:41 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ed893b0d-ac19-431f-a5d4-834c036e666e tempest-ServersNegativeTestJSON-1343817191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3a0f4bec-73b3-4b25-bbad-d6a6b8085dbf 1073741824" returned: 0 in 0.431s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:56:41 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ed893b0d-ac19-431f-a5d4-834c036e666e tempest-ServersNegativeTestJSON-1343817191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3a0f4bec-73b3-4b25-bbad-d6a6b8085dbf {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:56:41 devstack sudo[92053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3a0f4bec-73b3-4b25-bbad-d6a6b8085dbf Aug 10 15:56:41 devstack sudo[92053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:56:41 devstack sudo[92053]: pam_unix(sudo:session): session closed for user root Aug 10 15:56:41 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ed893b0d-ac19-431f-a5d4-834c036e666e tempest-ServersNegativeTestJSON-1343817191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3a0f4bec-73b3-4b25-bbad-d6a6b8085dbf" returned: 0 in 0.252s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:56:41 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-ed893b0d-ac19-431f-a5d4-834c036e666e tempest-ServersNegativeTestJSON-1343817191 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 15:56:41 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-ed893b0d-ac19-431f-a5d4-834c036e666e tempest-ServersNegativeTestJSON-1343817191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:56:41 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-ed893b0d-ac19-431f-a5d4-834c036e666e tempest-ServersNegativeTestJSON-1343817191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0aaab1ec-c18c-4666-92b5-a9ed09fc528f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a0f4bec-73b3-4b25-bbad-d6a6b8085dbf', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:56:41 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-ed893b0d-ac19-431f-a5d4-834c036e666e tempest-ServersNegativeTestJSON-1343817191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c85bd35f-a056-49a1-bd33-67798a37d552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:56:41 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-ed893b0d-ac19-431f-a5d4-834c036e666e tempest-ServersNegativeTestJSON-1343817191 None] Volume volume-3a0f4bec-73b3-4b25-bbad-d6a6b8085dbf (3a0f4bec-73b3-4b25-bbad-d6a6b8085dbf): created successfully Aug 10 15:56:41 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-ed893b0d-ac19-431f-a5d4-834c036e666e tempest-ServersNegativeTestJSON-1343817191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c85bd35f-a056-49a1-bd33-67798a37d552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:56:41 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-ed893b0d-ac19-431f-a5d4-834c036e666e tempest-ServersNegativeTestJSON-1343817191 None] Flow 'volume_create_manager' (cbd2b8f5-4217-445b-8b55-42398b0da9a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 15:56:41 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-ed893b0d-ac19-431f-a5d4-834c036e666e tempest-ServersNegativeTestJSON-1343817191 None] Created volume successfully. Aug 10 15:56:43 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-44049428-d25c-4e8e-b3ae-bfd0afc03a4b tempest-ServersNegativeTestJSON-1343817191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 15:56:43 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-44049428-d25c-4e8e-b3ae-bfd0afc03a4b tempest-ServersNegativeTestJSON-1343817191 None] Flow 'volume_create_manager' (2fcf3eb3-85a2-4cc4-a929-72cce4a1e386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 15:56:43 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-44049428-d25c-4e8e-b3ae-bfd0afc03a4b tempest-ServersNegativeTestJSON-1343817191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bbc535e-60f0-4d93-87a5-56915ae977d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:56:43 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-44049428-d25c-4e8e-b3ae-bfd0afc03a4b tempest-ServersNegativeTestJSON-1343817191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bbc535e-60f0-4d93-87a5-56915ae977d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T13:56:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1821166443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=579da620-3814-4f94-a3c5-83b0d70d85e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef9b4eec61c647d1ba64630819ec410f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T13:56:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T13:56:44Z,use_quota=True,user_id='9ef90e84dc11424c80325163f1b8d7d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:56:43 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-44049428-d25c-4e8e-b3ae-bfd0afc03a4b tempest-ServersNegativeTestJSON-1343817191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a51450cb-ec1d-4b44-bf93-ec627bc0fef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:56:43 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-44049428-d25c-4e8e-b3ae-bfd0afc03a4b tempest-ServersNegativeTestJSON-1343817191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a51450cb-ec1d-4b44-bf93-ec627bc0fef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:56:43 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-44049428-d25c-4e8e-b3ae-bfd0afc03a4b tempest-ServersNegativeTestJSON-1343817191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90c37efa-9ed8-4067-9db6-c77133d0a8e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:56:43 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-44049428-d25c-4e8e-b3ae-bfd0afc03a4b tempest-ServersNegativeTestJSON-1343817191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90c37efa-9ed8-4067-9db6-c77133d0a8e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '579da620-3814-4f94-a3c5-83b0d70d85e5', 'volume_name': 'volume-579da620-3814-4f94-a3c5-83b0d70d85e5', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:56:43 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-44049428-d25c-4e8e-b3ae-bfd0afc03a4b tempest-ServersNegativeTestJSON-1343817191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b609e5e-f5a5-4034-bb32-95f4e5c0dc98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:56:43 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-44049428-d25c-4e8e-b3ae-bfd0afc03a4b tempest-ServersNegativeTestJSON-1343817191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b609e5e-f5a5-4034-bb32-95f4e5c0dc98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:56:43 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-44049428-d25c-4e8e-b3ae-bfd0afc03a4b tempest-ServersNegativeTestJSON-1343817191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1879934e-1004-4614-aeb0-7cd54d2c4fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:56:43 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-44049428-d25c-4e8e-b3ae-bfd0afc03a4b tempest-ServersNegativeTestJSON-1343817191 None] Volume 579da620-3814-4f94-a3c5-83b0d70d85e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-579da620-3814-4f94-a3c5-83b0d70d85e5', 'volume_size': 1} Aug 10 15:56:43 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-44049428-d25c-4e8e-b3ae-bfd0afc03a4b tempest-ServersNegativeTestJSON-1343817191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:56:43 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-44049428-d25c-4e8e-b3ae-bfd0afc03a4b tempest-ServersNegativeTestJSON-1343817191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:56:43 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-44049428-d25c-4e8e-b3ae-bfd0afc03a4b tempest-ServersNegativeTestJSON-1343817191 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T13:56:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1821166443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=579da620-3814-4f94-a3c5-83b0d70d85e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef9b4eec61c647d1ba64630819ec410f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T13:56:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T13:56:44Z,use_quota=True,user_id='9ef90e84dc11424c80325163f1b8d7d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 15:56:43 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-44049428-d25c-4e8e-b3ae-bfd0afc03a4b tempest-ServersNegativeTestJSON-1343817191 None] Creating volume 579da620-3814-4f94-a3c5-83b0d70d85e5 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 15:56:43 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-44049428-d25c-4e8e-b3ae-bfd0afc03a4b tempest-ServersNegativeTestJSON-1343817191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:56:43 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-44049428-d25c-4e8e-b3ae-bfd0afc03a4b tempest-ServersNegativeTestJSON-1343817191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:56:43 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-44049428-d25c-4e8e-b3ae-bfd0afc03a4b tempest-ServersNegativeTestJSON-1343817191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 15:56:43 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-44049428-d25c-4e8e-b3ae-bfd0afc03a4b tempest-ServersNegativeTestJSON-1343817191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 15:56:43 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-44049428-d25c-4e8e-b3ae-bfd0afc03a4b tempest-ServersNegativeTestJSON-1343817191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:56:43 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-44049428-d25c-4e8e-b3ae-bfd0afc03a4b tempest-ServersNegativeTestJSON-1343817191 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 15:56:43 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-44049428-d25c-4e8e-b3ae-bfd0afc03a4b tempest-ServersNegativeTestJSON-1343817191 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 15:56:43 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-44049428-d25c-4e8e-b3ae-bfd0afc03a4b tempest-ServersNegativeTestJSON-1343817191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-579da620-3814-4f94-a3c5-83b0d70d85e5 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:56:43 devstack sudo[92091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-579da620-3814-4f94-a3c5-83b0d70d85e5 1073741824 Aug 10 15:56:43 devstack sudo[92091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:56:44 devstack sudo[92091]: pam_unix(sudo:session): session closed for user root Aug 10 15:56:44 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-44049428-d25c-4e8e-b3ae-bfd0afc03a4b tempest-ServersNegativeTestJSON-1343817191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-579da620-3814-4f94-a3c5-83b0d70d85e5 1073741824" returned: 0 in 0.505s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:56:44 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-44049428-d25c-4e8e-b3ae-bfd0afc03a4b tempest-ServersNegativeTestJSON-1343817191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-579da620-3814-4f94-a3c5-83b0d70d85e5 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:56:44 devstack sudo[92099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-579da620-3814-4f94-a3c5-83b0d70d85e5 Aug 10 15:56:44 devstack sudo[92099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:56:44 devstack sudo[92099]: pam_unix(sudo:session): session closed for user root Aug 10 15:56:44 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-44049428-d25c-4e8e-b3ae-bfd0afc03a4b tempest-ServersNegativeTestJSON-1343817191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-579da620-3814-4f94-a3c5-83b0d70d85e5" returned: 0 in 0.254s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:56:44 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-44049428-d25c-4e8e-b3ae-bfd0afc03a4b tempest-ServersNegativeTestJSON-1343817191 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 15:56:44 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-44049428-d25c-4e8e-b3ae-bfd0afc03a4b tempest-ServersNegativeTestJSON-1343817191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:56:44 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-44049428-d25c-4e8e-b3ae-bfd0afc03a4b tempest-ServersNegativeTestJSON-1343817191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1879934e-1004-4614-aeb0-7cd54d2c4fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-579da620-3814-4f94-a3c5-83b0d70d85e5', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:56:44 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-44049428-d25c-4e8e-b3ae-bfd0afc03a4b tempest-ServersNegativeTestJSON-1343817191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (722d8394-21ba-417f-9bdf-9fcf2d8c3c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:56:44 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-44049428-d25c-4e8e-b3ae-bfd0afc03a4b tempest-ServersNegativeTestJSON-1343817191 None] Volume volume-579da620-3814-4f94-a3c5-83b0d70d85e5 (579da620-3814-4f94-a3c5-83b0d70d85e5): created successfully Aug 10 15:56:44 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-44049428-d25c-4e8e-b3ae-bfd0afc03a4b tempest-ServersNegativeTestJSON-1343817191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (722d8394-21ba-417f-9bdf-9fcf2d8c3c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:56:44 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-44049428-d25c-4e8e-b3ae-bfd0afc03a4b tempest-ServersNegativeTestJSON-1343817191 None] Flow 'volume_create_manager' (2fcf3eb3-85a2-4cc4-a929-72cce4a1e386) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 15:56:44 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-44049428-d25c-4e8e-b3ae-bfd0afc03a4b tempest-ServersNegativeTestJSON-1343817191 None] Created volume successfully. Aug 10 15:56:46 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-dee0596c-27e7-44c7-883d-a7a9f779f6eb tempest-ServersNegativeTestJSON-1343817191 None] Acquiring lock "cinder-579da620-3814-4f94-a3c5-83b0d70d85e5-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 15:56:46 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-dee0596c-27e7-44c7-883d-a7a9f779f6eb tempest-ServersNegativeTestJSON-1343817191 None] Lock "cinder-579da620-3814-4f94-a3c5-83b0d70d85e5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 15:56:46 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-dee0596c-27e7-44c7-883d-a7a9f779f6eb tempest-ServersNegativeTestJSON-1343817191 None] Acquiring lock "cinder-quobyte-579da620-3814-4f94-a3c5-83b0d70d85e5" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 15:56:46 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-dee0596c-27e7-44c7-883d-a7a9f779f6eb tempest-ServersNegativeTestJSON-1343817191 None] Lock "cinder-quobyte-579da620-3814-4f94-a3c5-83b0d70d85e5" acquired by "delete_volume" :: waited 0.014s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 15:56:46 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[263f50d8-7ed8-4145-8516-c322526a5036]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 15:56:46 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-dee0596c-27e7-44c7-883d-a7a9f779f6eb tempest-ServersNegativeTestJSON-1343817191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-579da620-3814-4f94-a3c5-83b0d70d85e5 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:56:46 devstack sudo[92103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-579da620-3814-4f94-a3c5-83b0d70d85e5 Aug 10 15:56:46 devstack sudo[92103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:56:46 devstack sudo[92103]: pam_unix(sudo:session): session closed for user root Aug 10 15:56:46 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-dee0596c-27e7-44c7-883d-a7a9f779f6eb tempest-ServersNegativeTestJSON-1343817191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-579da620-3814-4f94-a3c5-83b0d70d85e5" returned: 0 in 0.386s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:56:46 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-dee0596c-27e7-44c7-883d-a7a9f779f6eb tempest-ServersNegativeTestJSON-1343817191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-579da620-3814-4f94-a3c5-83b0d70d85e5 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:56:46 devstack sudo[92108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-579da620-3814-4f94-a3c5-83b0d70d85e5 Aug 10 15:56:46 devstack sudo[92108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:56:46 devstack sudo[92108]: pam_unix(sudo:session): session closed for user root Aug 10 15:56:46 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-dee0596c-27e7-44c7-883d-a7a9f779f6eb tempest-ServersNegativeTestJSON-1343817191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-579da620-3814-4f94-a3c5-83b0d70d85e5" returned: 0 in 0.310s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:56:46 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-dee0596c-27e7-44c7-883d-a7a9f779f6eb tempest-ServersNegativeTestJSON-1343817191 None] Lock "cinder-quobyte-579da620-3814-4f94-a3c5-83b0d70d85e5" released by "delete_volume" :: held 0.747s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 15:56:47 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-dee0596c-27e7-44c7-883d-a7a9f779f6eb tempest-ServersNegativeTestJSON-1343817191 None] Created reservations ['c52dfeac-f44c-43a0-924f-d3ce68fa012e', '36143021-9120-4dce-8575-a84a70841814', '1444c302-ec33-4def-a214-91737b270223', 'd4183aaf-4440-4c44-bb26-5fbb06fd9317'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 15:56:47 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-dee0596c-27e7-44c7-883d-a7a9f779f6eb tempest-ServersNegativeTestJSON-1343817191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:56:47 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-dee0596c-27e7-44c7-883d-a7a9f779f6eb tempest-ServersNegativeTestJSON-1343817191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:56:47 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-dee0596c-27e7-44c7-883d-a7a9f779f6eb tempest-ServersNegativeTestJSON-1343817191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 15:56:47 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-dee0596c-27e7-44c7-883d-a7a9f779f6eb tempest-ServersNegativeTestJSON-1343817191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 15:56:47 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-dee0596c-27e7-44c7-883d-a7a9f779f6eb tempest-ServersNegativeTestJSON-1343817191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:56:47 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-dee0596c-27e7-44c7-883d-a7a9f779f6eb tempest-ServersNegativeTestJSON-1343817191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:56:47 devstack sudo[92111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 15:56:47 devstack sudo[92111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:56:47 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-81073d55-6797-418e-9443-3bec00e7a572 tempest-ServersNegativeTestJSON-1343817191 None] Acquiring lock "cinder-3a0f4bec-73b3-4b25-bbad-d6a6b8085dbf-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 15:56:47 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-81073d55-6797-418e-9443-3bec00e7a572 tempest-ServersNegativeTestJSON-1343817191 None] Lock "cinder-3a0f4bec-73b3-4b25-bbad-d6a6b8085dbf-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 15:56:47 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-81073d55-6797-418e-9443-3bec00e7a572 tempest-ServersNegativeTestJSON-1343817191 None] Acquiring lock "cinder-quobyte-3a0f4bec-73b3-4b25-bbad-d6a6b8085dbf" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 15:56:47 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-81073d55-6797-418e-9443-3bec00e7a572 tempest-ServersNegativeTestJSON-1343817191 None] Lock "cinder-quobyte-3a0f4bec-73b3-4b25-bbad-d6a6b8085dbf" acquired by "delete_volume" :: waited 0.020s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 15:56:47 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e3ab042-1cbc-4c7b-9ba5-94f4b358d94f]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 15:56:47 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-81073d55-6797-418e-9443-3bec00e7a572 tempest-ServersNegativeTestJSON-1343817191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3a0f4bec-73b3-4b25-bbad-d6a6b8085dbf {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:56:47 devstack sudo[92111]: pam_unix(sudo:session): session closed for user root Aug 10 15:56:47 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-dee0596c-27e7-44c7-883d-a7a9f779f6eb tempest-ServersNegativeTestJSON-1343817191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.378s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:56:47 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-dee0596c-27e7-44c7-883d-a7a9f779f6eb tempest-ServersNegativeTestJSON-1343817191 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 15:56:47 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-dee0596c-27e7-44c7-883d-a7a9f779f6eb tempest-ServersNegativeTestJSON-1343817191 None] Deleted volume successfully. Aug 10 15:56:47 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-dee0596c-27e7-44c7-883d-a7a9f779f6eb tempest-ServersNegativeTestJSON-1343817191 None] Lock "cinder-579da620-3814-4f94-a3c5-83b0d70d85e5-delete_volume" released by "delete_volume" :: held 1.427s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 15:56:47 devstack sudo[92114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3a0f4bec-73b3-4b25-bbad-d6a6b8085dbf Aug 10 15:56:47 devstack sudo[92114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:56:47 devstack sudo[92114]: pam_unix(sudo:session): session closed for user root Aug 10 15:56:47 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-81073d55-6797-418e-9443-3bec00e7a572 tempest-ServersNegativeTestJSON-1343817191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3a0f4bec-73b3-4b25-bbad-d6a6b8085dbf" returned: 0 in 0.460s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:56:47 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-81073d55-6797-418e-9443-3bec00e7a572 tempest-ServersNegativeTestJSON-1343817191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3a0f4bec-73b3-4b25-bbad-d6a6b8085dbf {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:56:48 devstack sudo[92121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3a0f4bec-73b3-4b25-bbad-d6a6b8085dbf Aug 10 15:56:48 devstack sudo[92121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:56:48 devstack sudo[92121]: pam_unix(sudo:session): session closed for user root Aug 10 15:56:48 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-81073d55-6797-418e-9443-3bec00e7a572 tempest-ServersNegativeTestJSON-1343817191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3a0f4bec-73b3-4b25-bbad-d6a6b8085dbf" returned: 0 in 0.274s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:56:48 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-81073d55-6797-418e-9443-3bec00e7a572 tempest-ServersNegativeTestJSON-1343817191 None] Lock "cinder-quobyte-3a0f4bec-73b3-4b25-bbad-d6a6b8085dbf" released by "delete_volume" :: held 0.787s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 15:56:48 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-81073d55-6797-418e-9443-3bec00e7a572 tempest-ServersNegativeTestJSON-1343817191 None] Created reservations ['f59e396d-2f39-442c-a52d-8275306ec558', 'b637ec6f-bf55-45ab-94b6-e63a8cd93eba', 'a5679114-6479-4494-86ea-b49d30d12f79', 'a0efa0f2-9bff-47a3-98a4-a82c7b2b0c4a'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 15:56:48 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-81073d55-6797-418e-9443-3bec00e7a572 tempest-ServersNegativeTestJSON-1343817191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:56:48 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-81073d55-6797-418e-9443-3bec00e7a572 tempest-ServersNegativeTestJSON-1343817191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:56:48 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-81073d55-6797-418e-9443-3bec00e7a572 tempest-ServersNegativeTestJSON-1343817191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 15:56:48 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-81073d55-6797-418e-9443-3bec00e7a572 tempest-ServersNegativeTestJSON-1343817191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 15:56:48 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-81073d55-6797-418e-9443-3bec00e7a572 tempest-ServersNegativeTestJSON-1343817191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:56:48 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-81073d55-6797-418e-9443-3bec00e7a572 tempest-ServersNegativeTestJSON-1343817191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:56:48 devstack sudo[92124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 15:56:48 devstack sudo[92124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:56:48 devstack sudo[92124]: pam_unix(sudo:session): session closed for user root Aug 10 15:56:48 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-81073d55-6797-418e-9443-3bec00e7a572 tempest-ServersNegativeTestJSON-1343817191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.279s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:56:48 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-81073d55-6797-418e-9443-3bec00e7a572 tempest-ServersNegativeTestJSON-1343817191 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 15:56:48 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-81073d55-6797-418e-9443-3bec00e7a572 tempest-ServersNegativeTestJSON-1343817191 None] Deleted volume successfully. Aug 10 15:56:48 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-81073d55-6797-418e-9443-3bec00e7a572 tempest-ServersNegativeTestJSON-1343817191 None] Lock "cinder-3a0f4bec-73b3-4b25-bbad-d6a6b8085dbf-delete_volume" released by "delete_volume" :: held 1.313s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 15:56:54 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-af8b70c7-d24d-454b-9630-d3abe6c1b625 tempest-GroupSnapshotsTest-1493708790 None] Group tempest-GroupSnapshotsTest-Group-753312856: creating Aug 10 15:56:54 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-af8b70c7-d24d-454b-9630-d3abe6c1b625 tempest-GroupSnapshotsTest-1493708790 None] Group tempest-GroupSnapshotsTest-Group-753312856: created successfully Aug 10 15:56:54 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-af8b70c7-d24d-454b-9630-d3abe6c1b625 tempest-GroupSnapshotsTest-1493708790 None] Create group completed successfully. Aug 10 15:56:55 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d941fc9-bd98-4144-a6bd-38f4793797a8 tempest-GroupSnapshotsTest-1493708790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 15:56:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2d941fc9-bd98-4144-a6bd-38f4793797a8 tempest-GroupSnapshotsTest-1493708790 None] Flow 'volume_create_manager' (3d61764e-2aad-465a-ae25-2927c83d26bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 15:56:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2d941fc9-bd98-4144-a6bd-38f4793797a8 tempest-GroupSnapshotsTest-1493708790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8ef950c-43ac-42e5-be8f-bb9b0bceb2b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:56:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2d941fc9-bd98-4144-a6bd-38f4793797a8 tempest-GroupSnapshotsTest-1493708790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8ef950c-43ac-42e5-be8f-bb9b0bceb2b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T13:56:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2010026852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0f999f6f-d708-4c7d-bea9-32e1475c7565,host='devstack@QuobyteHD#QuobyteHD',id=62b35645-4d58-4456-a4ec-1f9caf0518d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cd019c2b5d947cca3c05701822bbdae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T13:56:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T13:56:56Z,use_quota=True,user_id='ecaa555a49c544d5b0a89dbd4a095f0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c4b73a61-f216-49ff-9261-fc3c3cff1eb4),volume_type_id=c4b73a61-f216-49ff-9261-fc3c3cff1eb4)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:56:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2d941fc9-bd98-4144-a6bd-38f4793797a8 tempest-GroupSnapshotsTest-1493708790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7dd912a-7125-4326-8199-c27794c46b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:56:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2d941fc9-bd98-4144-a6bd-38f4793797a8 tempest-GroupSnapshotsTest-1493708790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7dd912a-7125-4326-8199-c27794c46b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:56:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2d941fc9-bd98-4144-a6bd-38f4793797a8 tempest-GroupSnapshotsTest-1493708790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd28a1f9-53e5-4629-a7dc-44c7629a83c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:56:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2d941fc9-bd98-4144-a6bd-38f4793797a8 tempest-GroupSnapshotsTest-1493708790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd28a1f9-53e5-4629-a7dc-44c7629a83c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62b35645-4d58-4456-a4ec-1f9caf0518d6', 'volume_name': 'volume-62b35645-4d58-4456-a4ec-1f9caf0518d6', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:56:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2d941fc9-bd98-4144-a6bd-38f4793797a8 tempest-GroupSnapshotsTest-1493708790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (384fb4b6-4a2f-4b0c-859f-15e0ab797ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:56:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2d941fc9-bd98-4144-a6bd-38f4793797a8 tempest-GroupSnapshotsTest-1493708790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (384fb4b6-4a2f-4b0c-859f-15e0ab797ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:56:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2d941fc9-bd98-4144-a6bd-38f4793797a8 tempest-GroupSnapshotsTest-1493708790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b70562c-628e-4f97-97c2-c64ba962cfcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:56:55 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-2d941fc9-bd98-4144-a6bd-38f4793797a8 tempest-GroupSnapshotsTest-1493708790 None] Volume 62b35645-4d58-4456-a4ec-1f9caf0518d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62b35645-4d58-4456-a4ec-1f9caf0518d6', 'volume_size': 1} Aug 10 15:56:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-2d941fc9-bd98-4144-a6bd-38f4793797a8 tempest-GroupSnapshotsTest-1493708790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:56:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-2d941fc9-bd98-4144-a6bd-38f4793797a8 tempest-GroupSnapshotsTest-1493708790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:56:55 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-2d941fc9-bd98-4144-a6bd-38f4793797a8 tempest-GroupSnapshotsTest-1493708790 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0f999f6f-d708-4c7d-bea9-32e1475c7565,created_at=2026-08-10T13:56:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2010026852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0f999f6f-d708-4c7d-bea9-32e1475c7565,host='devstack@QuobyteHD#QuobyteHD',id=62b35645-4d58-4456-a4ec-1f9caf0518d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cd019c2b5d947cca3c05701822bbdae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T13:56:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T13:56:56Z,use_quota=True,user_id='ecaa555a49c544d5b0a89dbd4a095f0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c4b73a61-f216-49ff-9261-fc3c3cff1eb4),volume_type_id=c4b73a61-f216-49ff-9261-fc3c3cff1eb4)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 15:56:55 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-2d941fc9-bd98-4144-a6bd-38f4793797a8 tempest-GroupSnapshotsTest-1493708790 None] Creating volume 62b35645-4d58-4456-a4ec-1f9caf0518d6 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 15:56:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-2d941fc9-bd98-4144-a6bd-38f4793797a8 tempest-GroupSnapshotsTest-1493708790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:56:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-2d941fc9-bd98-4144-a6bd-38f4793797a8 tempest-GroupSnapshotsTest-1493708790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:56:55 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-2d941fc9-bd98-4144-a6bd-38f4793797a8 tempest-GroupSnapshotsTest-1493708790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 15:56:55 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-2d941fc9-bd98-4144-a6bd-38f4793797a8 tempest-GroupSnapshotsTest-1493708790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 15:56:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-2d941fc9-bd98-4144-a6bd-38f4793797a8 tempest-GroupSnapshotsTest-1493708790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:56:55 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-2d941fc9-bd98-4144-a6bd-38f4793797a8 tempest-GroupSnapshotsTest-1493708790 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 15:56:55 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-2d941fc9-bd98-4144-a6bd-38f4793797a8 tempest-GroupSnapshotsTest-1493708790 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 15:56:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-2d941fc9-bd98-4144-a6bd-38f4793797a8 tempest-GroupSnapshotsTest-1493708790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-62b35645-4d58-4456-a4ec-1f9caf0518d6 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:56:55 devstack sudo[92192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-62b35645-4d58-4456-a4ec-1f9caf0518d6 1073741824 Aug 10 15:56:55 devstack sudo[92192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:56:56 devstack sudo[92192]: pam_unix(sudo:session): session closed for user root Aug 10 15:56:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-2d941fc9-bd98-4144-a6bd-38f4793797a8 tempest-GroupSnapshotsTest-1493708790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-62b35645-4d58-4456-a4ec-1f9caf0518d6 1073741824" returned: 0 in 0.537s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:56:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-2d941fc9-bd98-4144-a6bd-38f4793797a8 tempest-GroupSnapshotsTest-1493708790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-62b35645-4d58-4456-a4ec-1f9caf0518d6 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:56:56 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-b9bdabaa-7477-4cc8-a22f-ba5be4c3368b tempest-AttachVolumeShelveTestJSON-1860253489 None] Acquiring lock "cinder-c8ef19d0-009a-4533-99d8-8ab783c8fb2b-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 15:56:56 devstack sudo[92199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-62b35645-4d58-4456-a4ec-1f9caf0518d6 Aug 10 15:56:56 devstack sudo[92199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:56:56 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-b9bdabaa-7477-4cc8-a22f-ba5be4c3368b tempest-AttachVolumeShelveTestJSON-1860253489 None] Lock "cinder-c8ef19d0-009a-4533-99d8-8ab783c8fb2b-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 15:56:56 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-b9bdabaa-7477-4cc8-a22f-ba5be4c3368b tempest-AttachVolumeShelveTestJSON-1860253489 None] Acquiring lock "cinder-quobyte-c8ef19d0-009a-4533-99d8-8ab783c8fb2b" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 15:56:56 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-b9bdabaa-7477-4cc8-a22f-ba5be4c3368b tempest-AttachVolumeShelveTestJSON-1860253489 None] Lock "cinder-quobyte-c8ef19d0-009a-4533-99d8-8ab783c8fb2b" acquired by "delete_volume" :: waited 0.025s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 15:56:56 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[8abc10ca-5acd-488e-b4bc-62b556929552]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 15:56:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b9bdabaa-7477-4cc8-a22f-ba5be4c3368b tempest-AttachVolumeShelveTestJSON-1860253489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c8ef19d0-009a-4533-99d8-8ab783c8fb2b {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:56:56 devstack sudo[92199]: pam_unix(sudo:session): session closed for user root Aug 10 15:56:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-2d941fc9-bd98-4144-a6bd-38f4793797a8 tempest-GroupSnapshotsTest-1493708790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-62b35645-4d58-4456-a4ec-1f9caf0518d6" returned: 0 in 0.393s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:56:56 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-2d941fc9-bd98-4144-a6bd-38f4793797a8 tempest-GroupSnapshotsTest-1493708790 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 15:56:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-2d941fc9-bd98-4144-a6bd-38f4793797a8 tempest-GroupSnapshotsTest-1493708790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:56:56 devstack sudo[92201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c8ef19d0-009a-4533-99d8-8ab783c8fb2b Aug 10 15:56:56 devstack sudo[92201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:56:56 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2d941fc9-bd98-4144-a6bd-38f4793797a8 tempest-GroupSnapshotsTest-1493708790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b70562c-628e-4f97-97c2-c64ba962cfcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62b35645-4d58-4456-a4ec-1f9caf0518d6', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:56:56 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2d941fc9-bd98-4144-a6bd-38f4793797a8 tempest-GroupSnapshotsTest-1493708790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd1c5630-6d83-433a-a0d7-04d3d3f14775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:56:56 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-2d941fc9-bd98-4144-a6bd-38f4793797a8 tempest-GroupSnapshotsTest-1493708790 None] Volume volume-62b35645-4d58-4456-a4ec-1f9caf0518d6 (62b35645-4d58-4456-a4ec-1f9caf0518d6): created successfully Aug 10 15:56:56 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2d941fc9-bd98-4144-a6bd-38f4793797a8 tempest-GroupSnapshotsTest-1493708790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd1c5630-6d83-433a-a0d7-04d3d3f14775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:56:56 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2d941fc9-bd98-4144-a6bd-38f4793797a8 tempest-GroupSnapshotsTest-1493708790 None] Flow 'volume_create_manager' (3d61764e-2aad-465a-ae25-2927c83d26bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 15:56:57 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-2d941fc9-bd98-4144-a6bd-38f4793797a8 tempest-GroupSnapshotsTest-1493708790 None] Created volume successfully. Aug 10 15:56:57 devstack sudo[92201]: pam_unix(sudo:session): session closed for user root Aug 10 15:56:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b9bdabaa-7477-4cc8-a22f-ba5be4c3368b tempest-AttachVolumeShelveTestJSON-1860253489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c8ef19d0-009a-4533-99d8-8ab783c8fb2b" returned: 0 in 0.516s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:56:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b9bdabaa-7477-4cc8-a22f-ba5be4c3368b tempest-AttachVolumeShelveTestJSON-1860253489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c8ef19d0-009a-4533-99d8-8ab783c8fb2b {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:56:57 devstack sudo[92209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c8ef19d0-009a-4533-99d8-8ab783c8fb2b Aug 10 15:56:57 devstack sudo[92209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:56:57 devstack sudo[92209]: pam_unix(sudo:session): session closed for user root Aug 10 15:56:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b9bdabaa-7477-4cc8-a22f-ba5be4c3368b tempest-AttachVolumeShelveTestJSON-1860253489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c8ef19d0-009a-4533-99d8-8ab783c8fb2b" returned: 0 in 0.336s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:56:57 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-b9bdabaa-7477-4cc8-a22f-ba5be4c3368b tempest-AttachVolumeShelveTestJSON-1860253489 None] Lock "cinder-quobyte-c8ef19d0-009a-4533-99d8-8ab783c8fb2b" released by "delete_volume" :: held 0.924s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 15:56:57 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-b9bdabaa-7477-4cc8-a22f-ba5be4c3368b tempest-AttachVolumeShelveTestJSON-1860253489 None] Created reservations ['631639f7-6f41-4e15-8a15-56853527a1dd', 'bfa33c42-9e70-49e7-9168-f4cbdcd33b5e', 'a9fdfadc-6aa4-49fd-937a-12da19afdb34', 'a6c58142-8436-4606-b006-3bce35ca9467'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 15:56:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-b9bdabaa-7477-4cc8-a22f-ba5be4c3368b tempest-AttachVolumeShelveTestJSON-1860253489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:56:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-b9bdabaa-7477-4cc8-a22f-ba5be4c3368b tempest-AttachVolumeShelveTestJSON-1860253489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:56:57 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-b9bdabaa-7477-4cc8-a22f-ba5be4c3368b tempest-AttachVolumeShelveTestJSON-1860253489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 15:56:57 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-b9bdabaa-7477-4cc8-a22f-ba5be4c3368b tempest-AttachVolumeShelveTestJSON-1860253489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 15:56:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-b9bdabaa-7477-4cc8-a22f-ba5be4c3368b tempest-AttachVolumeShelveTestJSON-1860253489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:56:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b9bdabaa-7477-4cc8-a22f-ba5be4c3368b tempest-AttachVolumeShelveTestJSON-1860253489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:56:57 devstack sudo[92212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 15:56:57 devstack sudo[92212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:56:58 devstack sudo[92212]: pam_unix(sudo:session): session closed for user root Aug 10 15:56:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b9bdabaa-7477-4cc8-a22f-ba5be4c3368b tempest-AttachVolumeShelveTestJSON-1860253489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.483s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:56:58 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-b9bdabaa-7477-4cc8-a22f-ba5be4c3368b tempest-AttachVolumeShelveTestJSON-1860253489 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 15:56:58 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-b9bdabaa-7477-4cc8-a22f-ba5be4c3368b tempest-AttachVolumeShelveTestJSON-1860253489 None] Deleted volume successfully. Aug 10 15:56:58 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-b9bdabaa-7477-4cc8-a22f-ba5be4c3368b tempest-AttachVolumeShelveTestJSON-1860253489 None] Lock "cinder-c8ef19d0-009a-4533-99d8-8ab783c8fb2b-delete_volume" released by "delete_volume" :: held 1.832s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 15:56:58 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-e35fc2d6-5762-4363-836d-a4b24bfb02e3 tempest-GroupSnapshotsTest-1493708790 None] GroupSnapshot cbbdb7bb-f9de-4562-81b2-5dc411b148d8: creating. Aug 10 15:56:58 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-e35fc2d6-5762-4363-836d-a4b24bfb02e3 tempest-GroupSnapshotsTest-1493708790 None] Group snapshot cbbdb7bb-f9de-4562-81b2-5dc411b148d8: creating. {{(pid=88641) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 10 15:56:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-e35fc2d6-5762-4363-836d-a4b24bfb02e3 tempest-GroupSnapshotsTest-1493708790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:56:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-e35fc2d6-5762-4363-836d-a4b24bfb02e3 tempest-GroupSnapshotsTest-1493708790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:56:58 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-e35fc2d6-5762-4363-836d-a4b24bfb02e3 tempest-GroupSnapshotsTest-1493708790 None] Creating offline snapshot 5e911dec-659a-477f-883f-1ab9dad5095c of volume 62b35645-4d58-4456-a4ec-1f9caf0518d6 {{(pid=88641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 15:56:58 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[01db1941-8a66-4d7c-afce-cfbd34091c74]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 15:56:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e35fc2d6-5762-4363-836d-a4b24bfb02e3 tempest-GroupSnapshotsTest-1493708790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-62b35645-4d58-4456-a4ec-1f9caf0518d6 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:56:59 devstack sudo[92215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-62b35645-4d58-4456-a4ec-1f9caf0518d6 Aug 10 15:56:59 devstack sudo[92215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:56:59 devstack sudo[92215]: pam_unix(sudo:session): session closed for user root Aug 10 15:56:59 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e35fc2d6-5762-4363-836d-a4b24bfb02e3 tempest-GroupSnapshotsTest-1493708790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-62b35645-4d58-4456-a4ec-1f9caf0518d6" returned: 0 in 0.699s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:56:59 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e35fc2d6-5762-4363-836d-a4b24bfb02e3 tempest-GroupSnapshotsTest-1493708790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-62b35645-4d58-4456-a4ec-1f9caf0518d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-62b35645-4d58-4456-a4ec-1f9caf0518d6.5e911dec-659a-477f-883f-1ab9dad5095c 1G {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:56:59 devstack sudo[92221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-62b35645-4d58-4456-a4ec-1f9caf0518d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-62b35645-4d58-4456-a4ec-1f9caf0518d6.5e911dec-659a-477f-883f-1ab9dad5095c 1G Aug 10 15:56:59 devstack sudo[92221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:00 devstack sudo[92221]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e35fc2d6-5762-4363-836d-a4b24bfb02e3 tempest-GroupSnapshotsTest-1493708790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-62b35645-4d58-4456-a4ec-1f9caf0518d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-62b35645-4d58-4456-a4ec-1f9caf0518d6.5e911dec-659a-477f-883f-1ab9dad5095c 1G" returned: 0 in 0.696s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e35fc2d6-5762-4363-836d-a4b24bfb02e3 tempest-GroupSnapshotsTest-1493708790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62b35645-4d58-4456-a4ec-1f9caf0518d6 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-62b35645-4d58-4456-a4ec-1f9caf0518d6.5e911dec-659a-477f-883f-1ab9dad5095c {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:00 devstack sudo[92228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62b35645-4d58-4456-a4ec-1f9caf0518d6 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-62b35645-4d58-4456-a4ec-1f9caf0518d6.5e911dec-659a-477f-883f-1ab9dad5095c Aug 10 15:57:00 devstack sudo[92228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:00 devstack sudo[92228]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e35fc2d6-5762-4363-836d-a4b24bfb02e3 tempest-GroupSnapshotsTest-1493708790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62b35645-4d58-4456-a4ec-1f9caf0518d6 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-62b35645-4d58-4456-a4ec-1f9caf0518d6.5e911dec-659a-477f-883f-1ab9dad5095c" returned: 0 in 0.390s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:00 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-e35fc2d6-5762-4363-836d-a4b24bfb02e3 tempest-GroupSnapshotsTest-1493708790 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-62b35645-4d58-4456-a4ec-1f9caf0518d6.5e911dec-659a-477f-883f-1ab9dad5095c is being set with open permissions: ugo+rw: NotImplementedError Aug 10 15:57:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e35fc2d6-5762-4363-836d-a4b24bfb02e3 tempest-GroupSnapshotsTest-1493708790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-62b35645-4d58-4456-a4ec-1f9caf0518d6.5e911dec-659a-477f-883f-1ab9dad5095c {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:00 devstack sudo[92233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-62b35645-4d58-4456-a4ec-1f9caf0518d6.5e911dec-659a-477f-883f-1ab9dad5095c Aug 10 15:57:00 devstack sudo[92233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:00 devstack sudo[92233]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e35fc2d6-5762-4363-836d-a4b24bfb02e3 tempest-GroupSnapshotsTest-1493708790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-62b35645-4d58-4456-a4ec-1f9caf0518d6.5e911dec-659a-477f-883f-1ab9dad5095c" returned: 0 in 0.280s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e35fc2d6-5762-4363-836d-a4b24bfb02e3 tempest-GroupSnapshotsTest-1493708790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-62b35645-4d58-4456-a4ec-1f9caf0518d6.info {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:01 devstack sudo[92236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-62b35645-4d58-4456-a4ec-1f9caf0518d6.info Aug 10 15:57:01 devstack sudo[92236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:01 devstack sudo[92236]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:01 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e35fc2d6-5762-4363-836d-a4b24bfb02e3 tempest-GroupSnapshotsTest-1493708790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-62b35645-4d58-4456-a4ec-1f9caf0518d6.info" returned: 0 in 0.272s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:01 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-e35fc2d6-5762-4363-836d-a4b24bfb02e3 tempest-GroupSnapshotsTest-1493708790 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-62b35645-4d58-4456-a4ec-1f9caf0518d6.info is being set with open permissions: ugo+rw: NotImplementedError Aug 10 15:57:01 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e35fc2d6-5762-4363-836d-a4b24bfb02e3 tempest-GroupSnapshotsTest-1493708790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-62b35645-4d58-4456-a4ec-1f9caf0518d6.info {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:01 devstack sudo[92239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-62b35645-4d58-4456-a4ec-1f9caf0518d6.info Aug 10 15:57:01 devstack sudo[92239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:01 devstack sudo[92239]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:01 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e35fc2d6-5762-4363-836d-a4b24bfb02e3 tempest-GroupSnapshotsTest-1493708790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-62b35645-4d58-4456-a4ec-1f9caf0518d6.info" returned: 0 in 0.260s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:01 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-e35fc2d6-5762-4363-836d-a4b24bfb02e3 tempest-GroupSnapshotsTest-1493708790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.723s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:57:01 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-e35fc2d6-5762-4363-836d-a4b24bfb02e3 tempest-GroupSnapshotsTest-1493708790 None] group_snapshot cbbdb7bb-f9de-4562-81b2-5dc411b148d8: created successfully Aug 10 15:57:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-7c7e626d-710f-4f36-80e4-847c5626dc2a tempest-GroupSnapshotsTest-1493708790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:57:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-7c7e626d-710f-4f36-80e4-847c5626dc2a tempest-GroupSnapshotsTest-1493708790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:57:02 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-7c7e626d-710f-4f36-80e4-847c5626dc2a tempest-GroupSnapshotsTest-1493708790 None] Acquiring lock "cinder-quobyte-5e911dec-659a-477f-883f-1ab9dad5095c-9c20650a-5205-47c2-a8b7-cb530546b1c1" by "_create_volume_from_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 15:57:02 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-7c7e626d-710f-4f36-80e4-847c5626dc2a tempest-GroupSnapshotsTest-1493708790 None] Lock "cinder-quobyte-5e911dec-659a-477f-883f-1ab9dad5095c-9c20650a-5205-47c2-a8b7-cb530546b1c1" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 15:57:02 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-7c7e626d-710f-4f36-80e4-847c5626dc2a tempest-GroupSnapshotsTest-1493708790 None] Creating volume 9c20650a-5205-47c2-a8b7-cb530546b1c1 from snapshot 5e911dec-659a-477f-883f-1ab9dad5095c {{(pid=88641) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 10 15:57:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-7c7e626d-710f-4f36-80e4-847c5626dc2a tempest-GroupSnapshotsTest-1493708790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:57:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-7c7e626d-710f-4f36-80e4-847c5626dc2a tempest-GroupSnapshotsTest-1493708790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:57:02 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-7c7e626d-710f-4f36-80e4-847c5626dc2a tempest-GroupSnapshotsTest-1493708790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 15:57:02 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-7c7e626d-710f-4f36-80e4-847c5626dc2a tempest-GroupSnapshotsTest-1493708790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 15:57:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-7c7e626d-710f-4f36-80e4-847c5626dc2a tempest-GroupSnapshotsTest-1493708790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:57:02 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-7c7e626d-710f-4f36-80e4-847c5626dc2a tempest-GroupSnapshotsTest-1493708790 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 15:57:02 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-7c7e626d-710f-4f36-80e4-847c5626dc2a tempest-GroupSnapshotsTest-1493708790 None] Acquiring lock "cinder-quobyte-9c20650a-5205-47c2-a8b7-cb530546b1c1" by "_copy_volume_from_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 15:57:02 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-7c7e626d-710f-4f36-80e4-847c5626dc2a tempest-GroupSnapshotsTest-1493708790 None] Lock "cinder-quobyte-9c20650a-5205-47c2-a8b7-cb530546b1c1" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 15:57:02 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-7c7e626d-710f-4f36-80e4-847c5626dc2a tempest-GroupSnapshotsTest-1493708790 None] snapshot: 5e911dec-659a-477f-883f-1ab9dad5095c, volume: 9c20650a-5205-47c2-a8b7-cb530546b1c1, {{(pid=88641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 10 15:57:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-7c7e626d-710f-4f36-80e4-847c5626dc2a tempest-GroupSnapshotsTest-1493708790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:57:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-7c7e626d-710f-4f36-80e4-847c5626dc2a tempest-GroupSnapshotsTest-1493708790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:57:03 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-7c7e626d-710f-4f36-80e4-847c5626dc2a tempest-GroupSnapshotsTest-1493708790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 15:57:03 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-7c7e626d-710f-4f36-80e4-847c5626dc2a tempest-GroupSnapshotsTest-1493708790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 15:57:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-7c7e626d-710f-4f36-80e4-847c5626dc2a tempest-GroupSnapshotsTest-1493708790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:57:03 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[f17072ec-f8f2-452b-8f2e-890e04424d42]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 15:57:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7c7e626d-710f-4f36-80e4-847c5626dc2a tempest-GroupSnapshotsTest-1493708790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-62b35645-4d58-4456-a4ec-1f9caf0518d6.5e911dec-659a-477f-883f-1ab9dad5095c {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:03 devstack sudo[92245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-62b35645-4d58-4456-a4ec-1f9caf0518d6.5e911dec-659a-477f-883f-1ab9dad5095c Aug 10 15:57:03 devstack sudo[92245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:03 devstack sudo[92245]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7c7e626d-710f-4f36-80e4-847c5626dc2a tempest-GroupSnapshotsTest-1493708790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-62b35645-4d58-4456-a4ec-1f9caf0518d6.5e911dec-659a-477f-883f-1ab9dad5095c" returned: 0 in 0.399s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:03 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-7c7e626d-710f-4f36-80e4-847c5626dc2a tempest-GroupSnapshotsTest-1493708790 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62b35645-4d58-4456-a4ec-1f9caf0518d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 15:57:03 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[b97c8f09-fde5-479d-959f-13203f73312a]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 15:57:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7c7e626d-710f-4f36-80e4-847c5626dc2a tempest-GroupSnapshotsTest-1493708790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-62b35645-4d58-4456-a4ec-1f9caf0518d6 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:03 devstack sudo[92250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-62b35645-4d58-4456-a4ec-1f9caf0518d6 Aug 10 15:57:03 devstack sudo[92250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:03 devstack sudo[92250]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7c7e626d-710f-4f36-80e4-847c5626dc2a tempest-GroupSnapshotsTest-1493708790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-62b35645-4d58-4456-a4ec-1f9caf0518d6" returned: 0 in 0.364s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:03 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-7c7e626d-710f-4f36-80e4-847c5626dc2a tempest-GroupSnapshotsTest-1493708790 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-62b35645-4d58-4456-a4ec-1f9caf0518d6 {{(pid=88641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 10 15:57:03 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-7c7e626d-710f-4f36-80e4-847c5626dc2a tempest-GroupSnapshotsTest-1493708790 None] Creating direct copy from snapshot {{(pid=88641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 10 15:57:03 devstack cinder-volume[88641]: DEBUG cinder.utils [None req-7c7e626d-710f-4f36-80e4-847c5626dc2a tempest-GroupSnapshotsTest-1493708790 None] Path /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9c20650a-5205-47c2-a8b7-cb530546b1c1 not found in is_blk_device check {{(pid=88641) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 10 15:57:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7c7e626d-710f-4f36-80e4-847c5626dc2a tempest-GroupSnapshotsTest-1493708790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-62b35645-4d58-4456-a4ec-1f9caf0518d6 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9c20650a-5205-47c2-a8b7-cb530546b1c1 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:03 devstack sudo[92255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-62b35645-4d58-4456-a4ec-1f9caf0518d6 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9c20650a-5205-47c2-a8b7-cb530546b1c1 Aug 10 15:57:03 devstack sudo[92255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:10 devstack sudo[92255]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:10 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7c7e626d-710f-4f36-80e4-847c5626dc2a tempest-GroupSnapshotsTest-1493708790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-62b35645-4d58-4456-a4ec-1f9caf0518d6 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9c20650a-5205-47c2-a8b7-cb530546b1c1" returned: 0 in 6.605s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:10 devstack cinder-volume[88641]: DEBUG cinder.image.image_utils [None req-7c7e626d-710f-4f36-80e4-847c5626dc2a tempest-GroupSnapshotsTest-1493708790 None] Image conversion details: src /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-62b35645-4d58-4456-a4ec-1f9caf0518d6, size 1024.00 MB, duration 6.61 sec, destination /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9c20650a-5205-47c2-a8b7-cb530546b1c1 {{(pid=88641) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 10 15:57:10 devstack cinder-volume[88641]: INFO cinder.image.image_utils [None req-7c7e626d-710f-4f36-80e4-847c5626dc2a tempest-GroupSnapshotsTest-1493708790 None] Converted 1024.00 MB image at 154.93 MB/s Aug 10 15:57:10 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-7c7e626d-710f-4f36-80e4-847c5626dc2a tempest-GroupSnapshotsTest-1493708790 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9c20650a-5205-47c2-a8b7-cb530546b1c1 is being set with open permissions: ugo+rw: NotImplementedError Aug 10 15:57:10 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7c7e626d-710f-4f36-80e4-847c5626dc2a tempest-GroupSnapshotsTest-1493708790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9c20650a-5205-47c2-a8b7-cb530546b1c1 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:10 devstack sudo[92339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9c20650a-5205-47c2-a8b7-cb530546b1c1 Aug 10 15:57:10 devstack sudo[92339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:10 devstack sudo[92339]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:10 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7c7e626d-710f-4f36-80e4-847c5626dc2a tempest-GroupSnapshotsTest-1493708790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9c20650a-5205-47c2-a8b7-cb530546b1c1" returned: 0 in 0.450s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:10 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-7c7e626d-710f-4f36-80e4-847c5626dc2a tempest-GroupSnapshotsTest-1493708790 None] Lock "cinder-quobyte-9c20650a-5205-47c2-a8b7-cb530546b1c1" released by "_copy_volume_from_snapshot" :: held 7.935s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 15:57:10 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-7c7e626d-710f-4f36-80e4-847c5626dc2a tempest-GroupSnapshotsTest-1493708790 None] Lock "cinder-quobyte-5e911dec-659a-477f-883f-1ab9dad5095c-9c20650a-5205-47c2-a8b7-cb530546b1c1" released by "_create_volume_from_snapshot" :: held 8.069s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 15:57:10 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-7c7e626d-710f-4f36-80e4-847c5626dc2a tempest-GroupSnapshotsTest-1493708790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.088s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:57:11 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-7c7e626d-710f-4f36-80e4-847c5626dc2a tempest-GroupSnapshotsTest-1493708790 None] Create group from source-snapshot-cbbdb7bb-f9de-4562-81b2-5dc411b148d8 completed successfully. Aug 10 15:57:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-92cab07f-9f45-4dda-a568-bfbc11d7b59b req-bcf85c88-58f0-4c77-a7b3-ab3ace9433a5 tempest-TaggedAttachmentsTest-1292559499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:57:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-92cab07f-9f45-4dda-a568-bfbc11d7b59b req-bcf85c88-58f0-4c77-a7b3-ab3ace9433a5 tempest-TaggedAttachmentsTest-1292559499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:57:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-92cab07f-9f45-4dda-a568-bfbc11d7b59b req-bcf85c88-58f0-4c77-a7b3-ab3ace9433a5 tempest-TaggedAttachmentsTest-1292559499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:57:11 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [req-92cab07f-9f45-4dda-a568-bfbc11d7b59b req-bcf85c88-58f0-4c77-a7b3-ab3ace9433a5 tempest-TaggedAttachmentsTest-1292559499 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc', 'name': 'volume-dcae10d0-3fa5-46e1-b0a9-0d0e2faf3eb8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '286fa917-51cb-4b8c-b488-6c6d5e822142', 'enforce_multipath': True} {{(pid=88641) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 10 15:57:11 devstack cinder-volume[88641]: INFO cinder.volume.manager [req-92cab07f-9f45-4dda-a568-bfbc11d7b59b req-bcf85c88-58f0-4c77-a7b3-ab3ace9433a5 tempest-TaggedAttachmentsTest-1292559499 None] attachment_update completed successfully. Aug 10 15:57:12 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-9b2f6865-063c-4bf4-9a50-e789d8ccdb5f tempest-GroupSnapshotsTest-1493708790 None] Acquiring lock "cinder-quobyte-9c20650a-5205-47c2-a8b7-cb530546b1c1" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 15:57:12 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-9b2f6865-063c-4bf4-9a50-e789d8ccdb5f tempest-GroupSnapshotsTest-1493708790 None] Lock "cinder-quobyte-9c20650a-5205-47c2-a8b7-cb530546b1c1" acquired by "delete_volume" :: waited 0.031s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 15:57:12 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e6bb50-92c3-436e-812c-6259129e98fe]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 15:57:12 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9b2f6865-063c-4bf4-9a50-e789d8ccdb5f tempest-GroupSnapshotsTest-1493708790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9c20650a-5205-47c2-a8b7-cb530546b1c1 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:12 devstack sudo[92745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9c20650a-5205-47c2-a8b7-cb530546b1c1 Aug 10 15:57:12 devstack sudo[92745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:12 devstack sudo[92745]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:12 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9b2f6865-063c-4bf4-9a50-e789d8ccdb5f tempest-GroupSnapshotsTest-1493708790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9c20650a-5205-47c2-a8b7-cb530546b1c1" returned: 0 in 0.555s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:12 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9b2f6865-063c-4bf4-9a50-e789d8ccdb5f tempest-GroupSnapshotsTest-1493708790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9c20650a-5205-47c2-a8b7-cb530546b1c1 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:12 devstack sudo[92750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9c20650a-5205-47c2-a8b7-cb530546b1c1 Aug 10 15:57:12 devstack sudo[92750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:13 devstack sudo[92750]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:13 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9b2f6865-063c-4bf4-9a50-e789d8ccdb5f tempest-GroupSnapshotsTest-1493708790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9c20650a-5205-47c2-a8b7-cb530546b1c1" returned: 0 in 0.329s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:13 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-9b2f6865-063c-4bf4-9a50-e789d8ccdb5f tempest-GroupSnapshotsTest-1493708790 None] Lock "cinder-quobyte-9c20650a-5205-47c2-a8b7-cb530546b1c1" released by "delete_volume" :: held 0.946s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 15:57:13 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-9b2f6865-063c-4bf4-9a50-e789d8ccdb5f tempest-GroupSnapshotsTest-1493708790 None] Created reservations ['7f8037ac-ce97-48bf-b129-746e61e23c34'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 15:57:13 devstack cinder-volume[88641]: WARNING cinder.quota [None req-9b2f6865-063c-4bf4-9a50-e789d8ccdb5f tempest-GroupSnapshotsTest-1493708790 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1389788735 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1389788735, it is now deprecated. Please use the default quota class for default quota. Aug 10 15:57:13 devstack cinder-volume[88641]: WARNING cinder.quota [None req-9b2f6865-063c-4bf4-9a50-e789d8ccdb5f tempest-GroupSnapshotsTest-1493708790 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1389788735 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1389788735, it is now deprecated. Please use the default quota class for default quota. Aug 10 15:57:13 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-9b2f6865-063c-4bf4-9a50-e789d8ccdb5f tempest-GroupSnapshotsTest-1493708790 None] Created reservations ['41ab902c-0f6b-496c-a52a-cbc4a91d87f5', '98531dbb-9e85-4a6e-8271-d2e72a237da4', '5c13f5ec-3fd0-4846-abce-2d98e7bb4474', '680641f8-417b-4b17-a32f-45730632b734'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 15:57:13 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-9b2f6865-063c-4bf4-9a50-e789d8ccdb5f tempest-GroupSnapshotsTest-1493708790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:57:13 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-9b2f6865-063c-4bf4-9a50-e789d8ccdb5f tempest-GroupSnapshotsTest-1493708790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:57:13 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-9b2f6865-063c-4bf4-9a50-e789d8ccdb5f tempest-GroupSnapshotsTest-1493708790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 15:57:13 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-9b2f6865-063c-4bf4-9a50-e789d8ccdb5f tempest-GroupSnapshotsTest-1493708790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 15:57:13 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-9b2f6865-063c-4bf4-9a50-e789d8ccdb5f tempest-GroupSnapshotsTest-1493708790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:57:13 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9b2f6865-063c-4bf4-9a50-e789d8ccdb5f tempest-GroupSnapshotsTest-1493708790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:13 devstack sudo[92758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 15:57:13 devstack sudo[92758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:13 devstack sudo[92758]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:13 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9b2f6865-063c-4bf4-9a50-e789d8ccdb5f tempest-GroupSnapshotsTest-1493708790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.265s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:13 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-9b2f6865-063c-4bf4-9a50-e789d8ccdb5f tempest-GroupSnapshotsTest-1493708790 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 15:57:13 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-9b2f6865-063c-4bf4-9a50-e789d8ccdb5f tempest-GroupSnapshotsTest-1493708790 None] Delete group completed successfully. Aug 10 15:57:14 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [req-0f8ec4ae-91d6-4c8c-a4e0-c8555649890b req-54f91cc8-e089-4d27-8ecc-5da05efcef2a tempest-VolumesSnapshotsTestJSON-1674843237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 15:57:14 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [req-0f8ec4ae-91d6-4c8c-a4e0-c8555649890b req-54f91cc8-e089-4d27-8ecc-5da05efcef2a tempest-VolumesSnapshotsTestJSON-1674843237 None] Flow 'volume_create_manager' (99ca72e7-64ec-4c9d-974c-da737a6efe47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 15:57:14 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [req-0f8ec4ae-91d6-4c8c-a4e0-c8555649890b req-54f91cc8-e089-4d27-8ecc-5da05efcef2a tempest-VolumesSnapshotsTestJSON-1674843237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50dbe03c-ea73-49a3-bb77-79f18cc204d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:57:14 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [req-0f8ec4ae-91d6-4c8c-a4e0-c8555649890b req-54f91cc8-e089-4d27-8ecc-5da05efcef2a tempest-VolumesSnapshotsTestJSON-1674843237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50dbe03c-ea73-49a3-bb77-79f18cc204d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T13:57:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-521687046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05f9d3c4-76cc-4f24-8522-a801fc118716,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2237c538dcb345429977f39b530a7b89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T13:57:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T13:57:15Z,use_quota=True,user_id='4868acd3bffe4ecb8d748e3f47e400e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:57:14 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [req-0f8ec4ae-91d6-4c8c-a4e0-c8555649890b req-54f91cc8-e089-4d27-8ecc-5da05efcef2a tempest-VolumesSnapshotsTestJSON-1674843237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd259340-feec-47d2-a76d-5695dc6e040f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:57:14 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [req-0f8ec4ae-91d6-4c8c-a4e0-c8555649890b req-54f91cc8-e089-4d27-8ecc-5da05efcef2a tempest-VolumesSnapshotsTestJSON-1674843237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd259340-feec-47d2-a76d-5695dc6e040f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:57:14 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [req-0f8ec4ae-91d6-4c8c-a4e0-c8555649890b req-54f91cc8-e089-4d27-8ecc-5da05efcef2a tempest-VolumesSnapshotsTestJSON-1674843237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8d3a173-40ae-4e64-8678-62f0714d08a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:57:14 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [req-0f8ec4ae-91d6-4c8c-a4e0-c8555649890b req-54f91cc8-e089-4d27-8ecc-5da05efcef2a tempest-VolumesSnapshotsTestJSON-1674843237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8d3a173-40ae-4e64-8678-62f0714d08a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05f9d3c4-76cc-4f24-8522-a801fc118716', 'volume_name': 'volume-05f9d3c4-76cc-4f24-8522-a801fc118716', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:57:14 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [req-0f8ec4ae-91d6-4c8c-a4e0-c8555649890b req-54f91cc8-e089-4d27-8ecc-5da05efcef2a tempest-VolumesSnapshotsTestJSON-1674843237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20bb660f-d9fe-4b1c-880b-9d613399876d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:57:14 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [req-0f8ec4ae-91d6-4c8c-a4e0-c8555649890b req-54f91cc8-e089-4d27-8ecc-5da05efcef2a tempest-VolumesSnapshotsTestJSON-1674843237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20bb660f-d9fe-4b1c-880b-9d613399876d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:57:14 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [req-0f8ec4ae-91d6-4c8c-a4e0-c8555649890b req-54f91cc8-e089-4d27-8ecc-5da05efcef2a tempest-VolumesSnapshotsTestJSON-1674843237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20d6b851-ece2-4ca1-9734-68649f61578c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:57:14 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [req-0f8ec4ae-91d6-4c8c-a4e0-c8555649890b req-54f91cc8-e089-4d27-8ecc-5da05efcef2a tempest-VolumesSnapshotsTestJSON-1674843237 None] Volume 05f9d3c4-76cc-4f24-8522-a801fc118716: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05f9d3c4-76cc-4f24-8522-a801fc118716', 'volume_size': 1} Aug 10 15:57:14 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-0f8ec4ae-91d6-4c8c-a4e0-c8555649890b req-54f91cc8-e089-4d27-8ecc-5da05efcef2a tempest-VolumesSnapshotsTestJSON-1674843237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:57:14 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-0f8ec4ae-91d6-4c8c-a4e0-c8555649890b req-54f91cc8-e089-4d27-8ecc-5da05efcef2a tempest-VolumesSnapshotsTestJSON-1674843237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:57:14 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [req-0f8ec4ae-91d6-4c8c-a4e0-c8555649890b req-54f91cc8-e089-4d27-8ecc-5da05efcef2a tempest-VolumesSnapshotsTestJSON-1674843237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T13:57:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-521687046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05f9d3c4-76cc-4f24-8522-a801fc118716,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2237c538dcb345429977f39b530a7b89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T13:57:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T13:57:15Z,use_quota=True,user_id='4868acd3bffe4ecb8d748e3f47e400e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 15:57:14 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [req-0f8ec4ae-91d6-4c8c-a4e0-c8555649890b req-54f91cc8-e089-4d27-8ecc-5da05efcef2a tempest-VolumesSnapshotsTestJSON-1674843237 None] Creating volume 05f9d3c4-76cc-4f24-8522-a801fc118716 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 15:57:14 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-0f8ec4ae-91d6-4c8c-a4e0-c8555649890b req-54f91cc8-e089-4d27-8ecc-5da05efcef2a tempest-VolumesSnapshotsTestJSON-1674843237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:57:14 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-0f8ec4ae-91d6-4c8c-a4e0-c8555649890b req-54f91cc8-e089-4d27-8ecc-5da05efcef2a tempest-VolumesSnapshotsTestJSON-1674843237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:57:14 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [req-0f8ec4ae-91d6-4c8c-a4e0-c8555649890b req-54f91cc8-e089-4d27-8ecc-5da05efcef2a tempest-VolumesSnapshotsTestJSON-1674843237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 15:57:14 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [req-0f8ec4ae-91d6-4c8c-a4e0-c8555649890b req-54f91cc8-e089-4d27-8ecc-5da05efcef2a tempest-VolumesSnapshotsTestJSON-1674843237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 15:57:14 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-0f8ec4ae-91d6-4c8c-a4e0-c8555649890b req-54f91cc8-e089-4d27-8ecc-5da05efcef2a tempest-VolumesSnapshotsTestJSON-1674843237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:57:14 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [req-0f8ec4ae-91d6-4c8c-a4e0-c8555649890b req-54f91cc8-e089-4d27-8ecc-5da05efcef2a tempest-VolumesSnapshotsTestJSON-1674843237 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 15:57:14 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [req-0f8ec4ae-91d6-4c8c-a4e0-c8555649890b req-54f91cc8-e089-4d27-8ecc-5da05efcef2a tempest-VolumesSnapshotsTestJSON-1674843237 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 15:57:14 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [req-0f8ec4ae-91d6-4c8c-a4e0-c8555649890b req-54f91cc8-e089-4d27-8ecc-5da05efcef2a tempest-VolumesSnapshotsTestJSON-1674843237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-05f9d3c4-76cc-4f24-8522-a801fc118716 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:14 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-ec56d8c8-cd38-4074-9d24-9d1da67c5382 tempest-GroupSnapshotsTest-1493708790 None] group_snapshot cbbdb7bb-f9de-4562-81b2-5dc411b148d8: deleting Aug 10 15:57:14 devstack sudo[92766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-05f9d3c4-76cc-4f24-8522-a801fc118716 1073741824 Aug 10 15:57:14 devstack sudo[92766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:14 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-ec56d8c8-cd38-4074-9d24-9d1da67c5382 tempest-GroupSnapshotsTest-1493708790 None] group_snapshot cbbdb7bb-f9de-4562-81b2-5dc411b148d8: deleting {{(pid=88641) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 10 15:57:14 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-ec56d8c8-cd38-4074-9d24-9d1da67c5382 tempest-GroupSnapshotsTest-1493708790 None] Acquiring lock "cinder-quobyte-62b35645-4d58-4456-a4ec-1f9caf0518d6" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 15:57:14 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-ec56d8c8-cd38-4074-9d24-9d1da67c5382 tempest-GroupSnapshotsTest-1493708790 None] Lock "cinder-quobyte-62b35645-4d58-4456-a4ec-1f9caf0518d6" acquired by "delete_snapshot" :: waited 0.034s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 15:57:14 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-ec56d8c8-cd38-4074-9d24-9d1da67c5382 tempest-GroupSnapshotsTest-1493708790 None] Acquiring lock "cinder-quobyte-5e911dec-659a-477f-883f-1ab9dad5095c" by "_delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 15:57:14 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-ec56d8c8-cd38-4074-9d24-9d1da67c5382 tempest-GroupSnapshotsTest-1493708790 None] Lock "cinder-quobyte-5e911dec-659a-477f-883f-1ab9dad5095c" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 15:57:14 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-ec56d8c8-cd38-4074-9d24-9d1da67c5382 tempest-GroupSnapshotsTest-1493708790 None] Deleting offline snapshot 5e911dec-659a-477f-883f-1ab9dad5095c of volume 62b35645-4d58-4456-a4ec-1f9caf0518d6 {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 15:57:14 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-ec56d8c8-cd38-4074-9d24-9d1da67c5382 tempest-GroupSnapshotsTest-1493708790 None] snapshot_file for this snap is: volume-62b35645-4d58-4456-a4ec-1f9caf0518d6.5e911dec-659a-477f-883f-1ab9dad5095c {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 15:57:14 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e3d1b95-5e7f-43c2-a5af-19bb158b9bac]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 15:57:14 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ec56d8c8-cd38-4074-9d24-9d1da67c5382 tempest-GroupSnapshotsTest-1493708790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-62b35645-4d58-4456-a4ec-1f9caf0518d6.5e911dec-659a-477f-883f-1ab9dad5095c {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:15 devstack sudo[92769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-62b35645-4d58-4456-a4ec-1f9caf0518d6.5e911dec-659a-477f-883f-1ab9dad5095c Aug 10 15:57:15 devstack sudo[92769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:15 devstack cinder-volume[88641]: INFO cinder.volume.manager [req-38f96df2-ff3e-4111-bd3e-115139712c59 req-7826b10d-47d8-43c2-8721-594994d16228 tempest-TaggedAttachmentsTest-1292559499 None] Terminate volume connection completed successfully. Aug 10 15:57:15 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [req-38f96df2-ff3e-4111-bd3e-115139712c59 req-7826b10d-47d8-43c2-8721-594994d16228 tempest-TaggedAttachmentsTest-1292559499 None] Deleting attachment 286fa917-51cb-4b8c-b488-6c6d5e822142. {{(pid=88641) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 10 15:57:15 devstack sudo[92769]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:15 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ec56d8c8-cd38-4074-9d24-9d1da67c5382 tempest-GroupSnapshotsTest-1493708790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-62b35645-4d58-4456-a4ec-1f9caf0518d6.5e911dec-659a-477f-883f-1ab9dad5095c" returned: 0 in 0.718s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:15 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-ec56d8c8-cd38-4074-9d24-9d1da67c5382 tempest-GroupSnapshotsTest-1493708790 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62b35645-4d58-4456-a4ec-1f9caf0518d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 15:57:15 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[a56a98f7-9237-4eed-819b-d3bcbb0eac46]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 15:57:15 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ec56d8c8-cd38-4074-9d24-9d1da67c5382 tempest-GroupSnapshotsTest-1493708790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-62b35645-4d58-4456-a4ec-1f9caf0518d6 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:15 devstack sudo[92766]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:15 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [req-0f8ec4ae-91d6-4c8c-a4e0-c8555649890b req-54f91cc8-e089-4d27-8ecc-5da05efcef2a tempest-VolumesSnapshotsTestJSON-1674843237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-05f9d3c4-76cc-4f24-8522-a801fc118716 1073741824" returned: 0 in 0.985s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:15 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [req-0f8ec4ae-91d6-4c8c-a4e0-c8555649890b req-54f91cc8-e089-4d27-8ecc-5da05efcef2a tempest-VolumesSnapshotsTestJSON-1674843237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-05f9d3c4-76cc-4f24-8522-a801fc118716 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:15 devstack sudo[92806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-05f9d3c4-76cc-4f24-8522-a801fc118716 Aug 10 15:57:15 devstack sudo[92806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:16 devstack sudo[92805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-62b35645-4d58-4456-a4ec-1f9caf0518d6 Aug 10 15:57:16 devstack sudo[92805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:16 devstack sudo[92806]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:16 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [req-0f8ec4ae-91d6-4c8c-a4e0-c8555649890b req-54f91cc8-e089-4d27-8ecc-5da05efcef2a tempest-VolumesSnapshotsTestJSON-1674843237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-05f9d3c4-76cc-4f24-8522-a801fc118716" returned: 0 in 0.440s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:16 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [req-0f8ec4ae-91d6-4c8c-a4e0-c8555649890b req-54f91cc8-e089-4d27-8ecc-5da05efcef2a tempest-VolumesSnapshotsTestJSON-1674843237 None] <== create_volume: return (1516ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 15:57:16 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-0f8ec4ae-91d6-4c8c-a4e0-c8555649890b req-54f91cc8-e089-4d27-8ecc-5da05efcef2a tempest-VolumesSnapshotsTestJSON-1674843237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.519s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:57:16 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [req-0f8ec4ae-91d6-4c8c-a4e0-c8555649890b req-54f91cc8-e089-4d27-8ecc-5da05efcef2a tempest-VolumesSnapshotsTestJSON-1674843237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20d6b851-ece2-4ca1-9734-68649f61578c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05f9d3c4-76cc-4f24-8522-a801fc118716', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:57:16 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [req-0f8ec4ae-91d6-4c8c-a4e0-c8555649890b req-54f91cc8-e089-4d27-8ecc-5da05efcef2a tempest-VolumesSnapshotsTestJSON-1674843237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5805f35a-8ce8-4c46-a243-f36a88bc68c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:57:16 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [req-0f8ec4ae-91d6-4c8c-a4e0-c8555649890b req-54f91cc8-e089-4d27-8ecc-5da05efcef2a tempest-VolumesSnapshotsTestJSON-1674843237 None] Volume volume-05f9d3c4-76cc-4f24-8522-a801fc118716 (05f9d3c4-76cc-4f24-8522-a801fc118716): created successfully Aug 10 15:57:16 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [req-0f8ec4ae-91d6-4c8c-a4e0-c8555649890b req-54f91cc8-e089-4d27-8ecc-5da05efcef2a tempest-VolumesSnapshotsTestJSON-1674843237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5805f35a-8ce8-4c46-a243-f36a88bc68c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:57:16 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [req-0f8ec4ae-91d6-4c8c-a4e0-c8555649890b req-54f91cc8-e089-4d27-8ecc-5da05efcef2a tempest-VolumesSnapshotsTestJSON-1674843237 None] Flow 'volume_create_manager' (99ca72e7-64ec-4c9d-974c-da737a6efe47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 15:57:16 devstack cinder-volume[88641]: INFO cinder.volume.manager [req-0f8ec4ae-91d6-4c8c-a4e0-c8555649890b req-54f91cc8-e089-4d27-8ecc-5da05efcef2a tempest-VolumesSnapshotsTestJSON-1674843237 None] Created volume successfully. Aug 10 15:57:16 devstack sudo[92805]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:16 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ec56d8c8-cd38-4074-9d24-9d1da67c5382 tempest-GroupSnapshotsTest-1493708790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-62b35645-4d58-4456-a4ec-1f9caf0518d6" returned: 0 in 0.945s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:16 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ec56d8c8-cd38-4074-9d24-9d1da67c5382 tempest-GroupSnapshotsTest-1493708790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-62b35645-4d58-4456-a4ec-1f9caf0518d6.5e911dec-659a-477f-883f-1ab9dad5095c {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:16 devstack sudo[92831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-62b35645-4d58-4456-a4ec-1f9caf0518d6.5e911dec-659a-477f-883f-1ab9dad5095c Aug 10 15:57:16 devstack sudo[92831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:17 devstack sudo[92831]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ec56d8c8-cd38-4074-9d24-9d1da67c5382 tempest-GroupSnapshotsTest-1493708790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-62b35645-4d58-4456-a4ec-1f9caf0518d6.5e911dec-659a-477f-883f-1ab9dad5095c" returned: 0 in 0.540s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ec56d8c8-cd38-4074-9d24-9d1da67c5382 tempest-GroupSnapshotsTest-1493708790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-62b35645-4d58-4456-a4ec-1f9caf0518d6.5e911dec-659a-477f-883f-1ab9dad5095c {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:17 devstack sudo[92839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-62b35645-4d58-4456-a4ec-1f9caf0518d6.5e911dec-659a-477f-883f-1ab9dad5095c Aug 10 15:57:17 devstack sudo[92839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-dc88164c-db0e-4c6e-a315-19edaa21752b req-34ce8c4a-07c3-458f-853c-d3bd4359bbd0 tempest-VolumesSnapshotsTestJSON-1674843237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:57:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-dc88164c-db0e-4c6e-a315-19edaa21752b req-34ce8c4a-07c3-458f-853c-d3bd4359bbd0 tempest-VolumesSnapshotsTestJSON-1674843237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:57:17 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [req-dc88164c-db0e-4c6e-a315-19edaa21752b req-34ce8c4a-07c3-458f-853c-d3bd4359bbd0 tempest-VolumesSnapshotsTestJSON-1674843237 None] Creating offline snapshot 78bef570-f093-4738-9bfe-d14ccc276674 of volume 05f9d3c4-76cc-4f24-8522-a801fc118716 {{(pid=88641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 15:57:17 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b08e0f-a628-4f94-8879-7a27a0dcd173]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 15:57:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [req-dc88164c-db0e-4c6e-a315-19edaa21752b req-34ce8c4a-07c3-458f-853c-d3bd4359bbd0 tempest-VolumesSnapshotsTestJSON-1674843237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-05f9d3c4-76cc-4f24-8522-a801fc118716 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:17 devstack sudo[92839]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ec56d8c8-cd38-4074-9d24-9d1da67c5382 tempest-GroupSnapshotsTest-1493708790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-62b35645-4d58-4456-a4ec-1f9caf0518d6.5e911dec-659a-477f-883f-1ab9dad5095c" returned: 0 in 0.414s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:17 devstack sudo[92843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-05f9d3c4-76cc-4f24-8522-a801fc118716 Aug 10 15:57:17 devstack sudo[92843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:17 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-ec56d8c8-cd38-4074-9d24-9d1da67c5382 tempest-GroupSnapshotsTest-1493708790 None] Lock "cinder-quobyte-5e911dec-659a-477f-883f-1ab9dad5095c" released by "_delete_snapshot" :: held 2.796s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 15:57:17 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-ec56d8c8-cd38-4074-9d24-9d1da67c5382 tempest-GroupSnapshotsTest-1493708790 None] Lock "cinder-quobyte-62b35645-4d58-4456-a4ec-1f9caf0518d6" released by "delete_snapshot" :: held 2.832s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 15:57:17 devstack cinder-volume[88641]: WARNING cinder.quota [None req-ec56d8c8-cd38-4074-9d24-9d1da67c5382 tempest-GroupSnapshotsTest-1493708790 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1389788735 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1389788735, it is now deprecated. Please use the default quota class for default quota. Aug 10 15:57:17 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-ec56d8c8-cd38-4074-9d24-9d1da67c5382 tempest-GroupSnapshotsTest-1493708790 None] Created reservations ['aa3eac84-1624-4217-bb60-4867c529072d', '99725bdb-2295-408a-991d-d28d5976dc18', '39285e6e-ba41-48f7-a407-3af675b25c9c', 'd1e626e0-b615-4927-a11a-89aaab9251fa'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 15:57:18 devstack sudo[92843]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:18 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [req-dc88164c-db0e-4c6e-a315-19edaa21752b req-34ce8c4a-07c3-458f-853c-d3bd4359bbd0 tempest-VolumesSnapshotsTestJSON-1674843237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-05f9d3c4-76cc-4f24-8522-a801fc118716" returned: 0 in 0.517s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:18 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [req-dc88164c-db0e-4c6e-a315-19edaa21752b req-34ce8c4a-07c3-458f-853c-d3bd4359bbd0 tempest-VolumesSnapshotsTestJSON-1674843237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-05f9d3c4-76cc-4f24-8522-a801fc118716,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-05f9d3c4-76cc-4f24-8522-a801fc118716.78bef570-f093-4738-9bfe-d14ccc276674 1G {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:18 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-ec56d8c8-cd38-4074-9d24-9d1da67c5382 tempest-GroupSnapshotsTest-1493708790 None] group_snapshot cbbdb7bb-f9de-4562-81b2-5dc411b148d8: deleted successfully Aug 10 15:57:18 devstack sudo[92849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-05f9d3c4-76cc-4f24-8522-a801fc118716,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-05f9d3c4-76cc-4f24-8522-a801fc118716.78bef570-f093-4738-9bfe-d14ccc276674 1G Aug 10 15:57:18 devstack sudo[92849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:18 devstack sudo[92849]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:18 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [req-dc88164c-db0e-4c6e-a315-19edaa21752b req-34ce8c4a-07c3-458f-853c-d3bd4359bbd0 tempest-VolumesSnapshotsTestJSON-1674843237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-05f9d3c4-76cc-4f24-8522-a801fc118716,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-05f9d3c4-76cc-4f24-8522-a801fc118716.78bef570-f093-4738-9bfe-d14ccc276674 1G" returned: 0 in 0.477s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:18 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [req-dc88164c-db0e-4c6e-a315-19edaa21752b req-34ce8c4a-07c3-458f-853c-d3bd4359bbd0 tempest-VolumesSnapshotsTestJSON-1674843237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05f9d3c4-76cc-4f24-8522-a801fc118716 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-05f9d3c4-76cc-4f24-8522-a801fc118716.78bef570-f093-4738-9bfe-d14ccc276674 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:18 devstack sudo[92855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05f9d3c4-76cc-4f24-8522-a801fc118716 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-05f9d3c4-76cc-4f24-8522-a801fc118716.78bef570-f093-4738-9bfe-d14ccc276674 Aug 10 15:57:18 devstack sudo[92855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:18 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-e5afe918-00a4-4bc1-bfdd-db4e59af8d09 tempest-GroupSnapshotsTest-1493708790 None] Acquiring lock "cinder-quobyte-62b35645-4d58-4456-a4ec-1f9caf0518d6" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 15:57:18 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-e5afe918-00a4-4bc1-bfdd-db4e59af8d09 tempest-GroupSnapshotsTest-1493708790 None] Lock "cinder-quobyte-62b35645-4d58-4456-a4ec-1f9caf0518d6" acquired by "delete_volume" :: waited 0.023s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 15:57:18 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[54067020-813f-42e5-8769-25d0704f8c7b]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 15:57:18 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e5afe918-00a4-4bc1-bfdd-db4e59af8d09 tempest-GroupSnapshotsTest-1493708790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-62b35645-4d58-4456-a4ec-1f9caf0518d6 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:18 devstack sudo[92855]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:18 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [req-dc88164c-db0e-4c6e-a315-19edaa21752b req-34ce8c4a-07c3-458f-853c-d3bd4359bbd0 tempest-VolumesSnapshotsTestJSON-1674843237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05f9d3c4-76cc-4f24-8522-a801fc118716 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-05f9d3c4-76cc-4f24-8522-a801fc118716.78bef570-f093-4738-9bfe-d14ccc276674" returned: 0 in 0.447s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:18 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [req-dc88164c-db0e-4c6e-a315-19edaa21752b req-34ce8c4a-07c3-458f-853c-d3bd4359bbd0 tempest-VolumesSnapshotsTestJSON-1674843237 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-05f9d3c4-76cc-4f24-8522-a801fc118716.78bef570-f093-4738-9bfe-d14ccc276674 is being set with open permissions: ugo+rw Aug 10 15:57:18 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [req-dc88164c-db0e-4c6e-a315-19edaa21752b req-34ce8c4a-07c3-458f-853c-d3bd4359bbd0 tempest-VolumesSnapshotsTestJSON-1674843237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-05f9d3c4-76cc-4f24-8522-a801fc118716.78bef570-f093-4738-9bfe-d14ccc276674 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:18 devstack sudo[92863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-05f9d3c4-76cc-4f24-8522-a801fc118716.78bef570-f093-4738-9bfe-d14ccc276674 Aug 10 15:57:19 devstack sudo[92863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:19 devstack sudo[92862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-62b35645-4d58-4456-a4ec-1f9caf0518d6 Aug 10 15:57:19 devstack sudo[92862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:19 devstack sudo[92863]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [req-dc88164c-db0e-4c6e-a315-19edaa21752b req-34ce8c4a-07c3-458f-853c-d3bd4359bbd0 tempest-VolumesSnapshotsTestJSON-1674843237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-05f9d3c4-76cc-4f24-8522-a801fc118716.78bef570-f093-4738-9bfe-d14ccc276674" returned: 0 in 0.329s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:19 devstack sudo[92862]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [req-dc88164c-db0e-4c6e-a315-19edaa21752b req-34ce8c4a-07c3-458f-853c-d3bd4359bbd0 tempest-VolumesSnapshotsTestJSON-1674843237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-05f9d3c4-76cc-4f24-8522-a801fc118716.info {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e5afe918-00a4-4bc1-bfdd-db4e59af8d09 tempest-GroupSnapshotsTest-1493708790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-62b35645-4d58-4456-a4ec-1f9caf0518d6" returned: 0 in 0.467s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e5afe918-00a4-4bc1-bfdd-db4e59af8d09 tempest-GroupSnapshotsTest-1493708790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-62b35645-4d58-4456-a4ec-1f9caf0518d6 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:19 devstack sudo[92872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-05f9d3c4-76cc-4f24-8522-a801fc118716.info Aug 10 15:57:19 devstack sudo[92872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:19 devstack sudo[92873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-62b35645-4d58-4456-a4ec-1f9caf0518d6 Aug 10 15:57:19 devstack sudo[92873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:19 devstack sudo[92873]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e5afe918-00a4-4bc1-bfdd-db4e59af8d09 tempest-GroupSnapshotsTest-1493708790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-62b35645-4d58-4456-a4ec-1f9caf0518d6" returned: 0 in 0.298s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:19 devstack sudo[92872]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:19 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-e5afe918-00a4-4bc1-bfdd-db4e59af8d09 tempest-GroupSnapshotsTest-1493708790 None] Lock "cinder-quobyte-62b35645-4d58-4456-a4ec-1f9caf0518d6" released by "delete_volume" :: held 0.840s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 15:57:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [req-dc88164c-db0e-4c6e-a315-19edaa21752b req-34ce8c4a-07c3-458f-853c-d3bd4359bbd0 tempest-VolumesSnapshotsTestJSON-1674843237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-05f9d3c4-76cc-4f24-8522-a801fc118716.info" returned: 0 in 0.347s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:19 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [req-dc88164c-db0e-4c6e-a315-19edaa21752b req-34ce8c4a-07c3-458f-853c-d3bd4359bbd0 tempest-VolumesSnapshotsTestJSON-1674843237 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-05f9d3c4-76cc-4f24-8522-a801fc118716.info is being set with open permissions: ugo+rw Aug 10 15:57:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [req-dc88164c-db0e-4c6e-a315-19edaa21752b req-34ce8c4a-07c3-458f-853c-d3bd4359bbd0 tempest-VolumesSnapshotsTestJSON-1674843237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-05f9d3c4-76cc-4f24-8522-a801fc118716.info {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:19 devstack sudo[92882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-05f9d3c4-76cc-4f24-8522-a801fc118716.info Aug 10 15:57:19 devstack sudo[92882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:19 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-e5afe918-00a4-4bc1-bfdd-db4e59af8d09 tempest-GroupSnapshotsTest-1493708790 None] Created reservations ['081108f4-52ec-4d02-a068-11d1cfee14b4'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 15:57:19 devstack cinder-volume[88641]: WARNING cinder.db.api [None req-e5afe918-00a4-4bc1-bfdd-db4e59af8d09 tempest-GroupSnapshotsTest-1493708790 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1389788735'] Aug 10 15:57:19 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-e5afe918-00a4-4bc1-bfdd-db4e59af8d09 tempest-GroupSnapshotsTest-1493708790 None] Created reservations ['edb084c9-5618-46fb-bc7c-c13129a1661b', '68f74cff-67a5-4bc5-b6b1-2231d4169a0c', '76c95f27-a160-4f7c-b543-8c128b1b70c9', '6decd595-6368-41b8-8954-b76fe2e42056'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 15:57:20 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-e5afe918-00a4-4bc1-bfdd-db4e59af8d09 tempest-GroupSnapshotsTest-1493708790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:57:20 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-e5afe918-00a4-4bc1-bfdd-db4e59af8d09 tempest-GroupSnapshotsTest-1493708790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:57:20 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-e5afe918-00a4-4bc1-bfdd-db4e59af8d09 tempest-GroupSnapshotsTest-1493708790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 15:57:20 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-e5afe918-00a4-4bc1-bfdd-db4e59af8d09 tempest-GroupSnapshotsTest-1493708790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 15:57:20 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-e5afe918-00a4-4bc1-bfdd-db4e59af8d09 tempest-GroupSnapshotsTest-1493708790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:57:20 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e5afe918-00a4-4bc1-bfdd-db4e59af8d09 tempest-GroupSnapshotsTest-1493708790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:20 devstack sudo[92904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 15:57:20 devstack sudo[92904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:20 devstack sudo[92882]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:20 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [req-dc88164c-db0e-4c6e-a315-19edaa21752b req-34ce8c4a-07c3-458f-853c-d3bd4359bbd0 tempest-VolumesSnapshotsTestJSON-1674843237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-05f9d3c4-76cc-4f24-8522-a801fc118716.info" returned: 0 in 0.563s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:20 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-dc88164c-db0e-4c6e-a315-19edaa21752b req-34ce8c4a-07c3-458f-853c-d3bd4359bbd0 tempest-VolumesSnapshotsTestJSON-1674843237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.877s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:57:20 devstack cinder-volume[88641]: INFO cinder.volume.manager [req-dc88164c-db0e-4c6e-a315-19edaa21752b req-34ce8c4a-07c3-458f-853c-d3bd4359bbd0 tempest-VolumesSnapshotsTestJSON-1674843237 None] Create snapshot completed successfully Aug 10 15:57:20 devstack sudo[92904]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:20 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e5afe918-00a4-4bc1-bfdd-db4e59af8d09 tempest-GroupSnapshotsTest-1493708790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.334s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:20 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-e5afe918-00a4-4bc1-bfdd-db4e59af8d09 tempest-GroupSnapshotsTest-1493708790 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 15:57:20 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-e5afe918-00a4-4bc1-bfdd-db4e59af8d09 tempest-GroupSnapshotsTest-1493708790 None] Delete group completed successfully. Aug 10 15:57:21 devstack cinder-volume[88641]: DEBUG cinder.coordination [req-9325df23-a62d-4b2a-a434-05a39898abf1 req-ac2c2446-911c-4061-b3ee-48619e78db01 tempest-VolumesSnapshotsTestJSON-1674843237 None] Acquiring lock "cinder-78bef570-f093-4738-9bfe-d14ccc276674-delete_snapshot" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 15:57:21 devstack cinder-volume[88641]: DEBUG cinder.coordination [req-9325df23-a62d-4b2a-a434-05a39898abf1 req-ac2c2446-911c-4061-b3ee-48619e78db01 tempest-VolumesSnapshotsTestJSON-1674843237 None] Lock "cinder-78bef570-f093-4738-9bfe-d14ccc276674-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 15:57:21 devstack cinder-volume[88641]: DEBUG cinder.coordination [req-9325df23-a62d-4b2a-a434-05a39898abf1 req-ac2c2446-911c-4061-b3ee-48619e78db01 tempest-VolumesSnapshotsTestJSON-1674843237 None] Acquiring lock "cinder-quobyte-05f9d3c4-76cc-4f24-8522-a801fc118716" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 15:57:21 devstack cinder-volume[88641]: DEBUG cinder.coordination [req-9325df23-a62d-4b2a-a434-05a39898abf1 req-ac2c2446-911c-4061-b3ee-48619e78db01 tempest-VolumesSnapshotsTestJSON-1674843237 None] Lock "cinder-quobyte-05f9d3c4-76cc-4f24-8522-a801fc118716" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 15:57:21 devstack cinder-volume[88641]: DEBUG cinder.coordination [req-9325df23-a62d-4b2a-a434-05a39898abf1 req-ac2c2446-911c-4061-b3ee-48619e78db01 tempest-VolumesSnapshotsTestJSON-1674843237 None] Acquiring lock "cinder-quobyte-78bef570-f093-4738-9bfe-d14ccc276674" by "_delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 15:57:21 devstack cinder-volume[88641]: DEBUG cinder.coordination [req-9325df23-a62d-4b2a-a434-05a39898abf1 req-ac2c2446-911c-4061-b3ee-48619e78db01 tempest-VolumesSnapshotsTestJSON-1674843237 None] Lock "cinder-quobyte-78bef570-f093-4738-9bfe-d14ccc276674" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 15:57:21 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [req-9325df23-a62d-4b2a-a434-05a39898abf1 req-ac2c2446-911c-4061-b3ee-48619e78db01 tempest-VolumesSnapshotsTestJSON-1674843237 None] Deleting offline snapshot 78bef570-f093-4738-9bfe-d14ccc276674 of volume 05f9d3c4-76cc-4f24-8522-a801fc118716 {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 15:57:21 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [req-9325df23-a62d-4b2a-a434-05a39898abf1 req-ac2c2446-911c-4061-b3ee-48619e78db01 tempest-VolumesSnapshotsTestJSON-1674843237 None] snapshot_file for this snap is: volume-05f9d3c4-76cc-4f24-8522-a801fc118716.78bef570-f093-4738-9bfe-d14ccc276674 {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 15:57:21 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[c36ac028-29ed-455f-81af-c5e4e67933ec]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 15:57:21 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [req-9325df23-a62d-4b2a-a434-05a39898abf1 req-ac2c2446-911c-4061-b3ee-48619e78db01 tempest-VolumesSnapshotsTestJSON-1674843237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-05f9d3c4-76cc-4f24-8522-a801fc118716.78bef570-f093-4738-9bfe-d14ccc276674 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:21 devstack sudo[92917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-05f9d3c4-76cc-4f24-8522-a801fc118716.78bef570-f093-4738-9bfe-d14ccc276674 Aug 10 15:57:21 devstack sudo[92917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:21 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-bdf66406-b4b2-42b0-b14d-5fcaa184db9a tempest-GroupSnapshotsTest-1493708790 None] Group tempest-GroupSnapshotsTest-Group-2088132757: creating Aug 10 15:57:22 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-bdf66406-b4b2-42b0-b14d-5fcaa184db9a tempest-GroupSnapshotsTest-1493708790 None] Group tempest-GroupSnapshotsTest-Group-2088132757: created successfully Aug 10 15:57:22 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-bdf66406-b4b2-42b0-b14d-5fcaa184db9a tempest-GroupSnapshotsTest-1493708790 None] Create group completed successfully. Aug 10 15:57:22 devstack sudo[92917]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [req-9325df23-a62d-4b2a-a434-05a39898abf1 req-ac2c2446-911c-4061-b3ee-48619e78db01 tempest-VolumesSnapshotsTestJSON-1674843237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-05f9d3c4-76cc-4f24-8522-a801fc118716.78bef570-f093-4738-9bfe-d14ccc276674" returned: 0 in 0.494s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:22 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [req-9325df23-a62d-4b2a-a434-05a39898abf1 req-ac2c2446-911c-4061-b3ee-48619e78db01 tempest-VolumesSnapshotsTestJSON-1674843237 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05f9d3c4-76cc-4f24-8522-a801fc118716(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 15:57:22 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[08895ff3-694d-4d50-99d7-525c33f78cc5]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 15:57:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [req-9325df23-a62d-4b2a-a434-05a39898abf1 req-ac2c2446-911c-4061-b3ee-48619e78db01 tempest-VolumesSnapshotsTestJSON-1674843237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-05f9d3c4-76cc-4f24-8522-a801fc118716 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:22 devstack sudo[92926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-05f9d3c4-76cc-4f24-8522-a801fc118716 Aug 10 15:57:22 devstack sudo[92926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:22 devstack sudo[92926]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [req-9325df23-a62d-4b2a-a434-05a39898abf1 req-ac2c2446-911c-4061-b3ee-48619e78db01 tempest-VolumesSnapshotsTestJSON-1674843237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-05f9d3c4-76cc-4f24-8522-a801fc118716" returned: 0 in 0.377s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [req-9325df23-a62d-4b2a-a434-05a39898abf1 req-ac2c2446-911c-4061-b3ee-48619e78db01 tempest-VolumesSnapshotsTestJSON-1674843237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-05f9d3c4-76cc-4f24-8522-a801fc118716.78bef570-f093-4738-9bfe-d14ccc276674 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:22 devstack sudo[92931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-05f9d3c4-76cc-4f24-8522-a801fc118716.78bef570-f093-4738-9bfe-d14ccc276674 Aug 10 15:57:22 devstack sudo[92931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:23 devstack sudo[92931]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:23 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [req-9325df23-a62d-4b2a-a434-05a39898abf1 req-ac2c2446-911c-4061-b3ee-48619e78db01 tempest-VolumesSnapshotsTestJSON-1674843237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-05f9d3c4-76cc-4f24-8522-a801fc118716.78bef570-f093-4738-9bfe-d14ccc276674" returned: 0 in 0.431s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:23 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [req-9325df23-a62d-4b2a-a434-05a39898abf1 req-ac2c2446-911c-4061-b3ee-48619e78db01 tempest-VolumesSnapshotsTestJSON-1674843237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-05f9d3c4-76cc-4f24-8522-a801fc118716.78bef570-f093-4738-9bfe-d14ccc276674 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:23 devstack sudo[92939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-05f9d3c4-76cc-4f24-8522-a801fc118716.78bef570-f093-4738-9bfe-d14ccc276674 Aug 10 15:57:23 devstack sudo[92939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:23 devstack sudo[92939]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:23 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [req-9325df23-a62d-4b2a-a434-05a39898abf1 req-ac2c2446-911c-4061-b3ee-48619e78db01 tempest-VolumesSnapshotsTestJSON-1674843237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-05f9d3c4-76cc-4f24-8522-a801fc118716.78bef570-f093-4738-9bfe-d14ccc276674" returned: 0 in 0.434s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:23 devstack cinder-volume[88641]: DEBUG cinder.coordination [req-9325df23-a62d-4b2a-a434-05a39898abf1 req-ac2c2446-911c-4061-b3ee-48619e78db01 tempest-VolumesSnapshotsTestJSON-1674843237 None] Lock "cinder-quobyte-78bef570-f093-4738-9bfe-d14ccc276674" released by "_delete_snapshot" :: held 1.928s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 15:57:23 devstack cinder-volume[88641]: DEBUG cinder.coordination [req-9325df23-a62d-4b2a-a434-05a39898abf1 req-ac2c2446-911c-4061-b3ee-48619e78db01 tempest-VolumesSnapshotsTestJSON-1674843237 None] Lock "cinder-quobyte-05f9d3c4-76cc-4f24-8522-a801fc118716" released by "delete_snapshot" :: held 1.963s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 15:57:23 devstack cinder-volume[88641]: WARNING cinder.quota [req-9325df23-a62d-4b2a-a434-05a39898abf1 req-ac2c2446-911c-4061-b3ee-48619e78db01 tempest-VolumesSnapshotsTestJSON-1674843237 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 10 15:57:23 devstack cinder-volume[88641]: DEBUG cinder.quota [req-9325df23-a62d-4b2a-a434-05a39898abf1 req-ac2c2446-911c-4061-b3ee-48619e78db01 tempest-VolumesSnapshotsTestJSON-1674843237 None] Created reservations ['865376b5-40ef-426b-9a7f-29196fbd8b8f', '132a2fe3-8783-43a6-8cfb-77e509e263bb', '0850d46a-d368-4644-9ace-9cf8a0c157cc', 'ee77f0d8-2e2b-4665-a02b-d36120054f0b'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 15:57:23 devstack cinder-volume[88641]: INFO cinder.volume.manager [req-9325df23-a62d-4b2a-a434-05a39898abf1 req-ac2c2446-911c-4061-b3ee-48619e78db01 tempest-VolumesSnapshotsTestJSON-1674843237 None] Delete snapshot completed successfully. Aug 10 15:57:23 devstack cinder-volume[88641]: DEBUG cinder.coordination [req-9325df23-a62d-4b2a-a434-05a39898abf1 req-ac2c2446-911c-4061-b3ee-48619e78db01 tempest-VolumesSnapshotsTestJSON-1674843237 None] Lock "cinder-78bef570-f093-4738-9bfe-d14ccc276674-delete_snapshot" released by "delete_snapshot" :: held 2.189s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 15:57:23 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bf380aa-c9f0-49cc-bbcc-354e5d2f5c0c tempest-GroupSnapshotsTest-1493708790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 15:57:23 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-4bf380aa-c9f0-49cc-bbcc-354e5d2f5c0c tempest-GroupSnapshotsTest-1493708790 None] Flow 'volume_create_manager' (487a14c2-9292-49a0-b909-36f618d8c6fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 15:57:23 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-4bf380aa-c9f0-49cc-bbcc-354e5d2f5c0c tempest-GroupSnapshotsTest-1493708790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b3ba277-3e80-438a-b07d-47db39769c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:57:23 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-4bf380aa-c9f0-49cc-bbcc-354e5d2f5c0c tempest-GroupSnapshotsTest-1493708790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b3ba277-3e80-438a-b07d-47db39769c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T13:57:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2041031393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f2c02d65-d8af-4cfe-9234-a9f4668d4800,host='devstack@QuobyteHD#QuobyteHD',id=963e9104-5650-48fd-8fd9-1edfbed79cf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cd019c2b5d947cca3c05701822bbdae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T13:57:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T13:57:24Z,use_quota=True,user_id='ecaa555a49c544d5b0a89dbd4a095f0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(74f672d2-59b9-4df8-bdc1-34764891a002),volume_type_id=74f672d2-59b9-4df8-bdc1-34764891a002)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:57:23 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-4bf380aa-c9f0-49cc-bbcc-354e5d2f5c0c tempest-GroupSnapshotsTest-1493708790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81215206-4e34-47ab-96b6-beccf6522b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:57:23 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-4bf380aa-c9f0-49cc-bbcc-354e5d2f5c0c tempest-GroupSnapshotsTest-1493708790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81215206-4e34-47ab-96b6-beccf6522b4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:57:23 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-4bf380aa-c9f0-49cc-bbcc-354e5d2f5c0c tempest-GroupSnapshotsTest-1493708790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b59db5fe-8712-43ce-b219-f6e2860bb359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:57:23 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-4bf380aa-c9f0-49cc-bbcc-354e5d2f5c0c tempest-GroupSnapshotsTest-1493708790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b59db5fe-8712-43ce-b219-f6e2860bb359) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '963e9104-5650-48fd-8fd9-1edfbed79cf7', 'volume_name': 'volume-963e9104-5650-48fd-8fd9-1edfbed79cf7', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:57:24 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-4bf380aa-c9f0-49cc-bbcc-354e5d2f5c0c tempest-GroupSnapshotsTest-1493708790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d39609b0-fff9-4843-aa38-5564c519e555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:57:24 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-4bf380aa-c9f0-49cc-bbcc-354e5d2f5c0c tempest-GroupSnapshotsTest-1493708790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d39609b0-fff9-4843-aa38-5564c519e555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:57:24 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-4bf380aa-c9f0-49cc-bbcc-354e5d2f5c0c tempest-GroupSnapshotsTest-1493708790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2a274bc-5646-4a0b-bbca-40113c22ba83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:57:24 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-4bf380aa-c9f0-49cc-bbcc-354e5d2f5c0c tempest-GroupSnapshotsTest-1493708790 None] Volume 963e9104-5650-48fd-8fd9-1edfbed79cf7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-963e9104-5650-48fd-8fd9-1edfbed79cf7', 'volume_size': 1} Aug 10 15:57:24 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-4bf380aa-c9f0-49cc-bbcc-354e5d2f5c0c tempest-GroupSnapshotsTest-1493708790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:57:24 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-4bf380aa-c9f0-49cc-bbcc-354e5d2f5c0c tempest-GroupSnapshotsTest-1493708790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:57:24 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-4bf380aa-c9f0-49cc-bbcc-354e5d2f5c0c tempest-GroupSnapshotsTest-1493708790 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f2c02d65-d8af-4cfe-9234-a9f4668d4800,created_at=2026-08-10T13:57:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2041031393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f2c02d65-d8af-4cfe-9234-a9f4668d4800,host='devstack@QuobyteHD#QuobyteHD',id=963e9104-5650-48fd-8fd9-1edfbed79cf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cd019c2b5d947cca3c05701822bbdae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T13:57:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T13:57:24Z,use_quota=True,user_id='ecaa555a49c544d5b0a89dbd4a095f0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(74f672d2-59b9-4df8-bdc1-34764891a002),volume_type_id=74f672d2-59b9-4df8-bdc1-34764891a002)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 15:57:24 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-4bf380aa-c9f0-49cc-bbcc-354e5d2f5c0c tempest-GroupSnapshotsTest-1493708790 None] Creating volume 963e9104-5650-48fd-8fd9-1edfbed79cf7 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 15:57:24 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-4bf380aa-c9f0-49cc-bbcc-354e5d2f5c0c tempest-GroupSnapshotsTest-1493708790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:57:24 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-4bf380aa-c9f0-49cc-bbcc-354e5d2f5c0c tempest-GroupSnapshotsTest-1493708790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:57:24 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-4bf380aa-c9f0-49cc-bbcc-354e5d2f5c0c tempest-GroupSnapshotsTest-1493708790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 15:57:24 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-4bf380aa-c9f0-49cc-bbcc-354e5d2f5c0c tempest-GroupSnapshotsTest-1493708790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 15:57:24 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-4bf380aa-c9f0-49cc-bbcc-354e5d2f5c0c tempest-GroupSnapshotsTest-1493708790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:57:24 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-4bf380aa-c9f0-49cc-bbcc-354e5d2f5c0c tempest-GroupSnapshotsTest-1493708790 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 15:57:24 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-4bf380aa-c9f0-49cc-bbcc-354e5d2f5c0c tempest-GroupSnapshotsTest-1493708790 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 15:57:24 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4bf380aa-c9f0-49cc-bbcc-354e5d2f5c0c tempest-GroupSnapshotsTest-1493708790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-963e9104-5650-48fd-8fd9-1edfbed79cf7 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:24 devstack sudo[92944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-963e9104-5650-48fd-8fd9-1edfbed79cf7 1073741824 Aug 10 15:57:24 devstack sudo[92944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:24 devstack cinder-volume[88641]: DEBUG cinder.coordination [req-e7244b5f-6844-4f9a-8e11-2fa4c44e4673 req-ab14fd0a-905e-4979-bdee-dd39ce33ffc6 tempest-VolumesSnapshotsTestJSON-1674843237 None] Acquiring lock "cinder-05f9d3c4-76cc-4f24-8522-a801fc118716-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 15:57:24 devstack cinder-volume[88641]: DEBUG cinder.coordination [req-e7244b5f-6844-4f9a-8e11-2fa4c44e4673 req-ab14fd0a-905e-4979-bdee-dd39ce33ffc6 tempest-VolumesSnapshotsTestJSON-1674843237 None] Lock "cinder-05f9d3c4-76cc-4f24-8522-a801fc118716-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 15:57:24 devstack cinder-volume[88641]: DEBUG cinder.coordination [req-e7244b5f-6844-4f9a-8e11-2fa4c44e4673 req-ab14fd0a-905e-4979-bdee-dd39ce33ffc6 tempest-VolumesSnapshotsTestJSON-1674843237 None] Acquiring lock "cinder-quobyte-05f9d3c4-76cc-4f24-8522-a801fc118716" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 15:57:24 devstack cinder-volume[88641]: DEBUG cinder.coordination [req-e7244b5f-6844-4f9a-8e11-2fa4c44e4673 req-ab14fd0a-905e-4979-bdee-dd39ce33ffc6 tempest-VolumesSnapshotsTestJSON-1674843237 None] Lock "cinder-quobyte-05f9d3c4-76cc-4f24-8522-a801fc118716" acquired by "delete_volume" :: waited 0.038s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 15:57:24 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[da593dd1-0094-4380-b768-c9a03dad796c]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 15:57:24 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [req-e7244b5f-6844-4f9a-8e11-2fa4c44e4673 req-ab14fd0a-905e-4979-bdee-dd39ce33ffc6 tempest-VolumesSnapshotsTestJSON-1674843237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-05f9d3c4-76cc-4f24-8522-a801fc118716 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:24 devstack sudo[92949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-05f9d3c4-76cc-4f24-8522-a801fc118716 Aug 10 15:57:24 devstack sudo[92949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:24 devstack sudo[92944]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:24 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4bf380aa-c9f0-49cc-bbcc-354e5d2f5c0c tempest-GroupSnapshotsTest-1493708790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-963e9104-5650-48fd-8fd9-1edfbed79cf7 1073741824" returned: 0 in 0.813s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:24 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4bf380aa-c9f0-49cc-bbcc-354e5d2f5c0c tempest-GroupSnapshotsTest-1493708790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-963e9104-5650-48fd-8fd9-1edfbed79cf7 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:24 devstack sudo[92971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-963e9104-5650-48fd-8fd9-1edfbed79cf7 Aug 10 15:57:24 devstack sudo[92971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:25 devstack sudo[92949]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:25 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [req-e7244b5f-6844-4f9a-8e11-2fa4c44e4673 req-ab14fd0a-905e-4979-bdee-dd39ce33ffc6 tempest-VolumesSnapshotsTestJSON-1674843237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-05f9d3c4-76cc-4f24-8522-a801fc118716" returned: 0 in 0.716s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:25 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [req-e7244b5f-6844-4f9a-8e11-2fa4c44e4673 req-ab14fd0a-905e-4979-bdee-dd39ce33ffc6 tempest-VolumesSnapshotsTestJSON-1674843237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-05f9d3c4-76cc-4f24-8522-a801fc118716 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:25 devstack sudo[92975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-05f9d3c4-76cc-4f24-8522-a801fc118716 Aug 10 15:57:25 devstack sudo[92975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:25 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-c7cf9405-6a8b-4d76-9d1b-eb58ceb65859 tempest-TaggedAttachmentsTest-1292559499 None] Acquiring lock "cinder-dcae10d0-3fa5-46e1-b0a9-0d0e2faf3eb8-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 15:57:25 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-c7cf9405-6a8b-4d76-9d1b-eb58ceb65859 tempest-TaggedAttachmentsTest-1292559499 None] Lock "cinder-dcae10d0-3fa5-46e1-b0a9-0d0e2faf3eb8-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 15:57:25 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-c7cf9405-6a8b-4d76-9d1b-eb58ceb65859 tempest-TaggedAttachmentsTest-1292559499 None] Acquiring lock "cinder-quobyte-dcae10d0-3fa5-46e1-b0a9-0d0e2faf3eb8" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 15:57:25 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-c7cf9405-6a8b-4d76-9d1b-eb58ceb65859 tempest-TaggedAttachmentsTest-1292559499 None] Lock "cinder-quobyte-dcae10d0-3fa5-46e1-b0a9-0d0e2faf3eb8" acquired by "delete_volume" :: waited 0.018s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 15:57:25 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b67efc-3005-493c-a112-3c48b200b7a4]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 15:57:25 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c7cf9405-6a8b-4d76-9d1b-eb58ceb65859 tempest-TaggedAttachmentsTest-1292559499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-dcae10d0-3fa5-46e1-b0a9-0d0e2faf3eb8 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:25 devstack sudo[92975]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:25 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [req-e7244b5f-6844-4f9a-8e11-2fa4c44e4673 req-ab14fd0a-905e-4979-bdee-dd39ce33ffc6 tempest-VolumesSnapshotsTestJSON-1674843237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-05f9d3c4-76cc-4f24-8522-a801fc118716" returned: 0 in 0.409s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:25 devstack sudo[92971]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:25 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4bf380aa-c9f0-49cc-bbcc-354e5d2f5c0c tempest-GroupSnapshotsTest-1493708790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-963e9104-5650-48fd-8fd9-1edfbed79cf7" returned: 0 in 0.568s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:25 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-4bf380aa-c9f0-49cc-bbcc-354e5d2f5c0c tempest-GroupSnapshotsTest-1493708790 None] <== create_volume: return (1464ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 15:57:25 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-4bf380aa-c9f0-49cc-bbcc-354e5d2f5c0c tempest-GroupSnapshotsTest-1493708790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.467s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:57:25 devstack cinder-volume[88641]: DEBUG cinder.coordination [req-e7244b5f-6844-4f9a-8e11-2fa4c44e4673 req-ab14fd0a-905e-4979-bdee-dd39ce33ffc6 tempest-VolumesSnapshotsTestJSON-1674843237 None] Lock "cinder-quobyte-05f9d3c4-76cc-4f24-8522-a801fc118716" released by "delete_volume" :: held 1.226s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 15:57:25 devstack sudo[92979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-dcae10d0-3fa5-46e1-b0a9-0d0e2faf3eb8 Aug 10 15:57:25 devstack sudo[92979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:25 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-4bf380aa-c9f0-49cc-bbcc-354e5d2f5c0c tempest-GroupSnapshotsTest-1493708790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2a274bc-5646-4a0b-bbca-40113c22ba83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-963e9104-5650-48fd-8fd9-1edfbed79cf7', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:57:25 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-4bf380aa-c9f0-49cc-bbcc-354e5d2f5c0c tempest-GroupSnapshotsTest-1493708790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2411ef5b-0f36-4137-be13-691bccbfc502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:57:25 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-4bf380aa-c9f0-49cc-bbcc-354e5d2f5c0c tempest-GroupSnapshotsTest-1493708790 None] Volume volume-963e9104-5650-48fd-8fd9-1edfbed79cf7 (963e9104-5650-48fd-8fd9-1edfbed79cf7): created successfully Aug 10 15:57:25 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-4bf380aa-c9f0-49cc-bbcc-354e5d2f5c0c tempest-GroupSnapshotsTest-1493708790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2411ef5b-0f36-4137-be13-691bccbfc502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:57:25 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-4bf380aa-c9f0-49cc-bbcc-354e5d2f5c0c tempest-GroupSnapshotsTest-1493708790 None] Flow 'volume_create_manager' (487a14c2-9292-49a0-b909-36f618d8c6fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 15:57:25 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-4bf380aa-c9f0-49cc-bbcc-354e5d2f5c0c tempest-GroupSnapshotsTest-1493708790 None] Created volume successfully. Aug 10 15:57:25 devstack cinder-volume[88641]: DEBUG cinder.quota [req-e7244b5f-6844-4f9a-8e11-2fa4c44e4673 req-ab14fd0a-905e-4979-bdee-dd39ce33ffc6 tempest-VolumesSnapshotsTestJSON-1674843237 None] Created reservations ['2864c400-2b7b-4909-88ff-d1ee1f76aa95', '51a308d2-f42b-4019-8950-cb6d0df30648', '1158557f-0b58-4892-9373-97e003b1ffb0', '0916738e-d8bf-498e-8636-1684c6f6cabc'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 15:57:25 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-e7244b5f-6844-4f9a-8e11-2fa4c44e4673 req-ab14fd0a-905e-4979-bdee-dd39ce33ffc6 tempest-VolumesSnapshotsTestJSON-1674843237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:57:25 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-e7244b5f-6844-4f9a-8e11-2fa4c44e4673 req-ab14fd0a-905e-4979-bdee-dd39ce33ffc6 tempest-VolumesSnapshotsTestJSON-1674843237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:57:25 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [req-e7244b5f-6844-4f9a-8e11-2fa4c44e4673 req-ab14fd0a-905e-4979-bdee-dd39ce33ffc6 tempest-VolumesSnapshotsTestJSON-1674843237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 15:57:25 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [req-e7244b5f-6844-4f9a-8e11-2fa4c44e4673 req-ab14fd0a-905e-4979-bdee-dd39ce33ffc6 tempest-VolumesSnapshotsTestJSON-1674843237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 15:57:25 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-e7244b5f-6844-4f9a-8e11-2fa4c44e4673 req-ab14fd0a-905e-4979-bdee-dd39ce33ffc6 tempest-VolumesSnapshotsTestJSON-1674843237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:57:25 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [req-e7244b5f-6844-4f9a-8e11-2fa4c44e4673 req-ab14fd0a-905e-4979-bdee-dd39ce33ffc6 tempest-VolumesSnapshotsTestJSON-1674843237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:25 devstack sudo[92986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 15:57:25 devstack sudo[92986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:25 devstack sudo[92979]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:25 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c7cf9405-6a8b-4d76-9d1b-eb58ceb65859 tempest-TaggedAttachmentsTest-1292559499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-dcae10d0-3fa5-46e1-b0a9-0d0e2faf3eb8" returned: 0 in 0.381s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:25 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c7cf9405-6a8b-4d76-9d1b-eb58ceb65859 tempest-TaggedAttachmentsTest-1292559499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-dcae10d0-3fa5-46e1-b0a9-0d0e2faf3eb8 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:25 devstack sudo[92989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-dcae10d0-3fa5-46e1-b0a9-0d0e2faf3eb8 Aug 10 15:57:25 devstack sudo[92989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:25 devstack sudo[92986]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:25 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [req-e7244b5f-6844-4f9a-8e11-2fa4c44e4673 req-ab14fd0a-905e-4979-bdee-dd39ce33ffc6 tempest-VolumesSnapshotsTestJSON-1674843237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.259s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:26 devstack cinder-volume[88641]: DEBUG cinder.manager [req-e7244b5f-6844-4f9a-8e11-2fa4c44e4673 req-ab14fd0a-905e-4979-bdee-dd39ce33ffc6 tempest-VolumesSnapshotsTestJSON-1674843237 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 15:57:26 devstack cinder-volume[88641]: INFO cinder.volume.manager [req-e7244b5f-6844-4f9a-8e11-2fa4c44e4673 req-ab14fd0a-905e-4979-bdee-dd39ce33ffc6 tempest-VolumesSnapshotsTestJSON-1674843237 None] Deleted volume successfully. Aug 10 15:57:26 devstack cinder-volume[88641]: DEBUG cinder.coordination [req-e7244b5f-6844-4f9a-8e11-2fa4c44e4673 req-ab14fd0a-905e-4979-bdee-dd39ce33ffc6 tempest-VolumesSnapshotsTestJSON-1674843237 None] Lock "cinder-05f9d3c4-76cc-4f24-8522-a801fc118716-delete_volume" released by "delete_volume" :: held 1.908s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 15:57:26 devstack sudo[92989]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:26 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c7cf9405-6a8b-4d76-9d1b-eb58ceb65859 tempest-TaggedAttachmentsTest-1292559499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-dcae10d0-3fa5-46e1-b0a9-0d0e2faf3eb8" returned: 0 in 0.275s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:26 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-c7cf9405-6a8b-4d76-9d1b-eb58ceb65859 tempest-TaggedAttachmentsTest-1292559499 None] Lock "cinder-quobyte-dcae10d0-3fa5-46e1-b0a9-0d0e2faf3eb8" released by "delete_volume" :: held 0.719s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 15:57:26 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-c7cf9405-6a8b-4d76-9d1b-eb58ceb65859 tempest-TaggedAttachmentsTest-1292559499 None] Created reservations ['f9501472-3573-473a-ad45-8fdd1264a1c2', '2a621332-4e27-465b-be7b-180378895a92', '23bf413f-5235-4cb2-b4eb-50f2d3bea6d5', 'a8afb361-8366-4544-935a-7b97c738253c'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 15:57:26 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-c7cf9405-6a8b-4d76-9d1b-eb58ceb65859 tempest-TaggedAttachmentsTest-1292559499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:57:26 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-c7cf9405-6a8b-4d76-9d1b-eb58ceb65859 tempest-TaggedAttachmentsTest-1292559499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:57:26 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-c7cf9405-6a8b-4d76-9d1b-eb58ceb65859 tempest-TaggedAttachmentsTest-1292559499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 15:57:26 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-c7cf9405-6a8b-4d76-9d1b-eb58ceb65859 tempest-TaggedAttachmentsTest-1292559499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 15:57:26 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-c7cf9405-6a8b-4d76-9d1b-eb58ceb65859 tempest-TaggedAttachmentsTest-1292559499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:57:26 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c7cf9405-6a8b-4d76-9d1b-eb58ceb65859 tempest-TaggedAttachmentsTest-1292559499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:26 devstack sudo[92993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 15:57:26 devstack sudo[92993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:26 devstack sudo[92993]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:26 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c7cf9405-6a8b-4d76-9d1b-eb58ceb65859 tempest-TaggedAttachmentsTest-1292559499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.286s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:26 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-c7cf9405-6a8b-4d76-9d1b-eb58ceb65859 tempest-TaggedAttachmentsTest-1292559499 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 15:57:26 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-c7cf9405-6a8b-4d76-9d1b-eb58ceb65859 tempest-TaggedAttachmentsTest-1292559499 None] Deleted volume successfully. Aug 10 15:57:26 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-c7cf9405-6a8b-4d76-9d1b-eb58ceb65859 tempest-TaggedAttachmentsTest-1292559499 None] Lock "cinder-dcae10d0-3fa5-46e1-b0a9-0d0e2faf3eb8-delete_volume" released by "delete_volume" :: held 1.260s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 15:57:27 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-92b09d49-fe17-43fd-9199-dd458cb04dd2 tempest-GroupSnapshotsTest-1493708790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 15:57:27 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-92b09d49-fe17-43fd-9199-dd458cb04dd2 tempest-GroupSnapshotsTest-1493708790 None] Flow 'volume_create_manager' (6c165a64-3690-4c5a-b971-66a5d30f59f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 15:57:27 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-92b09d49-fe17-43fd-9199-dd458cb04dd2 tempest-GroupSnapshotsTest-1493708790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f0cc2ec-70ee-4286-87f6-087ccf5d56ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:57:27 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-92b09d49-fe17-43fd-9199-dd458cb04dd2 tempest-GroupSnapshotsTest-1493708790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f0cc2ec-70ee-4286-87f6-087ccf5d56ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T13:57:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1177819701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f2c02d65-d8af-4cfe-9234-a9f4668d4800,host='devstack@QuobyteHD#QuobyteHD',id=3b140c40-30a9-4805-9a13-7ab45e4f5ffc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cd019c2b5d947cca3c05701822bbdae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T13:57:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T13:57:27Z,use_quota=True,user_id='ecaa555a49c544d5b0a89dbd4a095f0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(74f672d2-59b9-4df8-bdc1-34764891a002),volume_type_id=74f672d2-59b9-4df8-bdc1-34764891a002)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:57:27 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-92b09d49-fe17-43fd-9199-dd458cb04dd2 tempest-GroupSnapshotsTest-1493708790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10e9c152-4c31-4e28-9b17-3476b1dfcf43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:57:27 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-92b09d49-fe17-43fd-9199-dd458cb04dd2 tempest-GroupSnapshotsTest-1493708790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10e9c152-4c31-4e28-9b17-3476b1dfcf43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:57:27 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-92b09d49-fe17-43fd-9199-dd458cb04dd2 tempest-GroupSnapshotsTest-1493708790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4629792-680c-4b24-a83a-87d35e519474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:57:27 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-92b09d49-fe17-43fd-9199-dd458cb04dd2 tempest-GroupSnapshotsTest-1493708790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4629792-680c-4b24-a83a-87d35e519474) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b140c40-30a9-4805-9a13-7ab45e4f5ffc', 'volume_name': 'volume-3b140c40-30a9-4805-9a13-7ab45e4f5ffc', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:57:27 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-92b09d49-fe17-43fd-9199-dd458cb04dd2 tempest-GroupSnapshotsTest-1493708790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10c406d5-f30d-497e-8f61-916436755609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:57:27 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-92b09d49-fe17-43fd-9199-dd458cb04dd2 tempest-GroupSnapshotsTest-1493708790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10c406d5-f30d-497e-8f61-916436755609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:57:27 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-92b09d49-fe17-43fd-9199-dd458cb04dd2 tempest-GroupSnapshotsTest-1493708790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (060ba826-79b7-4aa6-a388-4dc8c9d882e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:57:27 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-92b09d49-fe17-43fd-9199-dd458cb04dd2 tempest-GroupSnapshotsTest-1493708790 None] Volume 3b140c40-30a9-4805-9a13-7ab45e4f5ffc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b140c40-30a9-4805-9a13-7ab45e4f5ffc', 'volume_size': 1} Aug 10 15:57:27 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-92b09d49-fe17-43fd-9199-dd458cb04dd2 tempest-GroupSnapshotsTest-1493708790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:57:27 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-92b09d49-fe17-43fd-9199-dd458cb04dd2 tempest-GroupSnapshotsTest-1493708790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:57:27 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-92b09d49-fe17-43fd-9199-dd458cb04dd2 tempest-GroupSnapshotsTest-1493708790 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f2c02d65-d8af-4cfe-9234-a9f4668d4800,created_at=2026-08-10T13:57:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1177819701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f2c02d65-d8af-4cfe-9234-a9f4668d4800,host='devstack@QuobyteHD#QuobyteHD',id=3b140c40-30a9-4805-9a13-7ab45e4f5ffc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cd019c2b5d947cca3c05701822bbdae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T13:57:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T13:57:27Z,use_quota=True,user_id='ecaa555a49c544d5b0a89dbd4a095f0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(74f672d2-59b9-4df8-bdc1-34764891a002),volume_type_id=74f672d2-59b9-4df8-bdc1-34764891a002)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 15:57:27 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-92b09d49-fe17-43fd-9199-dd458cb04dd2 tempest-GroupSnapshotsTest-1493708790 None] Creating volume 3b140c40-30a9-4805-9a13-7ab45e4f5ffc {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 15:57:27 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-92b09d49-fe17-43fd-9199-dd458cb04dd2 tempest-GroupSnapshotsTest-1493708790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:57:27 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-92b09d49-fe17-43fd-9199-dd458cb04dd2 tempest-GroupSnapshotsTest-1493708790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:57:27 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-92b09d49-fe17-43fd-9199-dd458cb04dd2 tempest-GroupSnapshotsTest-1493708790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 15:57:27 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-92b09d49-fe17-43fd-9199-dd458cb04dd2 tempest-GroupSnapshotsTest-1493708790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 15:57:27 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-92b09d49-fe17-43fd-9199-dd458cb04dd2 tempest-GroupSnapshotsTest-1493708790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:57:27 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-92b09d49-fe17-43fd-9199-dd458cb04dd2 tempest-GroupSnapshotsTest-1493708790 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 15:57:27 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-92b09d49-fe17-43fd-9199-dd458cb04dd2 tempest-GroupSnapshotsTest-1493708790 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 15:57:27 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-92b09d49-fe17-43fd-9199-dd458cb04dd2 tempest-GroupSnapshotsTest-1493708790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3b140c40-30a9-4805-9a13-7ab45e4f5ffc 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:27 devstack sudo[93029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3b140c40-30a9-4805-9a13-7ab45e4f5ffc 1073741824 Aug 10 15:57:27 devstack sudo[93029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:28 devstack sudo[93029]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:28 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-92b09d49-fe17-43fd-9199-dd458cb04dd2 tempest-GroupSnapshotsTest-1493708790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3b140c40-30a9-4805-9a13-7ab45e4f5ffc 1073741824" returned: 0 in 0.913s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:28 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-92b09d49-fe17-43fd-9199-dd458cb04dd2 tempest-GroupSnapshotsTest-1493708790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3b140c40-30a9-4805-9a13-7ab45e4f5ffc {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:28 devstack sudo[93073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3b140c40-30a9-4805-9a13-7ab45e4f5ffc Aug 10 15:57:28 devstack sudo[93073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:28 devstack sudo[93073]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:28 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-92b09d49-fe17-43fd-9199-dd458cb04dd2 tempest-GroupSnapshotsTest-1493708790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3b140c40-30a9-4805-9a13-7ab45e4f5ffc" returned: 0 in 0.337s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:28 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-92b09d49-fe17-43fd-9199-dd458cb04dd2 tempest-GroupSnapshotsTest-1493708790 None] <== create_volume: return (1335ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 15:57:28 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-92b09d49-fe17-43fd-9199-dd458cb04dd2 tempest-GroupSnapshotsTest-1493708790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.337s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:57:28 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-92b09d49-fe17-43fd-9199-dd458cb04dd2 tempest-GroupSnapshotsTest-1493708790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (060ba826-79b7-4aa6-a388-4dc8c9d882e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b140c40-30a9-4805-9a13-7ab45e4f5ffc', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:57:28 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-92b09d49-fe17-43fd-9199-dd458cb04dd2 tempest-GroupSnapshotsTest-1493708790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (464e8927-096f-45a1-a773-95e595da9ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:57:28 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-92b09d49-fe17-43fd-9199-dd458cb04dd2 tempest-GroupSnapshotsTest-1493708790 None] Volume volume-3b140c40-30a9-4805-9a13-7ab45e4f5ffc (3b140c40-30a9-4805-9a13-7ab45e4f5ffc): created successfully Aug 10 15:57:28 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-92b09d49-fe17-43fd-9199-dd458cb04dd2 tempest-GroupSnapshotsTest-1493708790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (464e8927-096f-45a1-a773-95e595da9ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:57:28 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-92b09d49-fe17-43fd-9199-dd458cb04dd2 tempest-GroupSnapshotsTest-1493708790 None] Flow 'volume_create_manager' (6c165a64-3690-4c5a-b971-66a5d30f59f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 15:57:28 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-92b09d49-fe17-43fd-9199-dd458cb04dd2 tempest-GroupSnapshotsTest-1493708790 None] Created volume successfully. Aug 10 15:57:30 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-fd41380c-afdf-4e52-972f-5317105bcd93 tempest-GroupSnapshotsTest-1493708790 None] Update group completed successfully. Aug 10 15:57:31 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-5f77cef8-9c0f-472f-898d-da9442d5ddee tempest-GroupSnapshotsTest-1493708790 None] Update group completed successfully. Aug 10 15:57:33 devstack cinder-volume[88641]: DEBUG dbcounter [-] [88641] Writing DB stats cinder:UPDATE=101,cinder:SELECT=98,cinder:DELETE=7,cinder:INSERT=20 {{(pid=88641) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 15:57:33 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-f9320711-c059-4928-841b-215fd7b7e680 tempest-GroupSnapshotsTest-1493708790 None] Update group completed successfully. Aug 10 15:57:33 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [req-5e54f44a-6a2f-4950-844b-dc0c6ee80f92 req-399ae1c6-36b6-4a8a-9059-a436e2d924a8 tempest-VolumesGetTestJSON-290632544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 15:57:33 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [req-5e54f44a-6a2f-4950-844b-dc0c6ee80f92 req-399ae1c6-36b6-4a8a-9059-a436e2d924a8 tempest-VolumesGetTestJSON-290632544 None] Flow 'volume_create_manager' (1420709c-a8ec-4a1a-8a0e-fd2b57c9ffb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 15:57:33 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [req-5e54f44a-6a2f-4950-844b-dc0c6ee80f92 req-399ae1c6-36b6-4a8a-9059-a436e2d924a8 tempest-VolumesGetTestJSON-290632544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4daf34f-2a7c-42e4-b5d6-9dcf79d16267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:57:33 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [req-5e54f44a-6a2f-4950-844b-dc0c6ee80f92 req-399ae1c6-36b6-4a8a-9059-a436e2d924a8 tempest-VolumesGetTestJSON-290632544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4daf34f-2a7c-42e4-b5d6-9dcf79d16267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T13:57:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1715088600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64e6c7d7-a2c2-42a1-998d-bee3fa96550b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='71b017d8858043388893621977899869',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T13:57:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T13:57:33Z,use_quota=True,user_id='6c5f5678737e41258a3064e6484cfca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:57:33 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [req-5e54f44a-6a2f-4950-844b-dc0c6ee80f92 req-399ae1c6-36b6-4a8a-9059-a436e2d924a8 tempest-VolumesGetTestJSON-290632544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd497f12-8814-47bd-a26d-05f24ccd0c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:57:33 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [req-5e54f44a-6a2f-4950-844b-dc0c6ee80f92 req-399ae1c6-36b6-4a8a-9059-a436e2d924a8 tempest-VolumesGetTestJSON-290632544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd497f12-8814-47bd-a26d-05f24ccd0c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:57:33 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [req-5e54f44a-6a2f-4950-844b-dc0c6ee80f92 req-399ae1c6-36b6-4a8a-9059-a436e2d924a8 tempest-VolumesGetTestJSON-290632544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (885c76ca-96f0-4dcd-9f50-991ad0b87df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:57:33 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [req-5e54f44a-6a2f-4950-844b-dc0c6ee80f92 req-399ae1c6-36b6-4a8a-9059-a436e2d924a8 tempest-VolumesGetTestJSON-290632544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (885c76ca-96f0-4dcd-9f50-991ad0b87df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64e6c7d7-a2c2-42a1-998d-bee3fa96550b', 'volume_name': 'volume-64e6c7d7-a2c2-42a1-998d-bee3fa96550b', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:57:33 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [req-5e54f44a-6a2f-4950-844b-dc0c6ee80f92 req-399ae1c6-36b6-4a8a-9059-a436e2d924a8 tempest-VolumesGetTestJSON-290632544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb061f77-c0d2-4158-8915-982540a34d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:57:33 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [req-5e54f44a-6a2f-4950-844b-dc0c6ee80f92 req-399ae1c6-36b6-4a8a-9059-a436e2d924a8 tempest-VolumesGetTestJSON-290632544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb061f77-c0d2-4158-8915-982540a34d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:57:33 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [req-5e54f44a-6a2f-4950-844b-dc0c6ee80f92 req-399ae1c6-36b6-4a8a-9059-a436e2d924a8 tempest-VolumesGetTestJSON-290632544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87b1b893-219f-4435-a5b1-a1dd0cac360d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:57:33 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [req-5e54f44a-6a2f-4950-844b-dc0c6ee80f92 req-399ae1c6-36b6-4a8a-9059-a436e2d924a8 tempest-VolumesGetTestJSON-290632544 None] Volume 64e6c7d7-a2c2-42a1-998d-bee3fa96550b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64e6c7d7-a2c2-42a1-998d-bee3fa96550b', 'volume_size': 1} Aug 10 15:57:33 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-5e54f44a-6a2f-4950-844b-dc0c6ee80f92 req-399ae1c6-36b6-4a8a-9059-a436e2d924a8 tempest-VolumesGetTestJSON-290632544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:57:33 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-5e54f44a-6a2f-4950-844b-dc0c6ee80f92 req-399ae1c6-36b6-4a8a-9059-a436e2d924a8 tempest-VolumesGetTestJSON-290632544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:57:33 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [req-5e54f44a-6a2f-4950-844b-dc0c6ee80f92 req-399ae1c6-36b6-4a8a-9059-a436e2d924a8 tempest-VolumesGetTestJSON-290632544 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T13:57:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1715088600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64e6c7d7-a2c2-42a1-998d-bee3fa96550b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='71b017d8858043388893621977899869',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T13:57:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T13:57:33Z,use_quota=True,user_id='6c5f5678737e41258a3064e6484cfca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 15:57:33 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [req-5e54f44a-6a2f-4950-844b-dc0c6ee80f92 req-399ae1c6-36b6-4a8a-9059-a436e2d924a8 tempest-VolumesGetTestJSON-290632544 None] Creating volume 64e6c7d7-a2c2-42a1-998d-bee3fa96550b {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 15:57:33 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-5e54f44a-6a2f-4950-844b-dc0c6ee80f92 req-399ae1c6-36b6-4a8a-9059-a436e2d924a8 tempest-VolumesGetTestJSON-290632544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:57:33 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-5e54f44a-6a2f-4950-844b-dc0c6ee80f92 req-399ae1c6-36b6-4a8a-9059-a436e2d924a8 tempest-VolumesGetTestJSON-290632544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:57:33 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [req-5e54f44a-6a2f-4950-844b-dc0c6ee80f92 req-399ae1c6-36b6-4a8a-9059-a436e2d924a8 tempest-VolumesGetTestJSON-290632544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 15:57:33 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [req-5e54f44a-6a2f-4950-844b-dc0c6ee80f92 req-399ae1c6-36b6-4a8a-9059-a436e2d924a8 tempest-VolumesGetTestJSON-290632544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 15:57:33 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-5e54f44a-6a2f-4950-844b-dc0c6ee80f92 req-399ae1c6-36b6-4a8a-9059-a436e2d924a8 tempest-VolumesGetTestJSON-290632544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:57:33 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [req-5e54f44a-6a2f-4950-844b-dc0c6ee80f92 req-399ae1c6-36b6-4a8a-9059-a436e2d924a8 tempest-VolumesGetTestJSON-290632544 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 15:57:33 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [req-5e54f44a-6a2f-4950-844b-dc0c6ee80f92 req-399ae1c6-36b6-4a8a-9059-a436e2d924a8 tempest-VolumesGetTestJSON-290632544 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 15:57:33 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [req-5e54f44a-6a2f-4950-844b-dc0c6ee80f92 req-399ae1c6-36b6-4a8a-9059-a436e2d924a8 tempest-VolumesGetTestJSON-290632544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-64e6c7d7-a2c2-42a1-998d-bee3fa96550b 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:33 devstack sudo[93107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-64e6c7d7-a2c2-42a1-998d-bee3fa96550b 1073741824 Aug 10 15:57:33 devstack sudo[93107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:34 devstack sudo[93107]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:34 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [req-5e54f44a-6a2f-4950-844b-dc0c6ee80f92 req-399ae1c6-36b6-4a8a-9059-a436e2d924a8 tempest-VolumesGetTestJSON-290632544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-64e6c7d7-a2c2-42a1-998d-bee3fa96550b 1073741824" returned: 0 in 0.577s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:34 devstack cinder-volume[88641]: DEBUG dbcounter [-] [88641] Writing DB stats cinder:SELECT=100,cinder:INSERT=27,cinder:UPDATE=107,cinder:DELETE=5 {{(pid=88641) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 15:57:34 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [req-5e54f44a-6a2f-4950-844b-dc0c6ee80f92 req-399ae1c6-36b6-4a8a-9059-a436e2d924a8 tempest-VolumesGetTestJSON-290632544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-64e6c7d7-a2c2-42a1-998d-bee3fa96550b {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:34 devstack sudo[93115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-64e6c7d7-a2c2-42a1-998d-bee3fa96550b Aug 10 15:57:34 devstack sudo[93115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:34 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-b51ae100-236b-41c8-a836-bc587d6feee0 tempest-GroupSnapshotsTest-1493708790 None] Update group completed successfully. Aug 10 15:57:34 devstack sudo[93115]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:34 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [req-5e54f44a-6a2f-4950-844b-dc0c6ee80f92 req-399ae1c6-36b6-4a8a-9059-a436e2d924a8 tempest-VolumesGetTestJSON-290632544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-64e6c7d7-a2c2-42a1-998d-bee3fa96550b" returned: 0 in 0.382s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:34 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [req-5e54f44a-6a2f-4950-844b-dc0c6ee80f92 req-399ae1c6-36b6-4a8a-9059-a436e2d924a8 tempest-VolumesGetTestJSON-290632544 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 15:57:34 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-5e54f44a-6a2f-4950-844b-dc0c6ee80f92 req-399ae1c6-36b6-4a8a-9059-a436e2d924a8 tempest-VolumesGetTestJSON-290632544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:57:34 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [req-5e54f44a-6a2f-4950-844b-dc0c6ee80f92 req-399ae1c6-36b6-4a8a-9059-a436e2d924a8 tempest-VolumesGetTestJSON-290632544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87b1b893-219f-4435-a5b1-a1dd0cac360d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64e6c7d7-a2c2-42a1-998d-bee3fa96550b', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:57:34 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [req-5e54f44a-6a2f-4950-844b-dc0c6ee80f92 req-399ae1c6-36b6-4a8a-9059-a436e2d924a8 tempest-VolumesGetTestJSON-290632544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa627edd-23e3-443f-b3b4-7a5c82ad7c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:57:34 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [req-5e54f44a-6a2f-4950-844b-dc0c6ee80f92 req-399ae1c6-36b6-4a8a-9059-a436e2d924a8 tempest-VolumesGetTestJSON-290632544 None] Volume volume-64e6c7d7-a2c2-42a1-998d-bee3fa96550b (64e6c7d7-a2c2-42a1-998d-bee3fa96550b): created successfully Aug 10 15:57:34 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [req-5e54f44a-6a2f-4950-844b-dc0c6ee80f92 req-399ae1c6-36b6-4a8a-9059-a436e2d924a8 tempest-VolumesGetTestJSON-290632544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa627edd-23e3-443f-b3b4-7a5c82ad7c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:57:34 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [req-5e54f44a-6a2f-4950-844b-dc0c6ee80f92 req-399ae1c6-36b6-4a8a-9059-a436e2d924a8 tempest-VolumesGetTestJSON-290632544 None] Flow 'volume_create_manager' (1420709c-a8ec-4a1a-8a0e-fd2b57c9ffb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 15:57:34 devstack cinder-volume[88641]: INFO cinder.volume.manager [req-5e54f44a-6a2f-4950-844b-dc0c6ee80f92 req-399ae1c6-36b6-4a8a-9059-a436e2d924a8 tempest-VolumesGetTestJSON-290632544 None] Created volume successfully. Aug 10 15:57:35 devstack cinder-volume[88641]: DEBUG cinder.coordination [req-d66202d7-9b73-47ea-9bb3-ae19fed6256f req-90bccf41-010d-46d5-bc44-44f9af8aa3bf tempest-VolumesGetTestJSON-290632544 None] Acquiring lock "cinder-64e6c7d7-a2c2-42a1-998d-bee3fa96550b-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 15:57:35 devstack cinder-volume[88641]: DEBUG cinder.coordination [req-d66202d7-9b73-47ea-9bb3-ae19fed6256f req-90bccf41-010d-46d5-bc44-44f9af8aa3bf tempest-VolumesGetTestJSON-290632544 None] Lock "cinder-64e6c7d7-a2c2-42a1-998d-bee3fa96550b-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 15:57:35 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-0a5bfdcd-fcc3-476e-9cfd-f6032a394bd2 tempest-GroupSnapshotsTest-1493708790 None] GroupSnapshot f7f6b2bb-467a-4aed-91ff-d1218f319b35: creating. Aug 10 15:57:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-0a5bfdcd-fcc3-476e-9cfd-f6032a394bd2 tempest-GroupSnapshotsTest-1493708790 None] Group snapshot f7f6b2bb-467a-4aed-91ff-d1218f319b35: creating. {{(pid=88641) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 10 15:57:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-0a5bfdcd-fcc3-476e-9cfd-f6032a394bd2 tempest-GroupSnapshotsTest-1493708790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:57:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-0a5bfdcd-fcc3-476e-9cfd-f6032a394bd2 tempest-GroupSnapshotsTest-1493708790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:57:36 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-0a5bfdcd-fcc3-476e-9cfd-f6032a394bd2 tempest-GroupSnapshotsTest-1493708790 None] Creating offline snapshot 0f7e34f5-aac5-481b-93b4-6adb87a8ba8f of volume 963e9104-5650-48fd-8fd9-1edfbed79cf7 {{(pid=88641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 15:57:36 devstack cinder-volume[88641]: DEBUG cinder.coordination [req-d66202d7-9b73-47ea-9bb3-ae19fed6256f req-90bccf41-010d-46d5-bc44-44f9af8aa3bf tempest-VolumesGetTestJSON-290632544 None] Acquiring lock "cinder-quobyte-64e6c7d7-a2c2-42a1-998d-bee3fa96550b" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 15:57:36 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[7043f908-f7ff-43ce-b3bb-30d8856ce5cb]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 15:57:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0a5bfdcd-fcc3-476e-9cfd-f6032a394bd2 tempest-GroupSnapshotsTest-1493708790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-963e9104-5650-48fd-8fd9-1edfbed79cf7 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:36 devstack cinder-volume[88641]: DEBUG cinder.coordination [req-d66202d7-9b73-47ea-9bb3-ae19fed6256f req-90bccf41-010d-46d5-bc44-44f9af8aa3bf tempest-VolumesGetTestJSON-290632544 None] Lock "cinder-quobyte-64e6c7d7-a2c2-42a1-998d-bee3fa96550b" acquired by "delete_volume" :: waited 0.049s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 15:57:36 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3bc455c-11ce-460c-a540-c973483d101f]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 15:57:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [req-d66202d7-9b73-47ea-9bb3-ae19fed6256f req-90bccf41-010d-46d5-bc44-44f9af8aa3bf tempest-VolumesGetTestJSON-290632544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-64e6c7d7-a2c2-42a1-998d-bee3fa96550b {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:36 devstack sudo[93119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-963e9104-5650-48fd-8fd9-1edfbed79cf7 Aug 10 15:57:36 devstack sudo[93119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:36 devstack sudo[93120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-64e6c7d7-a2c2-42a1-998d-bee3fa96550b Aug 10 15:57:36 devstack sudo[93120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:36 devstack cinder-volume[88641]: DEBUG oslo_service.periodic_task [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88641) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 15:57:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:57:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:57:36 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 15:57:36 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 15:57:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:57:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:36 devstack sudo[93123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 15:57:36 devstack sudo[93123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:36 devstack sudo[93119]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0a5bfdcd-fcc3-476e-9cfd-f6032a394bd2 tempest-GroupSnapshotsTest-1493708790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-963e9104-5650-48fd-8fd9-1edfbed79cf7" returned: 0 in 0.577s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0a5bfdcd-fcc3-476e-9cfd-f6032a394bd2 tempest-GroupSnapshotsTest-1493708790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-963e9104-5650-48fd-8fd9-1edfbed79cf7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-963e9104-5650-48fd-8fd9-1edfbed79cf7.0f7e34f5-aac5-481b-93b4-6adb87a8ba8f 1G {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:36 devstack sudo[93120]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [req-d66202d7-9b73-47ea-9bb3-ae19fed6256f req-90bccf41-010d-46d5-bc44-44f9af8aa3bf tempest-VolumesGetTestJSON-290632544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-64e6c7d7-a2c2-42a1-998d-bee3fa96550b" returned: 0 in 0.551s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [req-d66202d7-9b73-47ea-9bb3-ae19fed6256f req-90bccf41-010d-46d5-bc44-44f9af8aa3bf tempest-VolumesGetTestJSON-290632544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-64e6c7d7-a2c2-42a1-998d-bee3fa96550b {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:36 devstack sudo[93131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-963e9104-5650-48fd-8fd9-1edfbed79cf7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-963e9104-5650-48fd-8fd9-1edfbed79cf7.0f7e34f5-aac5-481b-93b4-6adb87a8ba8f 1G Aug 10 15:57:36 devstack sudo[93131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:36 devstack sudo[93134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-64e6c7d7-a2c2-42a1-998d-bee3fa96550b Aug 10 15:57:36 devstack sudo[93134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:36 devstack sudo[93123]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.356s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:36 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 15:57:36 devstack cinder-volume[88641]: DEBUG oslo_service.periodic_task [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Running periodic task VolumeManager._thread_info {{(pid=88641) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 15:57:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] thread count: 8 {{(pid=88641) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 10 15:57:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] thread info: [<_MainThread(MainThread, started 127361545748608)>, , , , , , , ] {{(pid=88641) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 10 15:57:37 devstack sudo[93134]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [req-d66202d7-9b73-47ea-9bb3-ae19fed6256f req-90bccf41-010d-46d5-bc44-44f9af8aa3bf tempest-VolumesGetTestJSON-290632544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-64e6c7d7-a2c2-42a1-998d-bee3fa96550b" returned: 0 in 0.342s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:37 devstack cinder-volume[88641]: DEBUG cinder.coordination [req-d66202d7-9b73-47ea-9bb3-ae19fed6256f req-90bccf41-010d-46d5-bc44-44f9af8aa3bf tempest-VolumesGetTestJSON-290632544 None] Lock "cinder-quobyte-64e6c7d7-a2c2-42a1-998d-bee3fa96550b" released by "delete_volume" :: held 0.963s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 15:57:37 devstack cinder-volume[88641]: DEBUG cinder.quota [req-d66202d7-9b73-47ea-9bb3-ae19fed6256f req-90bccf41-010d-46d5-bc44-44f9af8aa3bf tempest-VolumesGetTestJSON-290632544 None] Created reservations ['4b6809ad-1162-4fda-bfff-be80b2fdc707', '364db0a0-2b32-425d-8296-0edf32be5604', '4b542fce-4f47-487c-b08b-2485c43621e2', 'ee02b276-00e6-4134-b1ad-2f741ebfc34e'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 15:57:37 devstack sudo[93131]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0a5bfdcd-fcc3-476e-9cfd-f6032a394bd2 tempest-GroupSnapshotsTest-1493708790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-963e9104-5650-48fd-8fd9-1edfbed79cf7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-963e9104-5650-48fd-8fd9-1edfbed79cf7.0f7e34f5-aac5-481b-93b4-6adb87a8ba8f 1G" returned: 0 in 0.541s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0a5bfdcd-fcc3-476e-9cfd-f6032a394bd2 tempest-GroupSnapshotsTest-1493708790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-963e9104-5650-48fd-8fd9-1edfbed79cf7 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-963e9104-5650-48fd-8fd9-1edfbed79cf7.0f7e34f5-aac5-481b-93b4-6adb87a8ba8f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:37 devstack sudo[93140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-963e9104-5650-48fd-8fd9-1edfbed79cf7 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-963e9104-5650-48fd-8fd9-1edfbed79cf7.0f7e34f5-aac5-481b-93b4-6adb87a8ba8f Aug 10 15:57:37 devstack sudo[93140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-d66202d7-9b73-47ea-9bb3-ae19fed6256f req-90bccf41-010d-46d5-bc44-44f9af8aa3bf tempest-VolumesGetTestJSON-290632544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:57:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-d66202d7-9b73-47ea-9bb3-ae19fed6256f req-90bccf41-010d-46d5-bc44-44f9af8aa3bf tempest-VolumesGetTestJSON-290632544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:57:37 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [req-d66202d7-9b73-47ea-9bb3-ae19fed6256f req-90bccf41-010d-46d5-bc44-44f9af8aa3bf tempest-VolumesGetTestJSON-290632544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 15:57:37 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [req-d66202d7-9b73-47ea-9bb3-ae19fed6256f req-90bccf41-010d-46d5-bc44-44f9af8aa3bf tempest-VolumesGetTestJSON-290632544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 15:57:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-d66202d7-9b73-47ea-9bb3-ae19fed6256f req-90bccf41-010d-46d5-bc44-44f9af8aa3bf tempest-VolumesGetTestJSON-290632544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:57:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [req-d66202d7-9b73-47ea-9bb3-ae19fed6256f req-90bccf41-010d-46d5-bc44-44f9af8aa3bf tempest-VolumesGetTestJSON-290632544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:37 devstack sudo[93142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 15:57:37 devstack sudo[93142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:37 devstack sudo[93140]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0a5bfdcd-fcc3-476e-9cfd-f6032a394bd2 tempest-GroupSnapshotsTest-1493708790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-963e9104-5650-48fd-8fd9-1edfbed79cf7 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-963e9104-5650-48fd-8fd9-1edfbed79cf7.0f7e34f5-aac5-481b-93b4-6adb87a8ba8f" returned: 0 in 0.335s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:37 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-0a5bfdcd-fcc3-476e-9cfd-f6032a394bd2 tempest-GroupSnapshotsTest-1493708790 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-963e9104-5650-48fd-8fd9-1edfbed79cf7.0f7e34f5-aac5-481b-93b4-6adb87a8ba8f is being set with open permissions: ugo+rw: NotImplementedError Aug 10 15:57:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0a5bfdcd-fcc3-476e-9cfd-f6032a394bd2 tempest-GroupSnapshotsTest-1493708790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-963e9104-5650-48fd-8fd9-1edfbed79cf7.0f7e34f5-aac5-481b-93b4-6adb87a8ba8f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:37 devstack sudo[93148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-963e9104-5650-48fd-8fd9-1edfbed79cf7.0f7e34f5-aac5-481b-93b4-6adb87a8ba8f Aug 10 15:57:37 devstack sudo[93148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:37 devstack sudo[93142]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [req-d66202d7-9b73-47ea-9bb3-ae19fed6256f req-90bccf41-010d-46d5-bc44-44f9af8aa3bf tempest-VolumesGetTestJSON-290632544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.398s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:37 devstack cinder-volume[88641]: DEBUG cinder.manager [req-d66202d7-9b73-47ea-9bb3-ae19fed6256f req-90bccf41-010d-46d5-bc44-44f9af8aa3bf tempest-VolumesGetTestJSON-290632544 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 15:57:37 devstack cinder-volume[88641]: INFO cinder.volume.manager [req-d66202d7-9b73-47ea-9bb3-ae19fed6256f req-90bccf41-010d-46d5-bc44-44f9af8aa3bf tempest-VolumesGetTestJSON-290632544 None] Deleted volume successfully. Aug 10 15:57:37 devstack cinder-volume[88641]: DEBUG cinder.coordination [req-d66202d7-9b73-47ea-9bb3-ae19fed6256f req-90bccf41-010d-46d5-bc44-44f9af8aa3bf tempest-VolumesGetTestJSON-290632544 None] Lock "cinder-64e6c7d7-a2c2-42a1-998d-bee3fa96550b-delete_volume" released by "delete_volume" :: held 1.881s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 15:57:37 devstack sudo[93148]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0a5bfdcd-fcc3-476e-9cfd-f6032a394bd2 tempest-GroupSnapshotsTest-1493708790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-963e9104-5650-48fd-8fd9-1edfbed79cf7.0f7e34f5-aac5-481b-93b4-6adb87a8ba8f" returned: 0 in 0.352s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0a5bfdcd-fcc3-476e-9cfd-f6032a394bd2 tempest-GroupSnapshotsTest-1493708790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-963e9104-5650-48fd-8fd9-1edfbed79cf7.info {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:37 devstack sudo[93152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-963e9104-5650-48fd-8fd9-1edfbed79cf7.info Aug 10 15:57:37 devstack sudo[93152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:38 devstack sudo[93152]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:38 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0a5bfdcd-fcc3-476e-9cfd-f6032a394bd2 tempest-GroupSnapshotsTest-1493708790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-963e9104-5650-48fd-8fd9-1edfbed79cf7.info" returned: 0 in 0.280s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:38 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-0a5bfdcd-fcc3-476e-9cfd-f6032a394bd2 tempest-GroupSnapshotsTest-1493708790 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-963e9104-5650-48fd-8fd9-1edfbed79cf7.info is being set with open permissions: ugo+rw: NotImplementedError Aug 10 15:57:38 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0a5bfdcd-fcc3-476e-9cfd-f6032a394bd2 tempest-GroupSnapshotsTest-1493708790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-963e9104-5650-48fd-8fd9-1edfbed79cf7.info {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:38 devstack sudo[93155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-963e9104-5650-48fd-8fd9-1edfbed79cf7.info Aug 10 15:57:38 devstack sudo[93155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:38 devstack sudo[93155]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:38 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0a5bfdcd-fcc3-476e-9cfd-f6032a394bd2 tempest-GroupSnapshotsTest-1493708790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-963e9104-5650-48fd-8fd9-1edfbed79cf7.info" returned: 0 in 0.318s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:38 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-0a5bfdcd-fcc3-476e-9cfd-f6032a394bd2 tempest-GroupSnapshotsTest-1493708790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.547s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:57:38 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-0a5bfdcd-fcc3-476e-9cfd-f6032a394bd2 tempest-GroupSnapshotsTest-1493708790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:57:38 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-0a5bfdcd-fcc3-476e-9cfd-f6032a394bd2 tempest-GroupSnapshotsTest-1493708790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:57:38 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-0a5bfdcd-fcc3-476e-9cfd-f6032a394bd2 tempest-GroupSnapshotsTest-1493708790 None] Creating offline snapshot 36784f04-1b5d-4fd7-8c6a-03d79eba9203 of volume 3b140c40-30a9-4805-9a13-7ab45e4f5ffc {{(pid=88641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 15:57:38 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e384bac-366a-48dc-a963-97f6443e6159]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 15:57:38 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0a5bfdcd-fcc3-476e-9cfd-f6032a394bd2 tempest-GroupSnapshotsTest-1493708790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3b140c40-30a9-4805-9a13-7ab45e4f5ffc {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:38 devstack sudo[93158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3b140c40-30a9-4805-9a13-7ab45e4f5ffc Aug 10 15:57:38 devstack sudo[93158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:39 devstack sudo[93158]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:39 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0a5bfdcd-fcc3-476e-9cfd-f6032a394bd2 tempest-GroupSnapshotsTest-1493708790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3b140c40-30a9-4805-9a13-7ab45e4f5ffc" returned: 0 in 0.526s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:39 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0a5bfdcd-fcc3-476e-9cfd-f6032a394bd2 tempest-GroupSnapshotsTest-1493708790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3b140c40-30a9-4805-9a13-7ab45e4f5ffc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3b140c40-30a9-4805-9a13-7ab45e4f5ffc.36784f04-1b5d-4fd7-8c6a-03d79eba9203 1G {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:39 devstack sudo[93164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3b140c40-30a9-4805-9a13-7ab45e4f5ffc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3b140c40-30a9-4805-9a13-7ab45e4f5ffc.36784f04-1b5d-4fd7-8c6a-03d79eba9203 1G Aug 10 15:57:39 devstack sudo[93164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:39 devstack sudo[93164]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:39 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0a5bfdcd-fcc3-476e-9cfd-f6032a394bd2 tempest-GroupSnapshotsTest-1493708790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3b140c40-30a9-4805-9a13-7ab45e4f5ffc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3b140c40-30a9-4805-9a13-7ab45e4f5ffc.36784f04-1b5d-4fd7-8c6a-03d79eba9203 1G" returned: 0 in 0.440s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:39 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0a5bfdcd-fcc3-476e-9cfd-f6032a394bd2 tempest-GroupSnapshotsTest-1493708790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b140c40-30a9-4805-9a13-7ab45e4f5ffc -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3b140c40-30a9-4805-9a13-7ab45e4f5ffc.36784f04-1b5d-4fd7-8c6a-03d79eba9203 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:39 devstack sudo[93171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b140c40-30a9-4805-9a13-7ab45e4f5ffc -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3b140c40-30a9-4805-9a13-7ab45e4f5ffc.36784f04-1b5d-4fd7-8c6a-03d79eba9203 Aug 10 15:57:39 devstack sudo[93171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:40 devstack sudo[93171]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:40 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0a5bfdcd-fcc3-476e-9cfd-f6032a394bd2 tempest-GroupSnapshotsTest-1493708790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b140c40-30a9-4805-9a13-7ab45e4f5ffc -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3b140c40-30a9-4805-9a13-7ab45e4f5ffc.36784f04-1b5d-4fd7-8c6a-03d79eba9203" returned: 0 in 0.448s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:40 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-0a5bfdcd-fcc3-476e-9cfd-f6032a394bd2 tempest-GroupSnapshotsTest-1493708790 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3b140c40-30a9-4805-9a13-7ab45e4f5ffc.36784f04-1b5d-4fd7-8c6a-03d79eba9203 is being set with open permissions: ugo+rw: NotImplementedError Aug 10 15:57:40 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0a5bfdcd-fcc3-476e-9cfd-f6032a394bd2 tempest-GroupSnapshotsTest-1493708790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3b140c40-30a9-4805-9a13-7ab45e4f5ffc.36784f04-1b5d-4fd7-8c6a-03d79eba9203 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:40 devstack sudo[93176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3b140c40-30a9-4805-9a13-7ab45e4f5ffc.36784f04-1b5d-4fd7-8c6a-03d79eba9203 Aug 10 15:57:40 devstack sudo[93176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:40 devstack sudo[93176]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:40 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0a5bfdcd-fcc3-476e-9cfd-f6032a394bd2 tempest-GroupSnapshotsTest-1493708790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3b140c40-30a9-4805-9a13-7ab45e4f5ffc.36784f04-1b5d-4fd7-8c6a-03d79eba9203" returned: 0 in 0.375s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:40 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0a5bfdcd-fcc3-476e-9cfd-f6032a394bd2 tempest-GroupSnapshotsTest-1493708790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3b140c40-30a9-4805-9a13-7ab45e4f5ffc.info {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:40 devstack sudo[93179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3b140c40-30a9-4805-9a13-7ab45e4f5ffc.info Aug 10 15:57:40 devstack sudo[93179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:40 devstack sudo[93179]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:40 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0a5bfdcd-fcc3-476e-9cfd-f6032a394bd2 tempest-GroupSnapshotsTest-1493708790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3b140c40-30a9-4805-9a13-7ab45e4f5ffc.info" returned: 0 in 0.330s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:40 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-0a5bfdcd-fcc3-476e-9cfd-f6032a394bd2 tempest-GroupSnapshotsTest-1493708790 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3b140c40-30a9-4805-9a13-7ab45e4f5ffc.info is being set with open permissions: ugo+rw: NotImplementedError Aug 10 15:57:40 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0a5bfdcd-fcc3-476e-9cfd-f6032a394bd2 tempest-GroupSnapshotsTest-1493708790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3b140c40-30a9-4805-9a13-7ab45e4f5ffc.info {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:40 devstack sudo[93182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3b140c40-30a9-4805-9a13-7ab45e4f5ffc.info Aug 10 15:57:40 devstack sudo[93182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:41 devstack sudo[93182]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:41 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0a5bfdcd-fcc3-476e-9cfd-f6032a394bd2 tempest-GroupSnapshotsTest-1493708790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3b140c40-30a9-4805-9a13-7ab45e4f5ffc.info" returned: 0 in 0.383s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:41 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-0a5bfdcd-fcc3-476e-9cfd-f6032a394bd2 tempest-GroupSnapshotsTest-1493708790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.637s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:57:41 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-0a5bfdcd-fcc3-476e-9cfd-f6032a394bd2 tempest-GroupSnapshotsTest-1493708790 None] group_snapshot f7f6b2bb-467a-4aed-91ff-d1218f319b35: created successfully Aug 10 15:57:41 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-61e28a71-3f0d-463b-925d-d607cf6da132 tempest-GroupSnapshotsTest-1493708790 None] group_snapshot f7f6b2bb-467a-4aed-91ff-d1218f319b35: deleting Aug 10 15:57:41 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-61e28a71-3f0d-463b-925d-d607cf6da132 tempest-GroupSnapshotsTest-1493708790 None] group_snapshot f7f6b2bb-467a-4aed-91ff-d1218f319b35: deleting {{(pid=88641) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 10 15:57:41 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-61e28a71-3f0d-463b-925d-d607cf6da132 tempest-GroupSnapshotsTest-1493708790 None] Acquiring lock "cinder-quobyte-963e9104-5650-48fd-8fd9-1edfbed79cf7" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 15:57:41 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-61e28a71-3f0d-463b-925d-d607cf6da132 tempest-GroupSnapshotsTest-1493708790 None] Lock "cinder-quobyte-963e9104-5650-48fd-8fd9-1edfbed79cf7" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 15:57:41 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-61e28a71-3f0d-463b-925d-d607cf6da132 tempest-GroupSnapshotsTest-1493708790 None] Acquiring lock "cinder-quobyte-0f7e34f5-aac5-481b-93b4-6adb87a8ba8f" by "_delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 15:57:41 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-61e28a71-3f0d-463b-925d-d607cf6da132 tempest-GroupSnapshotsTest-1493708790 None] Lock "cinder-quobyte-0f7e34f5-aac5-481b-93b4-6adb87a8ba8f" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 15:57:41 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-61e28a71-3f0d-463b-925d-d607cf6da132 tempest-GroupSnapshotsTest-1493708790 None] Deleting offline snapshot 0f7e34f5-aac5-481b-93b4-6adb87a8ba8f of volume 963e9104-5650-48fd-8fd9-1edfbed79cf7 {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 15:57:41 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-61e28a71-3f0d-463b-925d-d607cf6da132 tempest-GroupSnapshotsTest-1493708790 None] snapshot_file for this snap is: volume-963e9104-5650-48fd-8fd9-1edfbed79cf7.0f7e34f5-aac5-481b-93b4-6adb87a8ba8f {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 15:57:41 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[595c6e32-07ef-4686-8809-913f03ffdc4f]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 15:57:41 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-61e28a71-3f0d-463b-925d-d607cf6da132 tempest-GroupSnapshotsTest-1493708790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-963e9104-5650-48fd-8fd9-1edfbed79cf7.0f7e34f5-aac5-481b-93b4-6adb87a8ba8f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:42 devstack sudo[93186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-963e9104-5650-48fd-8fd9-1edfbed79cf7.0f7e34f5-aac5-481b-93b4-6adb87a8ba8f Aug 10 15:57:42 devstack sudo[93186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:42 devstack sudo[93186]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:42 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-61e28a71-3f0d-463b-925d-d607cf6da132 tempest-GroupSnapshotsTest-1493708790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-963e9104-5650-48fd-8fd9-1edfbed79cf7.0f7e34f5-aac5-481b-93b4-6adb87a8ba8f" returned: 0 in 0.644s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:42 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-61e28a71-3f0d-463b-925d-d607cf6da132 tempest-GroupSnapshotsTest-1493708790 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-963e9104-5650-48fd-8fd9-1edfbed79cf7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 15:57:42 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b0aa07-7768-4798-bfb5-565d2ad2da96]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 15:57:42 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-61e28a71-3f0d-463b-925d-d607cf6da132 tempest-GroupSnapshotsTest-1493708790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-963e9104-5650-48fd-8fd9-1edfbed79cf7 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:42 devstack sudo[93220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-963e9104-5650-48fd-8fd9-1edfbed79cf7 Aug 10 15:57:42 devstack sudo[93220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:43 devstack sudo[93220]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:43 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-61e28a71-3f0d-463b-925d-d607cf6da132 tempest-GroupSnapshotsTest-1493708790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-963e9104-5650-48fd-8fd9-1edfbed79cf7" returned: 0 in 0.507s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:43 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-61e28a71-3f0d-463b-925d-d607cf6da132 tempest-GroupSnapshotsTest-1493708790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-963e9104-5650-48fd-8fd9-1edfbed79cf7.0f7e34f5-aac5-481b-93b4-6adb87a8ba8f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:43 devstack sudo[93227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-963e9104-5650-48fd-8fd9-1edfbed79cf7.0f7e34f5-aac5-481b-93b4-6adb87a8ba8f Aug 10 15:57:43 devstack sudo[93227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:43 devstack sudo[93227]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:43 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-61e28a71-3f0d-463b-925d-d607cf6da132 tempest-GroupSnapshotsTest-1493708790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-963e9104-5650-48fd-8fd9-1edfbed79cf7.0f7e34f5-aac5-481b-93b4-6adb87a8ba8f" returned: 0 in 0.417s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:43 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-61e28a71-3f0d-463b-925d-d607cf6da132 tempest-GroupSnapshotsTest-1493708790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-963e9104-5650-48fd-8fd9-1edfbed79cf7.0f7e34f5-aac5-481b-93b4-6adb87a8ba8f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:43 devstack sudo[93233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-963e9104-5650-48fd-8fd9-1edfbed79cf7.0f7e34f5-aac5-481b-93b4-6adb87a8ba8f Aug 10 15:57:43 devstack sudo[93233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:43 devstack sudo[93233]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:43 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-61e28a71-3f0d-463b-925d-d607cf6da132 tempest-GroupSnapshotsTest-1493708790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-963e9104-5650-48fd-8fd9-1edfbed79cf7.0f7e34f5-aac5-481b-93b4-6adb87a8ba8f" returned: 0 in 0.355s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:43 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-61e28a71-3f0d-463b-925d-d607cf6da132 tempest-GroupSnapshotsTest-1493708790 None] Lock "cinder-quobyte-0f7e34f5-aac5-481b-93b4-6adb87a8ba8f" released by "_delete_snapshot" :: held 2.064s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 15:57:43 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-61e28a71-3f0d-463b-925d-d607cf6da132 tempest-GroupSnapshotsTest-1493708790 None] Lock "cinder-quobyte-963e9104-5650-48fd-8fd9-1edfbed79cf7" released by "delete_snapshot" :: held 2.104s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 15:57:43 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-f10c3257-41b5-467f-afae-99f0b79ef0a3 tempest-VolumesTestJSON-963726379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 15:57:43 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-f10c3257-41b5-467f-afae-99f0b79ef0a3 tempest-VolumesTestJSON-963726379 None] Flow 'volume_create_manager' (7ee98c24-f1ab-4948-93aa-1b481da888b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 15:57:43 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-f10c3257-41b5-467f-afae-99f0b79ef0a3 tempest-VolumesTestJSON-963726379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f586702f-b23a-4c67-944f-d8f428e31277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:57:43 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-61e28a71-3f0d-463b-925d-d607cf6da132 tempest-GroupSnapshotsTest-1493708790 None] Acquiring lock "cinder-quobyte-3b140c40-30a9-4805-9a13-7ab45e4f5ffc" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 15:57:43 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-f10c3257-41b5-467f-afae-99f0b79ef0a3 tempest-VolumesTestJSON-963726379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f586702f-b23a-4c67-944f-d8f428e31277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T13:57:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1945231727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a4885c9-6eab-4397-85a7-6164a3e4b75e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='14cfaa3d899b42c096fe0d480c4d04fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T13:57:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T13:57:44Z,use_quota=True,user_id='d4161bf2cdb845c08d9adc7a053e286d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:57:43 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-f10c3257-41b5-467f-afae-99f0b79ef0a3 tempest-VolumesTestJSON-963726379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88b4a1d1-4b4c-4201-94ff-96e04df63d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:57:43 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-f10c3257-41b5-467f-afae-99f0b79ef0a3 tempest-VolumesTestJSON-963726379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88b4a1d1-4b4c-4201-94ff-96e04df63d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:57:43 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-f10c3257-41b5-467f-afae-99f0b79ef0a3 tempest-VolumesTestJSON-963726379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7683c9c7-0bd8-43ea-946f-22bb6b12a571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:57:43 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-f10c3257-41b5-467f-afae-99f0b79ef0a3 tempest-VolumesTestJSON-963726379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7683c9c7-0bd8-43ea-946f-22bb6b12a571) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a4885c9-6eab-4397-85a7-6164a3e4b75e', 'volume_name': 'volume-0a4885c9-6eab-4397-85a7-6164a3e4b75e', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:57:43 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-f10c3257-41b5-467f-afae-99f0b79ef0a3 tempest-VolumesTestJSON-963726379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12987bde-b409-4e7b-8384-41f917e7f02d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:57:43 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-f10c3257-41b5-467f-afae-99f0b79ef0a3 tempest-VolumesTestJSON-963726379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12987bde-b409-4e7b-8384-41f917e7f02d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:57:43 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-f10c3257-41b5-467f-afae-99f0b79ef0a3 tempest-VolumesTestJSON-963726379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d52ac9e-e652-4807-b922-20e6b385af1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:57:43 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-f10c3257-41b5-467f-afae-99f0b79ef0a3 tempest-VolumesTestJSON-963726379 None] Volume 0a4885c9-6eab-4397-85a7-6164a3e4b75e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a4885c9-6eab-4397-85a7-6164a3e4b75e', 'volume_size': 1} Aug 10 15:57:44 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-f10c3257-41b5-467f-afae-99f0b79ef0a3 tempest-VolumesTestJSON-963726379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:57:44 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-f10c3257-41b5-467f-afae-99f0b79ef0a3 tempest-VolumesTestJSON-963726379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:57:44 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-f10c3257-41b5-467f-afae-99f0b79ef0a3 tempest-VolumesTestJSON-963726379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T13:57:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1945231727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a4885c9-6eab-4397-85a7-6164a3e4b75e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='14cfaa3d899b42c096fe0d480c4d04fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T13:57:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T13:57:44Z,use_quota=True,user_id='d4161bf2cdb845c08d9adc7a053e286d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 15:57:44 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-f10c3257-41b5-467f-afae-99f0b79ef0a3 tempest-VolumesTestJSON-963726379 None] Creating volume 0a4885c9-6eab-4397-85a7-6164a3e4b75e {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 15:57:44 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-f10c3257-41b5-467f-afae-99f0b79ef0a3 tempest-VolumesTestJSON-963726379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:57:44 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-f10c3257-41b5-467f-afae-99f0b79ef0a3 tempest-VolumesTestJSON-963726379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:57:44 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-f10c3257-41b5-467f-afae-99f0b79ef0a3 tempest-VolumesTestJSON-963726379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 15:57:44 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-f10c3257-41b5-467f-afae-99f0b79ef0a3 tempest-VolumesTestJSON-963726379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 15:57:44 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-f10c3257-41b5-467f-afae-99f0b79ef0a3 tempest-VolumesTestJSON-963726379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:57:44 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-f10c3257-41b5-467f-afae-99f0b79ef0a3 tempest-VolumesTestJSON-963726379 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 15:57:44 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-f10c3257-41b5-467f-afae-99f0b79ef0a3 tempest-VolumesTestJSON-963726379 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 15:57:44 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-f10c3257-41b5-467f-afae-99f0b79ef0a3 tempest-VolumesTestJSON-963726379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-0a4885c9-6eab-4397-85a7-6164a3e4b75e 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:44 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-61e28a71-3f0d-463b-925d-d607cf6da132 tempest-GroupSnapshotsTest-1493708790 None] Lock "cinder-quobyte-3b140c40-30a9-4805-9a13-7ab45e4f5ffc" acquired by "delete_snapshot" :: waited 0.080s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 15:57:44 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-61e28a71-3f0d-463b-925d-d607cf6da132 tempest-GroupSnapshotsTest-1493708790 None] Acquiring lock "cinder-quobyte-36784f04-1b5d-4fd7-8c6a-03d79eba9203" by "_delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 15:57:44 devstack sudo[93236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-0a4885c9-6eab-4397-85a7-6164a3e4b75e 1073741824 Aug 10 15:57:44 devstack sudo[93236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:44 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-61e28a71-3f0d-463b-925d-d607cf6da132 tempest-GroupSnapshotsTest-1493708790 None] Lock "cinder-quobyte-36784f04-1b5d-4fd7-8c6a-03d79eba9203" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 15:57:44 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-61e28a71-3f0d-463b-925d-d607cf6da132 tempest-GroupSnapshotsTest-1493708790 None] Deleting offline snapshot 36784f04-1b5d-4fd7-8c6a-03d79eba9203 of volume 3b140c40-30a9-4805-9a13-7ab45e4f5ffc {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 15:57:44 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-61e28a71-3f0d-463b-925d-d607cf6da132 tempest-GroupSnapshotsTest-1493708790 None] snapshot_file for this snap is: volume-3b140c40-30a9-4805-9a13-7ab45e4f5ffc.36784f04-1b5d-4fd7-8c6a-03d79eba9203 {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 15:57:44 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f047ebd-ba71-4407-aa63-fcd94a2113d2]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 15:57:44 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-61e28a71-3f0d-463b-925d-d607cf6da132 tempest-GroupSnapshotsTest-1493708790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3b140c40-30a9-4805-9a13-7ab45e4f5ffc.36784f04-1b5d-4fd7-8c6a-03d79eba9203 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:44 devstack sudo[93238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3b140c40-30a9-4805-9a13-7ab45e4f5ffc.36784f04-1b5d-4fd7-8c6a-03d79eba9203 Aug 10 15:57:44 devstack sudo[93238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:44 devstack sudo[93238]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:44 devstack sudo[93236]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:44 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-61e28a71-3f0d-463b-925d-d607cf6da132 tempest-GroupSnapshotsTest-1493708790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3b140c40-30a9-4805-9a13-7ab45e4f5ffc.36784f04-1b5d-4fd7-8c6a-03d79eba9203" returned: 0 in 0.401s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:44 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-61e28a71-3f0d-463b-925d-d607cf6da132 tempest-GroupSnapshotsTest-1493708790 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b140c40-30a9-4805-9a13-7ab45e4f5ffc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 15:57:44 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-f10c3257-41b5-467f-afae-99f0b79ef0a3 tempest-VolumesTestJSON-963726379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-0a4885c9-6eab-4397-85a7-6164a3e4b75e 1073741824" returned: 0 in 0.523s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:44 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc4a82a-d1d1-4fd9-b66b-35bea1db09c3]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 15:57:44 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-61e28a71-3f0d-463b-925d-d607cf6da132 tempest-GroupSnapshotsTest-1493708790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3b140c40-30a9-4805-9a13-7ab45e4f5ffc {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:44 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-f10c3257-41b5-467f-afae-99f0b79ef0a3 tempest-VolumesTestJSON-963726379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-0a4885c9-6eab-4397-85a7-6164a3e4b75e {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:44 devstack sudo[93282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-0a4885c9-6eab-4397-85a7-6164a3e4b75e Aug 10 15:57:44 devstack sudo[93282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:44 devstack sudo[93261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3b140c40-30a9-4805-9a13-7ab45e4f5ffc Aug 10 15:57:44 devstack sudo[93261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:44 devstack sudo[93282]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:44 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-f10c3257-41b5-467f-afae-99f0b79ef0a3 tempest-VolumesTestJSON-963726379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-0a4885c9-6eab-4397-85a7-6164a3e4b75e" returned: 0 in 0.371s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:44 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-f10c3257-41b5-467f-afae-99f0b79ef0a3 tempest-VolumesTestJSON-963726379 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 15:57:44 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-f10c3257-41b5-467f-afae-99f0b79ef0a3 tempest-VolumesTestJSON-963726379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:57:44 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-f10c3257-41b5-467f-afae-99f0b79ef0a3 tempest-VolumesTestJSON-963726379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d52ac9e-e652-4807-b922-20e6b385af1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a4885c9-6eab-4397-85a7-6164a3e4b75e', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:57:44 devstack sudo[93261]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:44 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-f10c3257-41b5-467f-afae-99f0b79ef0a3 tempest-VolumesTestJSON-963726379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0166f917-27cf-4b6a-a8e5-06e287cbc29a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:57:44 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-61e28a71-3f0d-463b-925d-d607cf6da132 tempest-GroupSnapshotsTest-1493708790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3b140c40-30a9-4805-9a13-7ab45e4f5ffc" returned: 0 in 0.438s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:44 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-61e28a71-3f0d-463b-925d-d607cf6da132 tempest-GroupSnapshotsTest-1493708790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3b140c40-30a9-4805-9a13-7ab45e4f5ffc.36784f04-1b5d-4fd7-8c6a-03d79eba9203 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:45 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-f10c3257-41b5-467f-afae-99f0b79ef0a3 tempest-VolumesTestJSON-963726379 None] Volume volume-0a4885c9-6eab-4397-85a7-6164a3e4b75e (0a4885c9-6eab-4397-85a7-6164a3e4b75e): created successfully Aug 10 15:57:45 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-f10c3257-41b5-467f-afae-99f0b79ef0a3 tempest-VolumesTestJSON-963726379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0166f917-27cf-4b6a-a8e5-06e287cbc29a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:57:45 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-f10c3257-41b5-467f-afae-99f0b79ef0a3 tempest-VolumesTestJSON-963726379 None] Flow 'volume_create_manager' (7ee98c24-f1ab-4948-93aa-1b481da888b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 15:57:45 devstack sudo[93291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3b140c40-30a9-4805-9a13-7ab45e4f5ffc.36784f04-1b5d-4fd7-8c6a-03d79eba9203 Aug 10 15:57:45 devstack sudo[93291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:45 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-f10c3257-41b5-467f-afae-99f0b79ef0a3 tempest-VolumesTestJSON-963726379 None] Created volume successfully. Aug 10 15:57:45 devstack sudo[93291]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:45 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-61e28a71-3f0d-463b-925d-d607cf6da132 tempest-GroupSnapshotsTest-1493708790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3b140c40-30a9-4805-9a13-7ab45e4f5ffc.36784f04-1b5d-4fd7-8c6a-03d79eba9203" returned: 0 in 0.399s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:45 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-61e28a71-3f0d-463b-925d-d607cf6da132 tempest-GroupSnapshotsTest-1493708790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3b140c40-30a9-4805-9a13-7ab45e4f5ffc.36784f04-1b5d-4fd7-8c6a-03d79eba9203 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:45 devstack sudo[93296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3b140c40-30a9-4805-9a13-7ab45e4f5ffc.36784f04-1b5d-4fd7-8c6a-03d79eba9203 Aug 10 15:57:45 devstack sudo[93296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:45 devstack sudo[93296]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:45 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-61e28a71-3f0d-463b-925d-d607cf6da132 tempest-GroupSnapshotsTest-1493708790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3b140c40-30a9-4805-9a13-7ab45e4f5ffc.36784f04-1b5d-4fd7-8c6a-03d79eba9203" returned: 0 in 0.247s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:45 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-61e28a71-3f0d-463b-925d-d607cf6da132 tempest-GroupSnapshotsTest-1493708790 None] Lock "cinder-quobyte-36784f04-1b5d-4fd7-8c6a-03d79eba9203" released by "_delete_snapshot" :: held 1.609s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 15:57:45 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-61e28a71-3f0d-463b-925d-d607cf6da132 tempest-GroupSnapshotsTest-1493708790 None] Lock "cinder-quobyte-3b140c40-30a9-4805-9a13-7ab45e4f5ffc" released by "delete_snapshot" :: held 1.639s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 15:57:45 devstack cinder-volume[88641]: WARNING cinder.quota [None req-61e28a71-3f0d-463b-925d-d607cf6da132 tempest-GroupSnapshotsTest-1493708790 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1465907036 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1465907036, it is now deprecated. Please use the default quota class for default quota. Aug 10 15:57:45 devstack cinder-volume[88641]: WARNING cinder.quota [None req-61e28a71-3f0d-463b-925d-d607cf6da132 tempest-GroupSnapshotsTest-1493708790 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1465907036 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1465907036, it is now deprecated. Please use the default quota class for default quota. Aug 10 15:57:45 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-61e28a71-3f0d-463b-925d-d607cf6da132 tempest-GroupSnapshotsTest-1493708790 None] Created reservations ['d3b36312-2513-4ea2-b136-0455ad5dca5d', '9fd0bc8a-310a-441b-914a-c6e67632bd20', 'a1083083-6864-4aed-b6f0-ff98b5912073', '25320471-3126-40a3-b0e2-59227cb156c9'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 15:57:45 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-61e28a71-3f0d-463b-925d-d607cf6da132 tempest-GroupSnapshotsTest-1493708790 None] Created reservations ['297cb825-a89f-436b-81a0-ec74337d585e', 'cc401a71-70cb-45a3-9f1a-14465152d742', 'eed32cf5-735f-4488-9734-3278f7f311f3', '311d3324-f2f0-4651-a872-689e12cd80c4'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 15:57:46 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-61e28a71-3f0d-463b-925d-d607cf6da132 tempest-GroupSnapshotsTest-1493708790 None] group_snapshot f7f6b2bb-467a-4aed-91ff-d1218f319b35: deleted successfully Aug 10 15:57:46 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-c15c4bc9-f21e-491f-816e-7d88c47e29de tempest-VolumesTestJSON-963726379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 15:57:46 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c15c4bc9-f21e-491f-816e-7d88c47e29de tempest-VolumesTestJSON-963726379 None] Flow 'volume_create_manager' (e7e3cb7c-d6b7-405f-8bb2-cb2f566e8e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 15:57:46 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c15c4bc9-f21e-491f-816e-7d88c47e29de tempest-VolumesTestJSON-963726379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (259ca99d-b3c7-40a0-ae3b-8595ceefef75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:57:46 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c15c4bc9-f21e-491f-816e-7d88c47e29de tempest-VolumesTestJSON-963726379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (259ca99d-b3c7-40a0-ae3b-8595ceefef75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T13:57:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1582567757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=757dd17a-6098-483b-8c01-3a0b2d7bb340,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='14cfaa3d899b42c096fe0d480c4d04fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T13:57:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T13:57:46Z,use_quota=True,user_id='d4161bf2cdb845c08d9adc7a053e286d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:57:46 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c15c4bc9-f21e-491f-816e-7d88c47e29de tempest-VolumesTestJSON-963726379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (727cf781-dcab-4a40-8f8f-d2023bd9ca1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:57:46 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c15c4bc9-f21e-491f-816e-7d88c47e29de tempest-VolumesTestJSON-963726379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (727cf781-dcab-4a40-8f8f-d2023bd9ca1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:57:46 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c15c4bc9-f21e-491f-816e-7d88c47e29de tempest-VolumesTestJSON-963726379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f599918-24d6-43fe-baf1-0b170c531d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:57:46 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c15c4bc9-f21e-491f-816e-7d88c47e29de tempest-VolumesTestJSON-963726379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f599918-24d6-43fe-baf1-0b170c531d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '757dd17a-6098-483b-8c01-3a0b2d7bb340', 'volume_name': 'volume-757dd17a-6098-483b-8c01-3a0b2d7bb340', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:57:46 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c15c4bc9-f21e-491f-816e-7d88c47e29de tempest-VolumesTestJSON-963726379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa52c652-10ab-494a-80ab-3a042a0f6cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:57:46 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c15c4bc9-f21e-491f-816e-7d88c47e29de tempest-VolumesTestJSON-963726379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa52c652-10ab-494a-80ab-3a042a0f6cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:57:46 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c15c4bc9-f21e-491f-816e-7d88c47e29de tempest-VolumesTestJSON-963726379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (391d6910-e05d-4b9b-9aeb-a01ea4960f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:57:46 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-c15c4bc9-f21e-491f-816e-7d88c47e29de tempest-VolumesTestJSON-963726379 None] Volume 757dd17a-6098-483b-8c01-3a0b2d7bb340: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-757dd17a-6098-483b-8c01-3a0b2d7bb340', 'volume_size': 1} Aug 10 15:57:46 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-c15c4bc9-f21e-491f-816e-7d88c47e29de tempest-VolumesTestJSON-963726379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:57:46 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-c15c4bc9-f21e-491f-816e-7d88c47e29de tempest-VolumesTestJSON-963726379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:57:46 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-c15c4bc9-f21e-491f-816e-7d88c47e29de tempest-VolumesTestJSON-963726379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T13:57:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1582567757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=757dd17a-6098-483b-8c01-3a0b2d7bb340,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='14cfaa3d899b42c096fe0d480c4d04fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T13:57:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T13:57:46Z,use_quota=True,user_id='d4161bf2cdb845c08d9adc7a053e286d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 15:57:46 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-c15c4bc9-f21e-491f-816e-7d88c47e29de tempest-VolumesTestJSON-963726379 None] Creating volume 757dd17a-6098-483b-8c01-3a0b2d7bb340 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 15:57:46 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-c15c4bc9-f21e-491f-816e-7d88c47e29de tempest-VolumesTestJSON-963726379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:57:46 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-c15c4bc9-f21e-491f-816e-7d88c47e29de tempest-VolumesTestJSON-963726379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:57:46 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-c15c4bc9-f21e-491f-816e-7d88c47e29de tempest-VolumesTestJSON-963726379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 15:57:46 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-c15c4bc9-f21e-491f-816e-7d88c47e29de tempest-VolumesTestJSON-963726379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 15:57:46 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-c15c4bc9-f21e-491f-816e-7d88c47e29de tempest-VolumesTestJSON-963726379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:57:46 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-c15c4bc9-f21e-491f-816e-7d88c47e29de tempest-VolumesTestJSON-963726379 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 15:57:46 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-c15c4bc9-f21e-491f-816e-7d88c47e29de tempest-VolumesTestJSON-963726379 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 15:57:46 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c15c4bc9-f21e-491f-816e-7d88c47e29de tempest-VolumesTestJSON-963726379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-757dd17a-6098-483b-8c01-3a0b2d7bb340 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:46 devstack sudo[93299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-757dd17a-6098-483b-8c01-3a0b2d7bb340 1073741824 Aug 10 15:57:46 devstack sudo[93299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:46 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-6d509fe2-3beb-4dc9-bc7a-3e1640a837c5 tempest-GroupSnapshotsTest-1493708790 None] Acquiring lock "cinder-quobyte-3b140c40-30a9-4805-9a13-7ab45e4f5ffc" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 15:57:46 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-6d509fe2-3beb-4dc9-bc7a-3e1640a837c5 tempest-GroupSnapshotsTest-1493708790 None] Lock "cinder-quobyte-3b140c40-30a9-4805-9a13-7ab45e4f5ffc" acquired by "delete_volume" :: waited 0.022s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 15:57:46 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[084268fb-a70c-434b-b8c2-dd0aa67fed48]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 15:57:46 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6d509fe2-3beb-4dc9-bc7a-3e1640a837c5 tempest-GroupSnapshotsTest-1493708790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3b140c40-30a9-4805-9a13-7ab45e4f5ffc {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:47 devstack sudo[93304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3b140c40-30a9-4805-9a13-7ab45e4f5ffc Aug 10 15:57:47 devstack sudo[93304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:47 devstack sudo[93299]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:47 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c15c4bc9-f21e-491f-816e-7d88c47e29de tempest-VolumesTestJSON-963726379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-757dd17a-6098-483b-8c01-3a0b2d7bb340 1073741824" returned: 0 in 0.503s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:47 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c15c4bc9-f21e-491f-816e-7d88c47e29de tempest-VolumesTestJSON-963726379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-757dd17a-6098-483b-8c01-3a0b2d7bb340 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:47 devstack sudo[93307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-757dd17a-6098-483b-8c01-3a0b2d7bb340 Aug 10 15:57:47 devstack sudo[93307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:47 devstack sudo[93304]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:47 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6d509fe2-3beb-4dc9-bc7a-3e1640a837c5 tempest-GroupSnapshotsTest-1493708790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3b140c40-30a9-4805-9a13-7ab45e4f5ffc" returned: 0 in 0.487s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:47 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6d509fe2-3beb-4dc9-bc7a-3e1640a837c5 tempest-GroupSnapshotsTest-1493708790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3b140c40-30a9-4805-9a13-7ab45e4f5ffc {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:47 devstack sudo[93313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3b140c40-30a9-4805-9a13-7ab45e4f5ffc Aug 10 15:57:47 devstack sudo[93313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:47 devstack sudo[93307]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:47 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c15c4bc9-f21e-491f-816e-7d88c47e29de tempest-VolumesTestJSON-963726379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-757dd17a-6098-483b-8c01-3a0b2d7bb340" returned: 0 in 0.315s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:47 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-c15c4bc9-f21e-491f-816e-7d88c47e29de tempest-VolumesTestJSON-963726379 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 15:57:47 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-c15c4bc9-f21e-491f-816e-7d88c47e29de tempest-VolumesTestJSON-963726379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:57:47 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c15c4bc9-f21e-491f-816e-7d88c47e29de tempest-VolumesTestJSON-963726379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (391d6910-e05d-4b9b-9aeb-a01ea4960f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-757dd17a-6098-483b-8c01-3a0b2d7bb340', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:57:47 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c15c4bc9-f21e-491f-816e-7d88c47e29de tempest-VolumesTestJSON-963726379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4146fab9-b3b0-469d-a2c0-170429ba1007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:57:47 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-c15c4bc9-f21e-491f-816e-7d88c47e29de tempest-VolumesTestJSON-963726379 None] Volume volume-757dd17a-6098-483b-8c01-3a0b2d7bb340 (757dd17a-6098-483b-8c01-3a0b2d7bb340): created successfully Aug 10 15:57:47 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c15c4bc9-f21e-491f-816e-7d88c47e29de tempest-VolumesTestJSON-963726379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4146fab9-b3b0-469d-a2c0-170429ba1007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:57:47 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c15c4bc9-f21e-491f-816e-7d88c47e29de tempest-VolumesTestJSON-963726379 None] Flow 'volume_create_manager' (e7e3cb7c-d6b7-405f-8bb2-cb2f566e8e15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 15:57:47 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-c15c4bc9-f21e-491f-816e-7d88c47e29de tempest-VolumesTestJSON-963726379 None] Created volume successfully. Aug 10 15:57:47 devstack sudo[93313]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:47 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6d509fe2-3beb-4dc9-bc7a-3e1640a837c5 tempest-GroupSnapshotsTest-1493708790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3b140c40-30a9-4805-9a13-7ab45e4f5ffc" returned: 0 in 0.337s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:47 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-6d509fe2-3beb-4dc9-bc7a-3e1640a837c5 tempest-GroupSnapshotsTest-1493708790 None] Lock "cinder-quobyte-3b140c40-30a9-4805-9a13-7ab45e4f5ffc" released by "delete_volume" :: held 0.896s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 15:57:47 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-6d509fe2-3beb-4dc9-bc7a-3e1640a837c5 tempest-GroupSnapshotsTest-1493708790 None] Acquiring lock "cinder-quobyte-963e9104-5650-48fd-8fd9-1edfbed79cf7" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 15:57:47 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-6d509fe2-3beb-4dc9-bc7a-3e1640a837c5 tempest-GroupSnapshotsTest-1493708790 None] Lock "cinder-quobyte-963e9104-5650-48fd-8fd9-1edfbed79cf7" acquired by "delete_volume" :: waited 0.019s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 15:57:47 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[da32dad9-26eb-4b38-bb35-da03733d5fab]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 15:57:47 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6d509fe2-3beb-4dc9-bc7a-3e1640a837c5 tempest-GroupSnapshotsTest-1493708790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-963e9104-5650-48fd-8fd9-1edfbed79cf7 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:47 devstack sudo[93316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-963e9104-5650-48fd-8fd9-1edfbed79cf7 Aug 10 15:57:47 devstack sudo[93316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:48 devstack sudo[93316]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:48 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6d509fe2-3beb-4dc9-bc7a-3e1640a837c5 tempest-GroupSnapshotsTest-1493708790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-963e9104-5650-48fd-8fd9-1edfbed79cf7" returned: 0 in 0.375s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:48 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6d509fe2-3beb-4dc9-bc7a-3e1640a837c5 tempest-GroupSnapshotsTest-1493708790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-963e9104-5650-48fd-8fd9-1edfbed79cf7 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:48 devstack sudo[93321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-963e9104-5650-48fd-8fd9-1edfbed79cf7 Aug 10 15:57:48 devstack sudo[93321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:48 devstack sudo[93321]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:48 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6d509fe2-3beb-4dc9-bc7a-3e1640a837c5 tempest-GroupSnapshotsTest-1493708790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-963e9104-5650-48fd-8fd9-1edfbed79cf7" returned: 0 in 0.262s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:48 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-6d509fe2-3beb-4dc9-bc7a-3e1640a837c5 tempest-GroupSnapshotsTest-1493708790 None] Lock "cinder-quobyte-963e9104-5650-48fd-8fd9-1edfbed79cf7" released by "delete_volume" :: held 0.711s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 15:57:48 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-6d509fe2-3beb-4dc9-bc7a-3e1640a837c5 tempest-GroupSnapshotsTest-1493708790 None] Created reservations ['f70952c3-73da-4129-909a-e100ba647346'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 15:57:48 devstack cinder-volume[88641]: WARNING cinder.quota [None req-6d509fe2-3beb-4dc9-bc7a-3e1640a837c5 tempest-GroupSnapshotsTest-1493708790 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1465907036 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1465907036, it is now deprecated. Please use the default quota class for default quota. Aug 10 15:57:48 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-6d509fe2-3beb-4dc9-bc7a-3e1640a837c5 tempest-GroupSnapshotsTest-1493708790 None] Created reservations ['45d59435-c6aa-4c82-b914-bbb2e77b4680', 'd0926cdc-7da9-4335-b1a9-bd57cd882f66', 'ff9d062d-2f49-4e5d-b522-795cdc968e2c', '774c689c-2cee-41ad-a24b-4a649953ab77'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 15:57:48 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-6d509fe2-3beb-4dc9-bc7a-3e1640a837c5 tempest-GroupSnapshotsTest-1493708790 None] Created reservations ['9e9bf2c8-bc46-4777-bcba-9e98a1f3f80f', 'e346ec63-7953-4d1a-8234-e88a75671471', 'f149207e-b843-4427-91b3-bc617e0b57da', '0c9b5ee4-f254-4bb6-bde1-b21788545462'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 15:57:48 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-6d509fe2-3beb-4dc9-bc7a-3e1640a837c5 tempest-GroupSnapshotsTest-1493708790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:57:48 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-6d509fe2-3beb-4dc9-bc7a-3e1640a837c5 tempest-GroupSnapshotsTest-1493708790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:57:48 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-6d509fe2-3beb-4dc9-bc7a-3e1640a837c5 tempest-GroupSnapshotsTest-1493708790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 15:57:48 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-6d509fe2-3beb-4dc9-bc7a-3e1640a837c5 tempest-GroupSnapshotsTest-1493708790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 15:57:48 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-6d509fe2-3beb-4dc9-bc7a-3e1640a837c5 tempest-GroupSnapshotsTest-1493708790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:57:48 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6d509fe2-3beb-4dc9-bc7a-3e1640a837c5 tempest-GroupSnapshotsTest-1493708790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:48 devstack sudo[93324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 15:57:48 devstack sudo[93324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:49 devstack sudo[93324]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:49 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6d509fe2-3beb-4dc9-bc7a-3e1640a837c5 tempest-GroupSnapshotsTest-1493708790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.357s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:49 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-6d509fe2-3beb-4dc9-bc7a-3e1640a837c5 tempest-GroupSnapshotsTest-1493708790 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 15:57:49 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-6d509fe2-3beb-4dc9-bc7a-3e1640a837c5 tempest-GroupSnapshotsTest-1493708790 None] Delete group completed successfully. Aug 10 15:57:49 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5176e9b-e754-4137-8d72-248df143e81d tempest-VolumesTestJSON-963726379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 15:57:49 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c5176e9b-e754-4137-8d72-248df143e81d tempest-VolumesTestJSON-963726379 None] Flow 'volume_create_manager' (c59de39b-bb98-417c-8b86-c8f7bcabb295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 15:57:49 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c5176e9b-e754-4137-8d72-248df143e81d tempest-VolumesTestJSON-963726379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7fe53ef-a6e1-4a99-8cff-9e1e94afe77e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:57:49 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c5176e9b-e754-4137-8d72-248df143e81d tempest-VolumesTestJSON-963726379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7fe53ef-a6e1-4a99-8cff-9e1e94afe77e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T13:57:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1207776132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63c6d754-8278-4e10-a840-d0a646c9a4ba,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='14cfaa3d899b42c096fe0d480c4d04fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T13:57:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T13:57:49Z,use_quota=True,user_id='d4161bf2cdb845c08d9adc7a053e286d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:57:49 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c5176e9b-e754-4137-8d72-248df143e81d tempest-VolumesTestJSON-963726379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22c4f0d5-6b41-4448-99b0-fed2ab050f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:57:49 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c5176e9b-e754-4137-8d72-248df143e81d tempest-VolumesTestJSON-963726379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22c4f0d5-6b41-4448-99b0-fed2ab050f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:57:49 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c5176e9b-e754-4137-8d72-248df143e81d tempest-VolumesTestJSON-963726379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2478d741-a261-44d8-aa08-f950d4b55f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:57:49 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c5176e9b-e754-4137-8d72-248df143e81d tempest-VolumesTestJSON-963726379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2478d741-a261-44d8-aa08-f950d4b55f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63c6d754-8278-4e10-a840-d0a646c9a4ba', 'volume_name': 'volume-63c6d754-8278-4e10-a840-d0a646c9a4ba', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:57:49 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c5176e9b-e754-4137-8d72-248df143e81d tempest-VolumesTestJSON-963726379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cda9bf73-c8f0-4459-862b-918e6c2b846a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:57:49 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c5176e9b-e754-4137-8d72-248df143e81d tempest-VolumesTestJSON-963726379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cda9bf73-c8f0-4459-862b-918e6c2b846a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:57:49 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c5176e9b-e754-4137-8d72-248df143e81d tempest-VolumesTestJSON-963726379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (226f544e-c8f7-4616-87c4-b80dd982ab95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:57:49 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-c5176e9b-e754-4137-8d72-248df143e81d tempest-VolumesTestJSON-963726379 None] Volume 63c6d754-8278-4e10-a840-d0a646c9a4ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63c6d754-8278-4e10-a840-d0a646c9a4ba', 'volume_size': 1} Aug 10 15:57:49 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-c5176e9b-e754-4137-8d72-248df143e81d tempest-VolumesTestJSON-963726379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:57:49 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-c5176e9b-e754-4137-8d72-248df143e81d tempest-VolumesTestJSON-963726379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:57:49 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-c5176e9b-e754-4137-8d72-248df143e81d tempest-VolumesTestJSON-963726379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T13:57:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1207776132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63c6d754-8278-4e10-a840-d0a646c9a4ba,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='14cfaa3d899b42c096fe0d480c4d04fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T13:57:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T13:57:49Z,use_quota=True,user_id='d4161bf2cdb845c08d9adc7a053e286d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 15:57:49 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-c5176e9b-e754-4137-8d72-248df143e81d tempest-VolumesTestJSON-963726379 None] Creating volume 63c6d754-8278-4e10-a840-d0a646c9a4ba {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 15:57:49 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-c5176e9b-e754-4137-8d72-248df143e81d tempest-VolumesTestJSON-963726379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:57:49 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-c5176e9b-e754-4137-8d72-248df143e81d tempest-VolumesTestJSON-963726379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:57:49 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-c5176e9b-e754-4137-8d72-248df143e81d tempest-VolumesTestJSON-963726379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 15:57:49 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-c5176e9b-e754-4137-8d72-248df143e81d tempest-VolumesTestJSON-963726379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 15:57:49 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-c5176e9b-e754-4137-8d72-248df143e81d tempest-VolumesTestJSON-963726379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:57:49 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-c5176e9b-e754-4137-8d72-248df143e81d tempest-VolumesTestJSON-963726379 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 15:57:49 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-c5176e9b-e754-4137-8d72-248df143e81d tempest-VolumesTestJSON-963726379 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 15:57:49 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c5176e9b-e754-4137-8d72-248df143e81d tempest-VolumesTestJSON-963726379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-63c6d754-8278-4e10-a840-d0a646c9a4ba 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:49 devstack sudo[93327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-63c6d754-8278-4e10-a840-d0a646c9a4ba 1073741824 Aug 10 15:57:49 devstack sudo[93327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:49 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-d413089c-3f16-414b-8d13-c08f05e224dc tempest-GroupSnapshotsTest-1493708790 None] Group tempest-GroupSnapshotsTest-Group-2077102935: creating Aug 10 15:57:49 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-d413089c-3f16-414b-8d13-c08f05e224dc tempest-GroupSnapshotsTest-1493708790 None] Group tempest-GroupSnapshotsTest-Group-2077102935: created successfully Aug 10 15:57:49 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-d413089c-3f16-414b-8d13-c08f05e224dc tempest-GroupSnapshotsTest-1493708790 None] Create group completed successfully. Aug 10 15:57:50 devstack sudo[93327]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c5176e9b-e754-4137-8d72-248df143e81d tempest-VolumesTestJSON-963726379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-63c6d754-8278-4e10-a840-d0a646c9a4ba 1073741824" returned: 0 in 0.665s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c5176e9b-e754-4137-8d72-248df143e81d tempest-VolumesTestJSON-963726379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-63c6d754-8278-4e10-a840-d0a646c9a4ba {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:50 devstack sudo[93333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-63c6d754-8278-4e10-a840-d0a646c9a4ba Aug 10 15:57:50 devstack sudo[93333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:50 devstack sudo[93333]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c5176e9b-e754-4137-8d72-248df143e81d tempest-VolumesTestJSON-963726379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-63c6d754-8278-4e10-a840-d0a646c9a4ba" returned: 0 in 0.265s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:50 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-c5176e9b-e754-4137-8d72-248df143e81d tempest-VolumesTestJSON-963726379 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 15:57:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-c5176e9b-e754-4137-8d72-248df143e81d tempest-VolumesTestJSON-963726379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:57:50 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c5176e9b-e754-4137-8d72-248df143e81d tempest-VolumesTestJSON-963726379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (226f544e-c8f7-4616-87c4-b80dd982ab95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63c6d754-8278-4e10-a840-d0a646c9a4ba', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:57:50 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c5176e9b-e754-4137-8d72-248df143e81d tempest-VolumesTestJSON-963726379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44cf1ccf-eba3-41ee-bb08-f2e23c041ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:57:50 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-c5176e9b-e754-4137-8d72-248df143e81d tempest-VolumesTestJSON-963726379 None] Volume volume-63c6d754-8278-4e10-a840-d0a646c9a4ba (63c6d754-8278-4e10-a840-d0a646c9a4ba): created successfully Aug 10 15:57:50 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c5176e9b-e754-4137-8d72-248df143e81d tempest-VolumesTestJSON-963726379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44cf1ccf-eba3-41ee-bb08-f2e23c041ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:57:50 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c5176e9b-e754-4137-8d72-248df143e81d tempest-VolumesTestJSON-963726379 None] Flow 'volume_create_manager' (c59de39b-bb98-417c-8b86-c8f7bcabb295) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 15:57:50 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-c5176e9b-e754-4137-8d72-248df143e81d tempest-VolumesTestJSON-963726379 None] Created volume successfully. Aug 10 15:57:51 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-49dec6dd-a245-4da9-b8dd-1df89d0e61f2 tempest-GroupSnapshotsTest-1493708790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 15:57:51 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-49dec6dd-a245-4da9-b8dd-1df89d0e61f2 tempest-GroupSnapshotsTest-1493708790 None] Flow 'volume_create_manager' (cc0f871b-eb01-4faf-8667-d5cb7412529a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 15:57:51 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-49dec6dd-a245-4da9-b8dd-1df89d0e61f2 tempest-GroupSnapshotsTest-1493708790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c9961d6-7121-4c37-bcd7-04697b145e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:57:51 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-49dec6dd-a245-4da9-b8dd-1df89d0e61f2 tempest-GroupSnapshotsTest-1493708790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c9961d6-7121-4c37-bcd7-04697b145e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T13:57:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-769851486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=63ace04f-802d-4705-ba1b-f6b1a62cada6,host='devstack@QuobyteHD#QuobyteHD',id=877b1bce-2521-44d9-83d8-a2d1c32bf448,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cd019c2b5d947cca3c05701822bbdae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T13:57:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T13:57:52Z,use_quota=True,user_id='ecaa555a49c544d5b0a89dbd4a095f0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(262d7293-095c-4aa6-864a-7f84ed2ef295),volume_type_id=262d7293-095c-4aa6-864a-7f84ed2ef295)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:57:51 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-49dec6dd-a245-4da9-b8dd-1df89d0e61f2 tempest-GroupSnapshotsTest-1493708790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c5fde1b-1452-40ac-be6a-5c68fefbf824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:57:51 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-49dec6dd-a245-4da9-b8dd-1df89d0e61f2 tempest-GroupSnapshotsTest-1493708790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c5fde1b-1452-40ac-be6a-5c68fefbf824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:57:51 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-49dec6dd-a245-4da9-b8dd-1df89d0e61f2 tempest-GroupSnapshotsTest-1493708790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d28513a-e6ef-4cb7-b2fa-ba283e9ad0d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:57:51 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-49dec6dd-a245-4da9-b8dd-1df89d0e61f2 tempest-GroupSnapshotsTest-1493708790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d28513a-e6ef-4cb7-b2fa-ba283e9ad0d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '877b1bce-2521-44d9-83d8-a2d1c32bf448', 'volume_name': 'volume-877b1bce-2521-44d9-83d8-a2d1c32bf448', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:57:51 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-49dec6dd-a245-4da9-b8dd-1df89d0e61f2 tempest-GroupSnapshotsTest-1493708790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ddc283e-316d-4ca6-a7e0-fdbedcc0c247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:57:51 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-49dec6dd-a245-4da9-b8dd-1df89d0e61f2 tempest-GroupSnapshotsTest-1493708790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ddc283e-316d-4ca6-a7e0-fdbedcc0c247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:57:51 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-49dec6dd-a245-4da9-b8dd-1df89d0e61f2 tempest-GroupSnapshotsTest-1493708790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7369b10e-3ecd-4b74-9d32-4671840efb72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:57:51 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-49dec6dd-a245-4da9-b8dd-1df89d0e61f2 tempest-GroupSnapshotsTest-1493708790 None] Volume 877b1bce-2521-44d9-83d8-a2d1c32bf448: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-877b1bce-2521-44d9-83d8-a2d1c32bf448', 'volume_size': 1} Aug 10 15:57:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-49dec6dd-a245-4da9-b8dd-1df89d0e61f2 tempest-GroupSnapshotsTest-1493708790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:57:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-49dec6dd-a245-4da9-b8dd-1df89d0e61f2 tempest-GroupSnapshotsTest-1493708790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:57:51 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-49dec6dd-a245-4da9-b8dd-1df89d0e61f2 tempest-GroupSnapshotsTest-1493708790 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=63ace04f-802d-4705-ba1b-f6b1a62cada6,created_at=2026-08-10T13:57:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-769851486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=63ace04f-802d-4705-ba1b-f6b1a62cada6,host='devstack@QuobyteHD#QuobyteHD',id=877b1bce-2521-44d9-83d8-a2d1c32bf448,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cd019c2b5d947cca3c05701822bbdae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T13:57:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T13:57:52Z,use_quota=True,user_id='ecaa555a49c544d5b0a89dbd4a095f0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(262d7293-095c-4aa6-864a-7f84ed2ef295),volume_type_id=262d7293-095c-4aa6-864a-7f84ed2ef295)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 15:57:51 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-49dec6dd-a245-4da9-b8dd-1df89d0e61f2 tempest-GroupSnapshotsTest-1493708790 None] Creating volume 877b1bce-2521-44d9-83d8-a2d1c32bf448 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 15:57:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-49dec6dd-a245-4da9-b8dd-1df89d0e61f2 tempest-GroupSnapshotsTest-1493708790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:57:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-49dec6dd-a245-4da9-b8dd-1df89d0e61f2 tempest-GroupSnapshotsTest-1493708790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:57:51 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-49dec6dd-a245-4da9-b8dd-1df89d0e61f2 tempest-GroupSnapshotsTest-1493708790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 15:57:51 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-49dec6dd-a245-4da9-b8dd-1df89d0e61f2 tempest-GroupSnapshotsTest-1493708790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 15:57:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-49dec6dd-a245-4da9-b8dd-1df89d0e61f2 tempest-GroupSnapshotsTest-1493708790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:57:51 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-49dec6dd-a245-4da9-b8dd-1df89d0e61f2 tempest-GroupSnapshotsTest-1493708790 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 15:57:51 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-49dec6dd-a245-4da9-b8dd-1df89d0e61f2 tempest-GroupSnapshotsTest-1493708790 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 15:57:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-49dec6dd-a245-4da9-b8dd-1df89d0e61f2 tempest-GroupSnapshotsTest-1493708790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-877b1bce-2521-44d9-83d8-a2d1c32bf448 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:51 devstack sudo[93338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-877b1bce-2521-44d9-83d8-a2d1c32bf448 1073741824 Aug 10 15:57:51 devstack sudo[93338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:52 devstack sudo[93338]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-49dec6dd-a245-4da9-b8dd-1df89d0e61f2 tempest-GroupSnapshotsTest-1493708790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-877b1bce-2521-44d9-83d8-a2d1c32bf448 1073741824" returned: 0 in 0.532s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-49dec6dd-a245-4da9-b8dd-1df89d0e61f2 tempest-GroupSnapshotsTest-1493708790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-877b1bce-2521-44d9-83d8-a2d1c32bf448 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:52 devstack sudo[93344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-877b1bce-2521-44d9-83d8-a2d1c32bf448 Aug 10 15:57:52 devstack sudo[93344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:52 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-59210ed1-03de-46c9-8ee9-ece9ae2df1a4 tempest-VolumesTestJSON-963726379 None] Acquiring lock "cinder-63c6d754-8278-4e10-a840-d0a646c9a4ba-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 15:57:52 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-59210ed1-03de-46c9-8ee9-ece9ae2df1a4 tempest-VolumesTestJSON-963726379 None] Lock "cinder-63c6d754-8278-4e10-a840-d0a646c9a4ba-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 15:57:52 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-59210ed1-03de-46c9-8ee9-ece9ae2df1a4 tempest-VolumesTestJSON-963726379 None] Acquiring lock "cinder-quobyte-63c6d754-8278-4e10-a840-d0a646c9a4ba" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 15:57:52 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-59210ed1-03de-46c9-8ee9-ece9ae2df1a4 tempest-VolumesTestJSON-963726379 None] Lock "cinder-quobyte-63c6d754-8278-4e10-a840-d0a646c9a4ba" acquired by "delete_volume" :: waited 0.018s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 15:57:52 devstack sudo[93344]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-49dec6dd-a245-4da9-b8dd-1df89d0e61f2 tempest-GroupSnapshotsTest-1493708790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-877b1bce-2521-44d9-83d8-a2d1c32bf448" returned: 0 in 0.325s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:52 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-49dec6dd-a245-4da9-b8dd-1df89d0e61f2 tempest-GroupSnapshotsTest-1493708790 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 15:57:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-49dec6dd-a245-4da9-b8dd-1df89d0e61f2 tempest-GroupSnapshotsTest-1493708790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:57:52 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-49dec6dd-a245-4da9-b8dd-1df89d0e61f2 tempest-GroupSnapshotsTest-1493708790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7369b10e-3ecd-4b74-9d32-4671840efb72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-877b1bce-2521-44d9-83d8-a2d1c32bf448', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:57:52 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-49dec6dd-a245-4da9-b8dd-1df89d0e61f2 tempest-GroupSnapshotsTest-1493708790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (566ea22b-35f4-4f41-8fb6-3cf1814e8bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:57:52 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1567489-ac13-4f61-9c09-ad9ba1e64b3f]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 15:57:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-59210ed1-03de-46c9-8ee9-ece9ae2df1a4 tempest-VolumesTestJSON-963726379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-63c6d754-8278-4e10-a840-d0a646c9a4ba {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:52 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-49dec6dd-a245-4da9-b8dd-1df89d0e61f2 tempest-GroupSnapshotsTest-1493708790 None] Volume volume-877b1bce-2521-44d9-83d8-a2d1c32bf448 (877b1bce-2521-44d9-83d8-a2d1c32bf448): created successfully Aug 10 15:57:52 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-49dec6dd-a245-4da9-b8dd-1df89d0e61f2 tempest-GroupSnapshotsTest-1493708790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (566ea22b-35f4-4f41-8fb6-3cf1814e8bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:57:52 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-49dec6dd-a245-4da9-b8dd-1df89d0e61f2 tempest-GroupSnapshotsTest-1493708790 None] Flow 'volume_create_manager' (cc0f871b-eb01-4faf-8667-d5cb7412529a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 15:57:52 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-49dec6dd-a245-4da9-b8dd-1df89d0e61f2 tempest-GroupSnapshotsTest-1493708790 None] Created volume successfully. Aug 10 15:57:52 devstack sudo[93347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-63c6d754-8278-4e10-a840-d0a646c9a4ba Aug 10 15:57:52 devstack sudo[93347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:53 devstack sudo[93347]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-59210ed1-03de-46c9-8ee9-ece9ae2df1a4 tempest-VolumesTestJSON-963726379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-63c6d754-8278-4e10-a840-d0a646c9a4ba" returned: 0 in 0.424s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-59210ed1-03de-46c9-8ee9-ece9ae2df1a4 tempest-VolumesTestJSON-963726379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-63c6d754-8278-4e10-a840-d0a646c9a4ba {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:53 devstack sudo[93352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-63c6d754-8278-4e10-a840-d0a646c9a4ba Aug 10 15:57:53 devstack sudo[93352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:53 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-65fa7cd0-de3e-4c0f-90e5-d0069c5f9b70 tempest-GroupSnapshotsTest-1493708790 None] GroupSnapshot 5dab4b73-698a-4cba-9b0b-659af9515e75: creating. Aug 10 15:57:53 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-65fa7cd0-de3e-4c0f-90e5-d0069c5f9b70 tempest-GroupSnapshotsTest-1493708790 None] Group snapshot 5dab4b73-698a-4cba-9b0b-659af9515e75: creating. {{(pid=88641) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 10 15:57:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-65fa7cd0-de3e-4c0f-90e5-d0069c5f9b70 tempest-GroupSnapshotsTest-1493708790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:57:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-65fa7cd0-de3e-4c0f-90e5-d0069c5f9b70 tempest-GroupSnapshotsTest-1493708790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:57:53 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-65fa7cd0-de3e-4c0f-90e5-d0069c5f9b70 tempest-GroupSnapshotsTest-1493708790 None] Creating offline snapshot c10061d3-9ecd-4484-b9f5-bda36ee8f2f4 of volume 877b1bce-2521-44d9-83d8-a2d1c32bf448 {{(pid=88641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 15:57:53 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b212a8-26bd-47f4-9c0b-4f1bab570cd1]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 15:57:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-65fa7cd0-de3e-4c0f-90e5-d0069c5f9b70 tempest-GroupSnapshotsTest-1493708790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-877b1bce-2521-44d9-83d8-a2d1c32bf448 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:53 devstack sudo[93354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-877b1bce-2521-44d9-83d8-a2d1c32bf448 Aug 10 15:57:53 devstack sudo[93354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:53 devstack sudo[93352]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-59210ed1-03de-46c9-8ee9-ece9ae2df1a4 tempest-VolumesTestJSON-963726379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-63c6d754-8278-4e10-a840-d0a646c9a4ba" returned: 0 in 0.290s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:53 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-59210ed1-03de-46c9-8ee9-ece9ae2df1a4 tempest-VolumesTestJSON-963726379 None] Lock "cinder-quobyte-63c6d754-8278-4e10-a840-d0a646c9a4ba" released by "delete_volume" :: held 0.781s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 15:57:53 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-59210ed1-03de-46c9-8ee9-ece9ae2df1a4 tempest-VolumesTestJSON-963726379 None] Created reservations ['d8ec469b-892b-485f-a61a-22f89aba6df6', 'd08eaeef-f769-4ff6-b612-7f85eb11fd17', '103348d8-35d6-4209-a913-46f29ba17bc8', 'ec47544d-75d6-43c7-871f-75004f1a33a7'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 15:57:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-59210ed1-03de-46c9-8ee9-ece9ae2df1a4 tempest-VolumesTestJSON-963726379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:57:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-59210ed1-03de-46c9-8ee9-ece9ae2df1a4 tempest-VolumesTestJSON-963726379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:57:53 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-59210ed1-03de-46c9-8ee9-ece9ae2df1a4 tempest-VolumesTestJSON-963726379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 15:57:53 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-59210ed1-03de-46c9-8ee9-ece9ae2df1a4 tempest-VolumesTestJSON-963726379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 15:57:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-59210ed1-03de-46c9-8ee9-ece9ae2df1a4 tempest-VolumesTestJSON-963726379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:57:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-59210ed1-03de-46c9-8ee9-ece9ae2df1a4 tempest-VolumesTestJSON-963726379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:53 devstack sudo[93359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 15:57:53 devstack sudo[93359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:53 devstack sudo[93354]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-65fa7cd0-de3e-4c0f-90e5-d0069c5f9b70 tempest-GroupSnapshotsTest-1493708790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-877b1bce-2521-44d9-83d8-a2d1c32bf448" returned: 0 in 0.501s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-65fa7cd0-de3e-4c0f-90e5-d0069c5f9b70 tempest-GroupSnapshotsTest-1493708790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-877b1bce-2521-44d9-83d8-a2d1c32bf448,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-877b1bce-2521-44d9-83d8-a2d1c32bf448.c10061d3-9ecd-4484-b9f5-bda36ee8f2f4 1G {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:53 devstack sudo[93364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-877b1bce-2521-44d9-83d8-a2d1c32bf448,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-877b1bce-2521-44d9-83d8-a2d1c32bf448.c10061d3-9ecd-4484-b9f5-bda36ee8f2f4 1G Aug 10 15:57:53 devstack sudo[93364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:53 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-349cc8a0-4b59-4c71-b0a4-378c4b869964 tempest-VolumesTestJSON-963726379 None] Acquiring lock "cinder-757dd17a-6098-483b-8c01-3a0b2d7bb340-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 15:57:53 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-349cc8a0-4b59-4c71-b0a4-378c4b869964 tempest-VolumesTestJSON-963726379 None] Lock "cinder-757dd17a-6098-483b-8c01-3a0b2d7bb340-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 15:57:53 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-349cc8a0-4b59-4c71-b0a4-378c4b869964 tempest-VolumesTestJSON-963726379 None] Acquiring lock "cinder-quobyte-757dd17a-6098-483b-8c01-3a0b2d7bb340" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 15:57:53 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-349cc8a0-4b59-4c71-b0a4-378c4b869964 tempest-VolumesTestJSON-963726379 None] Lock "cinder-quobyte-757dd17a-6098-483b-8c01-3a0b2d7bb340" acquired by "delete_volume" :: waited 0.014s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 15:57:53 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5313624-6a76-4f23-92f8-dd55107b3530]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 15:57:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-349cc8a0-4b59-4c71-b0a4-378c4b869964 tempest-VolumesTestJSON-963726379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-757dd17a-6098-483b-8c01-3a0b2d7bb340 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:53 devstack sudo[93359]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-59210ed1-03de-46c9-8ee9-ece9ae2df1a4 tempest-VolumesTestJSON-963726379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.373s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:53 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-59210ed1-03de-46c9-8ee9-ece9ae2df1a4 tempest-VolumesTestJSON-963726379 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 15:57:53 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-59210ed1-03de-46c9-8ee9-ece9ae2df1a4 tempest-VolumesTestJSON-963726379 None] Deleted volume successfully. Aug 10 15:57:53 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-59210ed1-03de-46c9-8ee9-ece9ae2df1a4 tempest-VolumesTestJSON-963726379 None] Lock "cinder-63c6d754-8278-4e10-a840-d0a646c9a4ba-delete_volume" released by "delete_volume" :: held 1.453s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 15:57:54 devstack sudo[93367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-757dd17a-6098-483b-8c01-3a0b2d7bb340 Aug 10 15:57:54 devstack sudo[93367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:54 devstack sudo[93367]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-349cc8a0-4b59-4c71-b0a4-378c4b869964 tempest-VolumesTestJSON-963726379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-757dd17a-6098-483b-8c01-3a0b2d7bb340" returned: 0 in 0.488s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-349cc8a0-4b59-4c71-b0a4-378c4b869964 tempest-VolumesTestJSON-963726379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-757dd17a-6098-483b-8c01-3a0b2d7bb340 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:54 devstack sudo[93364]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-65fa7cd0-de3e-4c0f-90e5-d0069c5f9b70 tempest-GroupSnapshotsTest-1493708790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-877b1bce-2521-44d9-83d8-a2d1c32bf448,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-877b1bce-2521-44d9-83d8-a2d1c32bf448.c10061d3-9ecd-4484-b9f5-bda36ee8f2f4 1G" returned: 0 in 0.683s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-65fa7cd0-de3e-4c0f-90e5-d0069c5f9b70 tempest-GroupSnapshotsTest-1493708790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-877b1bce-2521-44d9-83d8-a2d1c32bf448 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-877b1bce-2521-44d9-83d8-a2d1c32bf448.c10061d3-9ecd-4484-b9f5-bda36ee8f2f4 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:54 devstack sudo[93376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-757dd17a-6098-483b-8c01-3a0b2d7bb340 Aug 10 15:57:54 devstack sudo[93376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:54 devstack sudo[93377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-877b1bce-2521-44d9-83d8-a2d1c32bf448 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-877b1bce-2521-44d9-83d8-a2d1c32bf448.c10061d3-9ecd-4484-b9f5-bda36ee8f2f4 Aug 10 15:57:54 devstack sudo[93377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:54 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a695fee-1fc1-45db-bc12-9e9d623e1e1d tempest-AttachVolumeNegativeTest-115562770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 15:57:54 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9a695fee-1fc1-45db-bc12-9e9d623e1e1d tempest-AttachVolumeNegativeTest-115562770 None] Flow 'volume_create_manager' (9aa3283e-242f-4c38-a06c-9d8c7246b920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 15:57:54 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9a695fee-1fc1-45db-bc12-9e9d623e1e1d tempest-AttachVolumeNegativeTest-115562770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96429c84-6db2-4e63-8a5d-6c9297fced02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:57:54 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9a695fee-1fc1-45db-bc12-9e9d623e1e1d tempest-AttachVolumeNegativeTest-115562770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96429c84-6db2-4e63-8a5d-6c9297fced02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T13:57:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2135933451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06496020-bee6-4dfe-995e-27769de85343,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1ea2d0922df4e428db877fa475d5545',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T13:57:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T13:57:54Z,use_quota=True,user_id='96c1046256454dda9eac6d8c860ab370',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:57:54 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9a695fee-1fc1-45db-bc12-9e9d623e1e1d tempest-AttachVolumeNegativeTest-115562770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40d7356d-52f3-451e-a86d-ee70be9f7fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:57:54 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9a695fee-1fc1-45db-bc12-9e9d623e1e1d tempest-AttachVolumeNegativeTest-115562770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40d7356d-52f3-451e-a86d-ee70be9f7fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:57:54 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9a695fee-1fc1-45db-bc12-9e9d623e1e1d tempest-AttachVolumeNegativeTest-115562770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92fe9a2c-75e0-402c-a7bf-5bcdeffaf4a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:57:54 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9a695fee-1fc1-45db-bc12-9e9d623e1e1d tempest-AttachVolumeNegativeTest-115562770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92fe9a2c-75e0-402c-a7bf-5bcdeffaf4a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06496020-bee6-4dfe-995e-27769de85343', 'volume_name': 'volume-06496020-bee6-4dfe-995e-27769de85343', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:57:54 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9a695fee-1fc1-45db-bc12-9e9d623e1e1d tempest-AttachVolumeNegativeTest-115562770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6279310-3551-4fa8-ae25-6bd54922daec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:57:54 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9a695fee-1fc1-45db-bc12-9e9d623e1e1d tempest-AttachVolumeNegativeTest-115562770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6279310-3551-4fa8-ae25-6bd54922daec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:57:54 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9a695fee-1fc1-45db-bc12-9e9d623e1e1d tempest-AttachVolumeNegativeTest-115562770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86c3924f-fdf5-4c0f-a0a3-3c2f56e3b3b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:57:54 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-9a695fee-1fc1-45db-bc12-9e9d623e1e1d tempest-AttachVolumeNegativeTest-115562770 None] Volume 06496020-bee6-4dfe-995e-27769de85343: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06496020-bee6-4dfe-995e-27769de85343', 'volume_size': 1} Aug 10 15:57:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-9a695fee-1fc1-45db-bc12-9e9d623e1e1d tempest-AttachVolumeNegativeTest-115562770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:57:54 devstack sudo[93376]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-349cc8a0-4b59-4c71-b0a4-378c4b869964 tempest-VolumesTestJSON-963726379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-757dd17a-6098-483b-8c01-3a0b2d7bb340" returned: 0 in 0.373s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:54 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-349cc8a0-4b59-4c71-b0a4-378c4b869964 tempest-VolumesTestJSON-963726379 None] Lock "cinder-quobyte-757dd17a-6098-483b-8c01-3a0b2d7bb340" released by "delete_volume" :: held 0.952s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 15:57:54 devstack sudo[93377]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-65fa7cd0-de3e-4c0f-90e5-d0069c5f9b70 tempest-GroupSnapshotsTest-1493708790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-877b1bce-2521-44d9-83d8-a2d1c32bf448 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-877b1bce-2521-44d9-83d8-a2d1c32bf448.c10061d3-9ecd-4484-b9f5-bda36ee8f2f4" returned: 0 in 0.403s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:54 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-65fa7cd0-de3e-4c0f-90e5-d0069c5f9b70 tempest-GroupSnapshotsTest-1493708790 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-877b1bce-2521-44d9-83d8-a2d1c32bf448.c10061d3-9ecd-4484-b9f5-bda36ee8f2f4 is being set with open permissions: ugo+rw: NotImplementedError Aug 10 15:57:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-65fa7cd0-de3e-4c0f-90e5-d0069c5f9b70 tempest-GroupSnapshotsTest-1493708790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-877b1bce-2521-44d9-83d8-a2d1c32bf448.c10061d3-9ecd-4484-b9f5-bda36ee8f2f4 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:54 devstack sudo[93385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-877b1bce-2521-44d9-83d8-a2d1c32bf448.c10061d3-9ecd-4484-b9f5-bda36ee8f2f4 Aug 10 15:57:54 devstack sudo[93385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:54 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-349cc8a0-4b59-4c71-b0a4-378c4b869964 tempest-VolumesTestJSON-963726379 None] Created reservations ['4219db76-52cb-4d20-9ad9-51264006db54', '3ebb031c-2320-4aea-9de3-cb7cb0f577dd', 'ca0f766a-758d-47b1-975f-80445c72d53d', 'bead4711-2468-495e-87c5-fce49de33a7e'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 15:57:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-349cc8a0-4b59-4c71-b0a4-378c4b869964 tempest-VolumesTestJSON-963726379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:57:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-349cc8a0-4b59-4c71-b0a4-378c4b869964 tempest-VolumesTestJSON-963726379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:57:54 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-349cc8a0-4b59-4c71-b0a4-378c4b869964 tempest-VolumesTestJSON-963726379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 15:57:54 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-349cc8a0-4b59-4c71-b0a4-378c4b869964 tempest-VolumesTestJSON-963726379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 15:57:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-349cc8a0-4b59-4c71-b0a4-378c4b869964 tempest-VolumesTestJSON-963726379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:57:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-349cc8a0-4b59-4c71-b0a4-378c4b869964 tempest-VolumesTestJSON-963726379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:54 devstack sudo[93387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 15:57:54 devstack sudo[93387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:55 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-d7ed3d1a-ac8d-49de-a998-b5e2704426af tempest-VolumesTestJSON-963726379 None] Acquiring lock "cinder-0a4885c9-6eab-4397-85a7-6164a3e4b75e-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 15:57:55 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-d7ed3d1a-ac8d-49de-a998-b5e2704426af tempest-VolumesTestJSON-963726379 None] Lock "cinder-0a4885c9-6eab-4397-85a7-6164a3e4b75e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 15:57:55 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-d7ed3d1a-ac8d-49de-a998-b5e2704426af tempest-VolumesTestJSON-963726379 None] Acquiring lock "cinder-quobyte-0a4885c9-6eab-4397-85a7-6164a3e4b75e" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 15:57:55 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-d7ed3d1a-ac8d-49de-a998-b5e2704426af tempest-VolumesTestJSON-963726379 None] Lock "cinder-quobyte-0a4885c9-6eab-4397-85a7-6164a3e4b75e" acquired by "delete_volume" :: waited 0.019s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 15:57:55 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db8897d-e970-439a-b7c7-7bc55ed2d80e]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 15:57:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d7ed3d1a-ac8d-49de-a998-b5e2704426af tempest-VolumesTestJSON-963726379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-0a4885c9-6eab-4397-85a7-6164a3e4b75e {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:55 devstack sudo[93385]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-65fa7cd0-de3e-4c0f-90e5-d0069c5f9b70 tempest-GroupSnapshotsTest-1493708790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-877b1bce-2521-44d9-83d8-a2d1c32bf448.c10061d3-9ecd-4484-b9f5-bda36ee8f2f4" returned: 0 in 0.387s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-65fa7cd0-de3e-4c0f-90e5-d0069c5f9b70 tempest-GroupSnapshotsTest-1493708790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-877b1bce-2521-44d9-83d8-a2d1c32bf448.info {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:55 devstack sudo[93387]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:55 devstack sudo[93392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-877b1bce-2521-44d9-83d8-a2d1c32bf448.info Aug 10 15:57:55 devstack sudo[93392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-349cc8a0-4b59-4c71-b0a4-378c4b869964 tempest-VolumesTestJSON-963726379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.358s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:55 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-349cc8a0-4b59-4c71-b0a4-378c4b869964 tempest-VolumesTestJSON-963726379 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 15:57:55 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-349cc8a0-4b59-4c71-b0a4-378c4b869964 tempest-VolumesTestJSON-963726379 None] Deleted volume successfully. Aug 10 15:57:55 devstack sudo[93390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-0a4885c9-6eab-4397-85a7-6164a3e4b75e Aug 10 15:57:55 devstack sudo[93390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:55 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-349cc8a0-4b59-4c71-b0a4-378c4b869964 tempest-VolumesTestJSON-963726379 None] Lock "cinder-757dd17a-6098-483b-8c01-3a0b2d7bb340-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 15:57:55 devstack sudo[93392]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-65fa7cd0-de3e-4c0f-90e5-d0069c5f9b70 tempest-GroupSnapshotsTest-1493708790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-877b1bce-2521-44d9-83d8-a2d1c32bf448.info" returned: 0 in 0.351s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:55 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-65fa7cd0-de3e-4c0f-90e5-d0069c5f9b70 tempest-GroupSnapshotsTest-1493708790 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-877b1bce-2521-44d9-83d8-a2d1c32bf448.info is being set with open permissions: ugo+rw: NotImplementedError Aug 10 15:57:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-65fa7cd0-de3e-4c0f-90e5-d0069c5f9b70 tempest-GroupSnapshotsTest-1493708790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-877b1bce-2521-44d9-83d8-a2d1c32bf448.info {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:55 devstack sudo[93398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-877b1bce-2521-44d9-83d8-a2d1c32bf448.info Aug 10 15:57:55 devstack sudo[93398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:55 devstack sudo[93390]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d7ed3d1a-ac8d-49de-a998-b5e2704426af tempest-VolumesTestJSON-963726379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-0a4885c9-6eab-4397-85a7-6164a3e4b75e" returned: 0 in 0.515s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d7ed3d1a-ac8d-49de-a998-b5e2704426af tempest-VolumesTestJSON-963726379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-0a4885c9-6eab-4397-85a7-6164a3e4b75e {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:55 devstack sudo[93401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-0a4885c9-6eab-4397-85a7-6164a3e4b75e Aug 10 15:57:55 devstack sudo[93401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:55 devstack sudo[93398]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-65fa7cd0-de3e-4c0f-90e5-d0069c5f9b70 tempest-GroupSnapshotsTest-1493708790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-877b1bce-2521-44d9-83d8-a2d1c32bf448.info" returned: 0 in 0.278s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-65fa7cd0-de3e-4c0f-90e5-d0069c5f9b70 tempest-GroupSnapshotsTest-1493708790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.700s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:57:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-9a695fee-1fc1-45db-bc12-9e9d623e1e1d tempest-AttachVolumeNegativeTest-115562770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.200s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:57:55 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-9a695fee-1fc1-45db-bc12-9e9d623e1e1d tempest-AttachVolumeNegativeTest-115562770 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T13:57:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2135933451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06496020-bee6-4dfe-995e-27769de85343,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1ea2d0922df4e428db877fa475d5545',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T13:57:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T13:57:54Z,use_quota=True,user_id='96c1046256454dda9eac6d8c860ab370',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 15:57:55 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-9a695fee-1fc1-45db-bc12-9e9d623e1e1d tempest-AttachVolumeNegativeTest-115562770 None] Creating volume 06496020-bee6-4dfe-995e-27769de85343 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 15:57:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-9a695fee-1fc1-45db-bc12-9e9d623e1e1d tempest-AttachVolumeNegativeTest-115562770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:57:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-9a695fee-1fc1-45db-bc12-9e9d623e1e1d tempest-AttachVolumeNegativeTest-115562770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:57:55 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-9a695fee-1fc1-45db-bc12-9e9d623e1e1d tempest-AttachVolumeNegativeTest-115562770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 15:57:55 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-9a695fee-1fc1-45db-bc12-9e9d623e1e1d tempest-AttachVolumeNegativeTest-115562770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 15:57:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-9a695fee-1fc1-45db-bc12-9e9d623e1e1d tempest-AttachVolumeNegativeTest-115562770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:57:55 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-9a695fee-1fc1-45db-bc12-9e9d623e1e1d tempest-AttachVolumeNegativeTest-115562770 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 15:57:55 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-9a695fee-1fc1-45db-bc12-9e9d623e1e1d tempest-AttachVolumeNegativeTest-115562770 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 15:57:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9a695fee-1fc1-45db-bc12-9e9d623e1e1d tempest-AttachVolumeNegativeTest-115562770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-06496020-bee6-4dfe-995e-27769de85343 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:55 devstack sudo[93405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-06496020-bee6-4dfe-995e-27769de85343 1073741824 Aug 10 15:57:55 devstack sudo[93405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:55 devstack sudo[93401]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d7ed3d1a-ac8d-49de-a998-b5e2704426af tempest-VolumesTestJSON-963726379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-0a4885c9-6eab-4397-85a7-6164a3e4b75e" returned: 0 in 0.298s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:56 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-d7ed3d1a-ac8d-49de-a998-b5e2704426af tempest-VolumesTestJSON-963726379 None] Lock "cinder-quobyte-0a4885c9-6eab-4397-85a7-6164a3e4b75e" released by "delete_volume" :: held 0.867s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 15:57:56 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-65fa7cd0-de3e-4c0f-90e5-d0069c5f9b70 tempest-GroupSnapshotsTest-1493708790 None] group_snapshot 5dab4b73-698a-4cba-9b0b-659af9515e75: created successfully Aug 10 15:57:56 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-d7ed3d1a-ac8d-49de-a998-b5e2704426af tempest-VolumesTestJSON-963726379 None] Created reservations ['01cca2db-aa7f-4f2c-817b-187a3d5631ad', '6e976c20-a6e5-45b5-a6d3-9542e9c6a8b0', 'e302b9f1-0b54-4a29-ad74-4c4c4ae338dc', 'c4378a29-86d7-4422-98f7-625a4c4cbc50'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 15:57:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-d7ed3d1a-ac8d-49de-a998-b5e2704426af tempest-VolumesTestJSON-963726379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:57:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-d7ed3d1a-ac8d-49de-a998-b5e2704426af tempest-VolumesTestJSON-963726379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:57:56 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-d7ed3d1a-ac8d-49de-a998-b5e2704426af tempest-VolumesTestJSON-963726379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 15:57:56 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-d7ed3d1a-ac8d-49de-a998-b5e2704426af tempest-VolumesTestJSON-963726379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 15:57:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-d7ed3d1a-ac8d-49de-a998-b5e2704426af tempest-VolumesTestJSON-963726379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:57:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d7ed3d1a-ac8d-49de-a998-b5e2704426af tempest-VolumesTestJSON-963726379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:56 devstack sudo[93409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 15:57:56 devstack sudo[93409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:56 devstack sudo[93409]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d7ed3d1a-ac8d-49de-a998-b5e2704426af tempest-VolumesTestJSON-963726379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.288s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:56 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-d7ed3d1a-ac8d-49de-a998-b5e2704426af tempest-VolumesTestJSON-963726379 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 15:57:56 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-d7ed3d1a-ac8d-49de-a998-b5e2704426af tempest-VolumesTestJSON-963726379 None] Deleted volume successfully. Aug 10 15:57:56 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-d7ed3d1a-ac8d-49de-a998-b5e2704426af tempest-VolumesTestJSON-963726379 None] Lock "cinder-0a4885c9-6eab-4397-85a7-6164a3e4b75e-delete_volume" released by "delete_volume" :: held 1.498s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 15:57:56 devstack sudo[93405]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9a695fee-1fc1-45db-bc12-9e9d623e1e1d tempest-AttachVolumeNegativeTest-115562770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-06496020-bee6-4dfe-995e-27769de85343 1073741824" returned: 0 in 0.662s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9a695fee-1fc1-45db-bc12-9e9d623e1e1d tempest-AttachVolumeNegativeTest-115562770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-06496020-bee6-4dfe-995e-27769de85343 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:56 devstack sudo[93414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-06496020-bee6-4dfe-995e-27769de85343 Aug 10 15:57:56 devstack sudo[93414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:56 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-60a773ed-3c12-4a27-b7e4-21ed5513ab0d tempest-GroupSnapshotsTest-1493708790 None] group_snapshot 5dab4b73-698a-4cba-9b0b-659af9515e75: deleting Aug 10 15:57:56 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-60a773ed-3c12-4a27-b7e4-21ed5513ab0d tempest-GroupSnapshotsTest-1493708790 None] group_snapshot 5dab4b73-698a-4cba-9b0b-659af9515e75: deleting {{(pid=88641) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 10 15:57:56 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-60a773ed-3c12-4a27-b7e4-21ed5513ab0d tempest-GroupSnapshotsTest-1493708790 None] Acquiring lock "cinder-quobyte-877b1bce-2521-44d9-83d8-a2d1c32bf448" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 15:57:56 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-60a773ed-3c12-4a27-b7e4-21ed5513ab0d tempest-GroupSnapshotsTest-1493708790 None] Lock "cinder-quobyte-877b1bce-2521-44d9-83d8-a2d1c32bf448" acquired by "delete_snapshot" :: waited 0.046s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 15:57:56 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-60a773ed-3c12-4a27-b7e4-21ed5513ab0d tempest-GroupSnapshotsTest-1493708790 None] Acquiring lock "cinder-quobyte-c10061d3-9ecd-4484-b9f5-bda36ee8f2f4" by "_delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 15:57:56 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-60a773ed-3c12-4a27-b7e4-21ed5513ab0d tempest-GroupSnapshotsTest-1493708790 None] Lock "cinder-quobyte-c10061d3-9ecd-4484-b9f5-bda36ee8f2f4" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 15:57:56 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-60a773ed-3c12-4a27-b7e4-21ed5513ab0d tempest-GroupSnapshotsTest-1493708790 None] Deleting offline snapshot c10061d3-9ecd-4484-b9f5-bda36ee8f2f4 of volume 877b1bce-2521-44d9-83d8-a2d1c32bf448 {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 15:57:56 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-60a773ed-3c12-4a27-b7e4-21ed5513ab0d tempest-GroupSnapshotsTest-1493708790 None] snapshot_file for this snap is: volume-877b1bce-2521-44d9-83d8-a2d1c32bf448.c10061d3-9ecd-4484-b9f5-bda36ee8f2f4 {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 15:57:56 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba97170d-8e20-4e27-85d2-9db087c2dcea]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 15:57:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-60a773ed-3c12-4a27-b7e4-21ed5513ab0d tempest-GroupSnapshotsTest-1493708790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-877b1bce-2521-44d9-83d8-a2d1c32bf448.c10061d3-9ecd-4484-b9f5-bda36ee8f2f4 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:57 devstack sudo[93414]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9a695fee-1fc1-45db-bc12-9e9d623e1e1d tempest-AttachVolumeNegativeTest-115562770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-06496020-bee6-4dfe-995e-27769de85343" returned: 0 in 0.406s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:57 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-9a695fee-1fc1-45db-bc12-9e9d623e1e1d tempest-AttachVolumeNegativeTest-115562770 None] <== create_volume: return (1135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 15:57:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-9a695fee-1fc1-45db-bc12-9e9d623e1e1d tempest-AttachVolumeNegativeTest-115562770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:57:57 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9a695fee-1fc1-45db-bc12-9e9d623e1e1d tempest-AttachVolumeNegativeTest-115562770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86c3924f-fdf5-4c0f-a0a3-3c2f56e3b3b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06496020-bee6-4dfe-995e-27769de85343', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:57:57 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9a695fee-1fc1-45db-bc12-9e9d623e1e1d tempest-AttachVolumeNegativeTest-115562770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4683a41-d066-42b1-b365-c231944abd02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:57:57 devstack sudo[93417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-877b1bce-2521-44d9-83d8-a2d1c32bf448.c10061d3-9ecd-4484-b9f5-bda36ee8f2f4 Aug 10 15:57:57 devstack sudo[93417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:57 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-9a695fee-1fc1-45db-bc12-9e9d623e1e1d tempest-AttachVolumeNegativeTest-115562770 None] Volume volume-06496020-bee6-4dfe-995e-27769de85343 (06496020-bee6-4dfe-995e-27769de85343): created successfully Aug 10 15:57:57 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9a695fee-1fc1-45db-bc12-9e9d623e1e1d tempest-AttachVolumeNegativeTest-115562770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4683a41-d066-42b1-b365-c231944abd02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:57:57 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9a695fee-1fc1-45db-bc12-9e9d623e1e1d tempest-AttachVolumeNegativeTest-115562770 None] Flow 'volume_create_manager' (9aa3283e-242f-4c38-a06c-9d8c7246b920) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 15:57:57 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-9a695fee-1fc1-45db-bc12-9e9d623e1e1d tempest-AttachVolumeNegativeTest-115562770 None] Created volume successfully. Aug 10 15:57:57 devstack sudo[93417]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-60a773ed-3c12-4a27-b7e4-21ed5513ab0d tempest-GroupSnapshotsTest-1493708790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-877b1bce-2521-44d9-83d8-a2d1c32bf448.c10061d3-9ecd-4484-b9f5-bda36ee8f2f4" returned: 0 in 0.456s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:57 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-60a773ed-3c12-4a27-b7e4-21ed5513ab0d tempest-GroupSnapshotsTest-1493708790 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-877b1bce-2521-44d9-83d8-a2d1c32bf448(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 15:57:57 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa8fa258-6970-4771-a6e3-d64b828aed1d]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 15:57:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-60a773ed-3c12-4a27-b7e4-21ed5513ab0d tempest-GroupSnapshotsTest-1493708790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-877b1bce-2521-44d9-83d8-a2d1c32bf448 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:57 devstack sudo[93423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-877b1bce-2521-44d9-83d8-a2d1c32bf448 Aug 10 15:57:57 devstack sudo[93423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:57 devstack sudo[93423]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-60a773ed-3c12-4a27-b7e4-21ed5513ab0d tempest-GroupSnapshotsTest-1493708790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-877b1bce-2521-44d9-83d8-a2d1c32bf448" returned: 0 in 0.480s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-60a773ed-3c12-4a27-b7e4-21ed5513ab0d tempest-GroupSnapshotsTest-1493708790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-877b1bce-2521-44d9-83d8-a2d1c32bf448.c10061d3-9ecd-4484-b9f5-bda36ee8f2f4 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:57 devstack sudo[93432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-877b1bce-2521-44d9-83d8-a2d1c32bf448.c10061d3-9ecd-4484-b9f5-bda36ee8f2f4 Aug 10 15:57:57 devstack sudo[93432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:58 devstack sudo[93432]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-60a773ed-3c12-4a27-b7e4-21ed5513ab0d tempest-GroupSnapshotsTest-1493708790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-877b1bce-2521-44d9-83d8-a2d1c32bf448.c10061d3-9ecd-4484-b9f5-bda36ee8f2f4" returned: 0 in 0.509s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-60a773ed-3c12-4a27-b7e4-21ed5513ab0d tempest-GroupSnapshotsTest-1493708790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-877b1bce-2521-44d9-83d8-a2d1c32bf448.c10061d3-9ecd-4484-b9f5-bda36ee8f2f4 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:58 devstack sudo[93440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-877b1bce-2521-44d9-83d8-a2d1c32bf448.c10061d3-9ecd-4484-b9f5-bda36ee8f2f4 Aug 10 15:57:58 devstack sudo[93440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:57:58 devstack sudo[93440]: pam_unix(sudo:session): session closed for user root Aug 10 15:57:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-3e1b6cef-649a-46e2-93ff-e47d3038e9e3 req-aa6cdb59-f064-479d-852f-2efba2cf3141 tempest-AttachVolumeNegativeTest-115562770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:57:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-3e1b6cef-649a-46e2-93ff-e47d3038e9e3 req-aa6cdb59-f064-479d-852f-2efba2cf3141 tempest-AttachVolumeNegativeTest-115562770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:57:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-60a773ed-3c12-4a27-b7e4-21ed5513ab0d tempest-GroupSnapshotsTest-1493708790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-877b1bce-2521-44d9-83d8-a2d1c32bf448.c10061d3-9ecd-4484-b9f5-bda36ee8f2f4" returned: 0 in 0.292s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:57:58 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-60a773ed-3c12-4a27-b7e4-21ed5513ab0d tempest-GroupSnapshotsTest-1493708790 None] Lock "cinder-quobyte-c10061d3-9ecd-4484-b9f5-bda36ee8f2f4" released by "_delete_snapshot" :: held 1.898s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 15:57:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-3e1b6cef-649a-46e2-93ff-e47d3038e9e3 req-aa6cdb59-f064-479d-852f-2efba2cf3141 tempest-AttachVolumeNegativeTest-115562770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.048s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:57:58 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-60a773ed-3c12-4a27-b7e4-21ed5513ab0d tempest-GroupSnapshotsTest-1493708790 None] Lock "cinder-quobyte-877b1bce-2521-44d9-83d8-a2d1c32bf448" released by "delete_snapshot" :: held 1.943s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 15:57:58 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [req-3e1b6cef-649a-46e2-93ff-e47d3038e9e3 req-aa6cdb59-f064-479d-852f-2efba2cf3141 tempest-AttachVolumeNegativeTest-115562770 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc', 'name': 'volume-06496020-bee6-4dfe-995e-27769de85343', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '12f3a4fa-059e-446c-a53f-9157eb3ca6d9', 'enforce_multipath': True} {{(pid=88641) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 10 15:57:58 devstack cinder-volume[88641]: WARNING cinder.quota [None req-60a773ed-3c12-4a27-b7e4-21ed5513ab0d tempest-GroupSnapshotsTest-1493708790 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-211150529 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-211150529, it is now deprecated. Please use the default quota class for default quota. Aug 10 15:57:58 devstack cinder-volume[88641]: WARNING cinder.quota [None req-60a773ed-3c12-4a27-b7e4-21ed5513ab0d tempest-GroupSnapshotsTest-1493708790 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-211150529 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-211150529, it is now deprecated. Please use the default quota class for default quota. Aug 10 15:57:58 devstack cinder-volume[88641]: INFO cinder.volume.manager [req-3e1b6cef-649a-46e2-93ff-e47d3038e9e3 req-aa6cdb59-f064-479d-852f-2efba2cf3141 tempest-AttachVolumeNegativeTest-115562770 None] attachment_update completed successfully. Aug 10 15:57:58 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-60a773ed-3c12-4a27-b7e4-21ed5513ab0d tempest-GroupSnapshotsTest-1493708790 None] Created reservations ['a13a4026-6fc1-4001-aeae-6bd5b0acf271', '7416e2b3-e48f-424a-99dd-71627ba863c5', 'acf94ca2-258c-4df3-9371-3dbe0521231f', 'a3b7ac35-8101-4804-9255-5979d542d4dc'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 15:57:59 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-60a773ed-3c12-4a27-b7e4-21ed5513ab0d tempest-GroupSnapshotsTest-1493708790 None] group_snapshot 5dab4b73-698a-4cba-9b0b-659af9515e75: deleted successfully Aug 10 15:57:59 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-0f728476-5965-4124-a30e-0c5089918c33 tempest-GroupSnapshotsTest-1493708790 None] Acquiring lock "cinder-quobyte-877b1bce-2521-44d9-83d8-a2d1c32bf448" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 15:57:59 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-0f728476-5965-4124-a30e-0c5089918c33 tempest-GroupSnapshotsTest-1493708790 None] Lock "cinder-quobyte-877b1bce-2521-44d9-83d8-a2d1c32bf448" acquired by "delete_volume" :: waited 0.020s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 15:57:59 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[11d723f9-5ccf-41d3-8556-1468d39064c0]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 15:57:59 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0f728476-5965-4124-a30e-0c5089918c33 tempest-GroupSnapshotsTest-1493708790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-877b1bce-2521-44d9-83d8-a2d1c32bf448 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:57:59 devstack sudo[93836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-877b1bce-2521-44d9-83d8-a2d1c32bf448 Aug 10 15:57:59 devstack sudo[93836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:58:00 devstack sudo[93836]: pam_unix(sudo:session): session closed for user root Aug 10 15:58:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0f728476-5965-4124-a30e-0c5089918c33 tempest-GroupSnapshotsTest-1493708790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-877b1bce-2521-44d9-83d8-a2d1c32bf448" returned: 0 in 0.478s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:58:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0f728476-5965-4124-a30e-0c5089918c33 tempest-GroupSnapshotsTest-1493708790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-877b1bce-2521-44d9-83d8-a2d1c32bf448 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:58:00 devstack sudo[93841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-877b1bce-2521-44d9-83d8-a2d1c32bf448 Aug 10 15:58:00 devstack sudo[93841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:58:00 devstack sudo[93841]: pam_unix(sudo:session): session closed for user root Aug 10 15:58:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0f728476-5965-4124-a30e-0c5089918c33 tempest-GroupSnapshotsTest-1493708790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-877b1bce-2521-44d9-83d8-a2d1c32bf448" returned: 0 in 0.289s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:58:00 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-0f728476-5965-4124-a30e-0c5089918c33 tempest-GroupSnapshotsTest-1493708790 None] Lock "cinder-quobyte-877b1bce-2521-44d9-83d8-a2d1c32bf448" released by "delete_volume" :: held 0.853s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 15:58:00 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-0f728476-5965-4124-a30e-0c5089918c33 tempest-GroupSnapshotsTest-1493708790 None] Created reservations ['587e4c5b-1693-490d-879a-4e44556b4a36'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 15:58:00 devstack cinder-volume[88641]: WARNING cinder.quota [None req-0f728476-5965-4124-a30e-0c5089918c33 tempest-GroupSnapshotsTest-1493708790 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-211150529 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-211150529, it is now deprecated. Please use the default quota class for default quota. Aug 10 15:58:00 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-0f728476-5965-4124-a30e-0c5089918c33 tempest-GroupSnapshotsTest-1493708790 None] Created reservations ['e0ef4ea4-23b2-444a-b12e-2555987b6629', 'c5629261-07e1-43a2-8922-3cabe67abf5e', '2e331018-e5b9-4913-aaaa-11f8836f7de2', '90120d69-495e-4ba2-b270-249f61309e7c'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 15:58:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-0f728476-5965-4124-a30e-0c5089918c33 tempest-GroupSnapshotsTest-1493708790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:58:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-0f728476-5965-4124-a30e-0c5089918c33 tempest-GroupSnapshotsTest-1493708790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:58:00 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-0f728476-5965-4124-a30e-0c5089918c33 tempest-GroupSnapshotsTest-1493708790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 15:58:00 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-0f728476-5965-4124-a30e-0c5089918c33 tempest-GroupSnapshotsTest-1493708790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 15:58:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-0f728476-5965-4124-a30e-0c5089918c33 tempest-GroupSnapshotsTest-1493708790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:58:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0f728476-5965-4124-a30e-0c5089918c33 tempest-GroupSnapshotsTest-1493708790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:58:00 devstack sudo[93847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 15:58:00 devstack sudo[93847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:58:01 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2cbad394-b161-46b2-85b9-38d56f5864b8 tempest-BackendsCapabilitiesAdminTestsJSON-1777951904 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7576522827148, 'free_capacity_gb': 1775.7576522827148, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88641) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 10 15:58:01 devstack sudo[93847]: pam_unix(sudo:session): session closed for user root Aug 10 15:58:01 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0f728476-5965-4124-a30e-0c5089918c33 tempest-GroupSnapshotsTest-1493708790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.370s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:58:01 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-0f728476-5965-4124-a30e-0c5089918c33 tempest-GroupSnapshotsTest-1493708790 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 15:58:01 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-0f728476-5965-4124-a30e-0c5089918c33 tempest-GroupSnapshotsTest-1493708790 None] Delete group completed successfully. Aug 10 15:58:01 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d4b80b6c-78fd-4d6b-9f56-fec54815a0d0 tempest-BackendsCapabilitiesAdminTestsJSON-1777951904 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7576522827148, 'free_capacity_gb': 1775.7576522827148, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88641) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 10 15:58:10 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-57808c07-22df-4f70-9fbc-450ce345279d tempest-GroupsV320Test-724716667 None] Group tempest-GroupsV320Test-Group-1885089889: creating Aug 10 15:58:10 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-57808c07-22df-4f70-9fbc-450ce345279d tempest-GroupsV320Test-724716667 None] Group tempest-GroupsV320Test-Group-1885089889: created successfully Aug 10 15:58:10 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-57808c07-22df-4f70-9fbc-450ce345279d tempest-GroupsV320Test-724716667 None] Create group completed successfully. Aug 10 15:58:12 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-6020391a-e3b2-4b2b-9878-85b3579d7778 tempest-GroupsV320Test-724716667 None] Created reservations ['d3e108da-0465-4e96-a39a-205f2cfc8fcf'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 15:58:12 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-6020391a-e3b2-4b2b-9878-85b3579d7778 tempest-GroupsV320Test-724716667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:58:12 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-6020391a-e3b2-4b2b-9878-85b3579d7778 tempest-GroupsV320Test-724716667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:58:12 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-6020391a-e3b2-4b2b-9878-85b3579d7778 tempest-GroupsV320Test-724716667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 15:58:12 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-6020391a-e3b2-4b2b-9878-85b3579d7778 tempest-GroupsV320Test-724716667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 15:58:12 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-6020391a-e3b2-4b2b-9878-85b3579d7778 tempest-GroupsV320Test-724716667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:58:12 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6020391a-e3b2-4b2b-9878-85b3579d7778 tempest-GroupsV320Test-724716667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:58:12 devstack sudo[93987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 15:58:12 devstack sudo[93987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:58:13 devstack sudo[93987]: pam_unix(sudo:session): session closed for user root Aug 10 15:58:13 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6020391a-e3b2-4b2b-9878-85b3579d7778 tempest-GroupsV320Test-724716667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.454s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:58:13 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-6020391a-e3b2-4b2b-9878-85b3579d7778 tempest-GroupsV320Test-724716667 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 15:58:13 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-6020391a-e3b2-4b2b-9878-85b3579d7778 tempest-GroupsV320Test-724716667 None] Delete group completed successfully. Aug 10 15:58:22 devstack cinder-volume[88641]: DEBUG dbcounter [-] [88641] Writing DB stats cinder:SELECT=113,cinder:UPDATE=112,cinder:INSERT=28,cinder:DELETE=2 {{(pid=88641) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 15:58:22 devstack cinder-volume[88641]: DEBUG dbcounter [-] [88641] Writing DB stats cinder:SELECT=90,cinder:UPDATE=108,cinder:INSERT=24,cinder:DELETE=8 {{(pid=88641) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 15:58:30 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c9aeb75-7779-44fc-b0db-147187310eae tempest-VolumesServicesTestJSON-2098603713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 15:58:30 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2c9aeb75-7779-44fc-b0db-147187310eae tempest-VolumesServicesTestJSON-2098603713 None] Flow 'volume_create_manager' (2031b862-8660-44b6-a672-9f8944fbd612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 15:58:30 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2c9aeb75-7779-44fc-b0db-147187310eae tempest-VolumesServicesTestJSON-2098603713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1885e976-0191-45c2-be97-3c2111103b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:58:30 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2c9aeb75-7779-44fc-b0db-147187310eae tempest-VolumesServicesTestJSON-2098603713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1885e976-0191-45c2-be97-3c2111103b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T13:58:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1723118066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b70e91e8-13ae-4e30-bcfb-1a7eaf15bfd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6be113946ee434baf7ebfbd8a63fbff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T13:58:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T13:58:30Z,use_quota=True,user_id='05eb4f5a38de41109edb68376dc8e42e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:58:30 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2c9aeb75-7779-44fc-b0db-147187310eae tempest-VolumesServicesTestJSON-2098603713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccb2e3b8-0737-492f-8905-9e882413c97b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:58:30 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2c9aeb75-7779-44fc-b0db-147187310eae tempest-VolumesServicesTestJSON-2098603713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccb2e3b8-0737-492f-8905-9e882413c97b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:58:30 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2c9aeb75-7779-44fc-b0db-147187310eae tempest-VolumesServicesTestJSON-2098603713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30521536-1f4f-43ab-ace6-d278a7537924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:58:30 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2c9aeb75-7779-44fc-b0db-147187310eae tempest-VolumesServicesTestJSON-2098603713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30521536-1f4f-43ab-ace6-d278a7537924) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b70e91e8-13ae-4e30-bcfb-1a7eaf15bfd3', 'volume_name': 'volume-b70e91e8-13ae-4e30-bcfb-1a7eaf15bfd3', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:58:30 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2c9aeb75-7779-44fc-b0db-147187310eae tempest-VolumesServicesTestJSON-2098603713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (077fda10-0c83-49c1-a8c0-a34b6267d36a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:58:30 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2c9aeb75-7779-44fc-b0db-147187310eae tempest-VolumesServicesTestJSON-2098603713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (077fda10-0c83-49c1-a8c0-a34b6267d36a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:58:30 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2c9aeb75-7779-44fc-b0db-147187310eae tempest-VolumesServicesTestJSON-2098603713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b8efe2f-20d6-4b86-b1b2-5eb0286575b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:58:30 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-2c9aeb75-7779-44fc-b0db-147187310eae tempest-VolumesServicesTestJSON-2098603713 None] Volume b70e91e8-13ae-4e30-bcfb-1a7eaf15bfd3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b70e91e8-13ae-4e30-bcfb-1a7eaf15bfd3', 'volume_size': 1} Aug 10 15:58:30 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-2c9aeb75-7779-44fc-b0db-147187310eae tempest-VolumesServicesTestJSON-2098603713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:58:30 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-2c9aeb75-7779-44fc-b0db-147187310eae tempest-VolumesServicesTestJSON-2098603713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:58:30 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-2c9aeb75-7779-44fc-b0db-147187310eae tempest-VolumesServicesTestJSON-2098603713 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T13:58:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1723118066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b70e91e8-13ae-4e30-bcfb-1a7eaf15bfd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6be113946ee434baf7ebfbd8a63fbff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T13:58:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T13:58:30Z,use_quota=True,user_id='05eb4f5a38de41109edb68376dc8e42e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 15:58:30 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-2c9aeb75-7779-44fc-b0db-147187310eae tempest-VolumesServicesTestJSON-2098603713 None] Creating volume b70e91e8-13ae-4e30-bcfb-1a7eaf15bfd3 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 15:58:30 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-2c9aeb75-7779-44fc-b0db-147187310eae tempest-VolumesServicesTestJSON-2098603713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:58:30 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-2c9aeb75-7779-44fc-b0db-147187310eae tempest-VolumesServicesTestJSON-2098603713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:58:30 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-2c9aeb75-7779-44fc-b0db-147187310eae tempest-VolumesServicesTestJSON-2098603713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 15:58:30 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-2c9aeb75-7779-44fc-b0db-147187310eae tempest-VolumesServicesTestJSON-2098603713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 15:58:30 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-2c9aeb75-7779-44fc-b0db-147187310eae tempest-VolumesServicesTestJSON-2098603713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:58:30 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-2c9aeb75-7779-44fc-b0db-147187310eae tempest-VolumesServicesTestJSON-2098603713 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 15:58:30 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-2c9aeb75-7779-44fc-b0db-147187310eae tempest-VolumesServicesTestJSON-2098603713 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 15:58:30 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-2c9aeb75-7779-44fc-b0db-147187310eae tempest-VolumesServicesTestJSON-2098603713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b70e91e8-13ae-4e30-bcfb-1a7eaf15bfd3 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:58:30 devstack sudo[94129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b70e91e8-13ae-4e30-bcfb-1a7eaf15bfd3 1073741824 Aug 10 15:58:30 devstack sudo[94129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:58:31 devstack sudo[94129]: pam_unix(sudo:session): session closed for user root Aug 10 15:58:31 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-2c9aeb75-7779-44fc-b0db-147187310eae tempest-VolumesServicesTestJSON-2098603713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b70e91e8-13ae-4e30-bcfb-1a7eaf15bfd3 1073741824" returned: 0 in 0.572s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:58:31 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-2c9aeb75-7779-44fc-b0db-147187310eae tempest-VolumesServicesTestJSON-2098603713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b70e91e8-13ae-4e30-bcfb-1a7eaf15bfd3 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:58:31 devstack sudo[94174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b70e91e8-13ae-4e30-bcfb-1a7eaf15bfd3 Aug 10 15:58:31 devstack sudo[94174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:58:31 devstack sudo[94174]: pam_unix(sudo:session): session closed for user root Aug 10 15:58:31 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-2c9aeb75-7779-44fc-b0db-147187310eae tempest-VolumesServicesTestJSON-2098603713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b70e91e8-13ae-4e30-bcfb-1a7eaf15bfd3" returned: 0 in 0.291s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:58:31 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-2c9aeb75-7779-44fc-b0db-147187310eae tempest-VolumesServicesTestJSON-2098603713 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 15:58:31 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-2c9aeb75-7779-44fc-b0db-147187310eae tempest-VolumesServicesTestJSON-2098603713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:58:31 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2c9aeb75-7779-44fc-b0db-147187310eae tempest-VolumesServicesTestJSON-2098603713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b8efe2f-20d6-4b86-b1b2-5eb0286575b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b70e91e8-13ae-4e30-bcfb-1a7eaf15bfd3', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:58:31 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2c9aeb75-7779-44fc-b0db-147187310eae tempest-VolumesServicesTestJSON-2098603713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a160f30-d1e3-4c7e-9136-167752261fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:58:31 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-2c9aeb75-7779-44fc-b0db-147187310eae tempest-VolumesServicesTestJSON-2098603713 None] Volume volume-b70e91e8-13ae-4e30-bcfb-1a7eaf15bfd3 (b70e91e8-13ae-4e30-bcfb-1a7eaf15bfd3): created successfully Aug 10 15:58:31 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2c9aeb75-7779-44fc-b0db-147187310eae tempest-VolumesServicesTestJSON-2098603713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a160f30-d1e3-4c7e-9136-167752261fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:58:31 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2c9aeb75-7779-44fc-b0db-147187310eae tempest-VolumesServicesTestJSON-2098603713 None] Flow 'volume_create_manager' (2031b862-8660-44b6-a672-9f8944fbd612) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 15:58:31 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-2c9aeb75-7779-44fc-b0db-147187310eae tempest-VolumesServicesTestJSON-2098603713 None] Created volume successfully. Aug 10 15:58:31 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-70a0f0bc-08ae-4c1d-87ff-52e712e962a6 tempest-VolumeTypesAccessTest-260937957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 15:58:31 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-70a0f0bc-08ae-4c1d-87ff-52e712e962a6 tempest-VolumeTypesAccessTest-260937957 None] Flow 'volume_create_manager' (63092e08-efc0-483c-814a-ec6700f2d3b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 15:58:31 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-70a0f0bc-08ae-4c1d-87ff-52e712e962a6 tempest-VolumeTypesAccessTest-260937957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f2d5999-724f-4fd3-a312-4430dedf941c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:58:32 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-70a0f0bc-08ae-4c1d-87ff-52e712e962a6 tempest-VolumeTypesAccessTest-260937957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f2d5999-724f-4fd3-a312-4430dedf941c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T13:58:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-541053496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bbd4541-9c87-425b-b4e6-008ce633d996,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b134b6264654b1a93ae31c8b703a9c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T13:58:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T13:58:32Z,use_quota=True,user_id='8583f9d2d1aa4e728fd159f08cda770f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e01882b5-b332-49c7-aa30-749c7e1365c2),volume_type_id=e01882b5-b332-49c7-aa30-749c7e1365c2)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:58:32 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-70a0f0bc-08ae-4c1d-87ff-52e712e962a6 tempest-VolumeTypesAccessTest-260937957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cebb24f-7e1b-4712-a657-b2e84f8823ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:58:32 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-70a0f0bc-08ae-4c1d-87ff-52e712e962a6 tempest-VolumeTypesAccessTest-260937957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cebb24f-7e1b-4712-a657-b2e84f8823ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:58:32 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-70a0f0bc-08ae-4c1d-87ff-52e712e962a6 tempest-VolumeTypesAccessTest-260937957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1630ee7c-385a-40c8-a29f-2a3cb89b6d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:58:32 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-70a0f0bc-08ae-4c1d-87ff-52e712e962a6 tempest-VolumeTypesAccessTest-260937957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1630ee7c-385a-40c8-a29f-2a3cb89b6d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bbd4541-9c87-425b-b4e6-008ce633d996', 'volume_name': 'volume-2bbd4541-9c87-425b-b4e6-008ce633d996', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:58:32 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-70a0f0bc-08ae-4c1d-87ff-52e712e962a6 tempest-VolumeTypesAccessTest-260937957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3248f313-2a8a-46bc-b304-3ba0b153a410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:58:32 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-70a0f0bc-08ae-4c1d-87ff-52e712e962a6 tempest-VolumeTypesAccessTest-260937957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3248f313-2a8a-46bc-b304-3ba0b153a410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:58:32 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-70a0f0bc-08ae-4c1d-87ff-52e712e962a6 tempest-VolumeTypesAccessTest-260937957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72605221-8537-4147-bdd3-80e464ef38e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:58:32 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-70a0f0bc-08ae-4c1d-87ff-52e712e962a6 tempest-VolumeTypesAccessTest-260937957 None] Volume 2bbd4541-9c87-425b-b4e6-008ce633d996: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bbd4541-9c87-425b-b4e6-008ce633d996', 'volume_size': 1} Aug 10 15:58:32 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-70a0f0bc-08ae-4c1d-87ff-52e712e962a6 tempest-VolumeTypesAccessTest-260937957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:58:32 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-70a0f0bc-08ae-4c1d-87ff-52e712e962a6 tempest-VolumeTypesAccessTest-260937957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:58:32 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-70a0f0bc-08ae-4c1d-87ff-52e712e962a6 tempest-VolumeTypesAccessTest-260937957 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T13:58:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-541053496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bbd4541-9c87-425b-b4e6-008ce633d996,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b134b6264654b1a93ae31c8b703a9c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T13:58:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T13:58:32Z,use_quota=True,user_id='8583f9d2d1aa4e728fd159f08cda770f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e01882b5-b332-49c7-aa30-749c7e1365c2),volume_type_id=e01882b5-b332-49c7-aa30-749c7e1365c2)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 15:58:32 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-70a0f0bc-08ae-4c1d-87ff-52e712e962a6 tempest-VolumeTypesAccessTest-260937957 None] Creating volume 2bbd4541-9c87-425b-b4e6-008ce633d996 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 15:58:32 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-70a0f0bc-08ae-4c1d-87ff-52e712e962a6 tempest-VolumeTypesAccessTest-260937957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:58:32 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-70a0f0bc-08ae-4c1d-87ff-52e712e962a6 tempest-VolumeTypesAccessTest-260937957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:58:32 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-70a0f0bc-08ae-4c1d-87ff-52e712e962a6 tempest-VolumeTypesAccessTest-260937957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 15:58:32 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-70a0f0bc-08ae-4c1d-87ff-52e712e962a6 tempest-VolumeTypesAccessTest-260937957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 15:58:32 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-70a0f0bc-08ae-4c1d-87ff-52e712e962a6 tempest-VolumeTypesAccessTest-260937957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:58:32 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-70a0f0bc-08ae-4c1d-87ff-52e712e962a6 tempest-VolumeTypesAccessTest-260937957 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 15:58:32 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-70a0f0bc-08ae-4c1d-87ff-52e712e962a6 tempest-VolumeTypesAccessTest-260937957 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 15:58:32 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-70a0f0bc-08ae-4c1d-87ff-52e712e962a6 tempest-VolumeTypesAccessTest-260937957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2bbd4541-9c87-425b-b4e6-008ce633d996 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:58:32 devstack sudo[94178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2bbd4541-9c87-425b-b4e6-008ce633d996 1073741824 Aug 10 15:58:32 devstack sudo[94178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:58:32 devstack sudo[94178]: pam_unix(sudo:session): session closed for user root Aug 10 15:58:32 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-70a0f0bc-08ae-4c1d-87ff-52e712e962a6 tempest-VolumeTypesAccessTest-260937957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2bbd4541-9c87-425b-b4e6-008ce633d996 1073741824" returned: 0 in 0.501s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:58:32 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-9e36c75f-140e-420e-ab88-577b010adcc7 tempest-VolumesServicesTestJSON-2098603713 None] Acquiring lock "cinder-b70e91e8-13ae-4e30-bcfb-1a7eaf15bfd3-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 15:58:32 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-70a0f0bc-08ae-4c1d-87ff-52e712e962a6 tempest-VolumeTypesAccessTest-260937957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2bbd4541-9c87-425b-b4e6-008ce633d996 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:58:32 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-9e36c75f-140e-420e-ab88-577b010adcc7 tempest-VolumesServicesTestJSON-2098603713 None] Lock "cinder-b70e91e8-13ae-4e30-bcfb-1a7eaf15bfd3-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 15:58:32 devstack sudo[94188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2bbd4541-9c87-425b-b4e6-008ce633d996 Aug 10 15:58:32 devstack sudo[94188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:58:32 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-9e36c75f-140e-420e-ab88-577b010adcc7 tempest-VolumesServicesTestJSON-2098603713 None] Acquiring lock "cinder-quobyte-b70e91e8-13ae-4e30-bcfb-1a7eaf15bfd3" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 15:58:32 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-9e36c75f-140e-420e-ab88-577b010adcc7 tempest-VolumesServicesTestJSON-2098603713 None] Lock "cinder-quobyte-b70e91e8-13ae-4e30-bcfb-1a7eaf15bfd3" acquired by "delete_volume" :: waited 0.015s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 15:58:32 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e96fc8-bac7-491b-aa4d-34baabdc9428]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 15:58:32 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9e36c75f-140e-420e-ab88-577b010adcc7 tempest-VolumesServicesTestJSON-2098603713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b70e91e8-13ae-4e30-bcfb-1a7eaf15bfd3 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:58:32 devstack sudo[94190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b70e91e8-13ae-4e30-bcfb-1a7eaf15bfd3 Aug 10 15:58:32 devstack sudo[94190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:58:32 devstack sudo[94188]: pam_unix(sudo:session): session closed for user root Aug 10 15:58:32 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-70a0f0bc-08ae-4c1d-87ff-52e712e962a6 tempest-VolumeTypesAccessTest-260937957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2bbd4541-9c87-425b-b4e6-008ce633d996" returned: 0 in 0.286s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:58:32 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-70a0f0bc-08ae-4c1d-87ff-52e712e962a6 tempest-VolumeTypesAccessTest-260937957 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 15:58:32 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-70a0f0bc-08ae-4c1d-87ff-52e712e962a6 tempest-VolumeTypesAccessTest-260937957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:58:32 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-70a0f0bc-08ae-4c1d-87ff-52e712e962a6 tempest-VolumeTypesAccessTest-260937957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72605221-8537-4147-bdd3-80e464ef38e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bbd4541-9c87-425b-b4e6-008ce633d996', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:58:32 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-70a0f0bc-08ae-4c1d-87ff-52e712e962a6 tempest-VolumeTypesAccessTest-260937957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (371f1c5b-cf28-4500-b077-3cb688fed5fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:58:32 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-70a0f0bc-08ae-4c1d-87ff-52e712e962a6 tempest-VolumeTypesAccessTest-260937957 None] Volume volume-2bbd4541-9c87-425b-b4e6-008ce633d996 (2bbd4541-9c87-425b-b4e6-008ce633d996): created successfully Aug 10 15:58:32 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-70a0f0bc-08ae-4c1d-87ff-52e712e962a6 tempest-VolumeTypesAccessTest-260937957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (371f1c5b-cf28-4500-b077-3cb688fed5fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:58:32 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-70a0f0bc-08ae-4c1d-87ff-52e712e962a6 tempest-VolumeTypesAccessTest-260937957 None] Flow 'volume_create_manager' (63092e08-efc0-483c-814a-ec6700f2d3b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 15:58:32 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-70a0f0bc-08ae-4c1d-87ff-52e712e962a6 tempest-VolumeTypesAccessTest-260937957 None] Created volume successfully. Aug 10 15:58:33 devstack sudo[94190]: pam_unix(sudo:session): session closed for user root Aug 10 15:58:33 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9e36c75f-140e-420e-ab88-577b010adcc7 tempest-VolumesServicesTestJSON-2098603713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b70e91e8-13ae-4e30-bcfb-1a7eaf15bfd3" returned: 0 in 0.386s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:58:33 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9e36c75f-140e-420e-ab88-577b010adcc7 tempest-VolumesServicesTestJSON-2098603713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b70e91e8-13ae-4e30-bcfb-1a7eaf15bfd3 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:58:33 devstack sudo[94197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b70e91e8-13ae-4e30-bcfb-1a7eaf15bfd3 Aug 10 15:58:33 devstack sudo[94197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:58:33 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd2664bc-757c-4899-a828-bf4826a1eacf tempest-ServerActionsTestOtherA-603942358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 15:58:33 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-cd2664bc-757c-4899-a828-bf4826a1eacf tempest-ServerActionsTestOtherA-603942358 None] Flow 'volume_create_manager' (81f94bdd-3231-49e6-b3b9-f08ff8a9fd4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 15:58:33 devstack sudo[94197]: pam_unix(sudo:session): session closed for user root Aug 10 15:58:33 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-cd2664bc-757c-4899-a828-bf4826a1eacf tempest-ServerActionsTestOtherA-603942358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (128dd8e2-3b87-4a35-9cc1-7ffaec6de766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:58:33 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9e36c75f-140e-420e-ab88-577b010adcc7 tempest-VolumesServicesTestJSON-2098603713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b70e91e8-13ae-4e30-bcfb-1a7eaf15bfd3" returned: 0 in 0.265s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:58:33 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-cd2664bc-757c-4899-a828-bf4826a1eacf tempest-ServerActionsTestOtherA-603942358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (128dd8e2-3b87-4a35-9cc1-7ffaec6de766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T13:58:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-2015930616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93d9738d-5344-4405-b96b-e31d4c227d5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03078de0c6d743b39bc32b527af6f07c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T13:58:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T13:58:33Z,use_quota=True,user_id='f91a8a33d77e4544805d3c8ea355f55a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:58:33 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-cd2664bc-757c-4899-a828-bf4826a1eacf tempest-ServerActionsTestOtherA-603942358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d002324a-677c-4198-a690-39e5895591a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:58:33 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-cd2664bc-757c-4899-a828-bf4826a1eacf tempest-ServerActionsTestOtherA-603942358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d002324a-677c-4198-a690-39e5895591a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:58:33 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-cd2664bc-757c-4899-a828-bf4826a1eacf tempest-ServerActionsTestOtherA-603942358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72eadf65-6c2f-4dbe-920e-8e24501ccee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:58:33 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-cd2664bc-757c-4899-a828-bf4826a1eacf tempest-ServerActionsTestOtherA-603942358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72eadf65-6c2f-4dbe-920e-8e24501ccee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93d9738d-5344-4405-b96b-e31d4c227d5f', 'volume_name': 'volume-93d9738d-5344-4405-b96b-e31d4c227d5f', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:58:33 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-cd2664bc-757c-4899-a828-bf4826a1eacf tempest-ServerActionsTestOtherA-603942358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d39de353-f4dd-4c6c-90a8-e43c4a400bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:58:33 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-cd2664bc-757c-4899-a828-bf4826a1eacf tempest-ServerActionsTestOtherA-603942358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d39de353-f4dd-4c6c-90a8-e43c4a400bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:58:33 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-cd2664bc-757c-4899-a828-bf4826a1eacf tempest-ServerActionsTestOtherA-603942358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10c605f4-864f-476b-b7ea-baf6aedf5e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:58:33 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-cd2664bc-757c-4899-a828-bf4826a1eacf tempest-ServerActionsTestOtherA-603942358 None] Volume 93d9738d-5344-4405-b96b-e31d4c227d5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93d9738d-5344-4405-b96b-e31d4c227d5f', 'volume_size': 1} Aug 10 15:58:33 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-cd2664bc-757c-4899-a828-bf4826a1eacf tempest-ServerActionsTestOtherA-603942358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:58:33 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-cd2664bc-757c-4899-a828-bf4826a1eacf tempest-ServerActionsTestOtherA-603942358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:58:33 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-cd2664bc-757c-4899-a828-bf4826a1eacf tempest-ServerActionsTestOtherA-603942358 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T13:58:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-2015930616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93d9738d-5344-4405-b96b-e31d4c227d5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03078de0c6d743b39bc32b527af6f07c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T13:58:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T13:58:33Z,use_quota=True,user_id='f91a8a33d77e4544805d3c8ea355f55a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 15:58:33 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-cd2664bc-757c-4899-a828-bf4826a1eacf tempest-ServerActionsTestOtherA-603942358 None] Creating volume 93d9738d-5344-4405-b96b-e31d4c227d5f {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 15:58:33 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-cd2664bc-757c-4899-a828-bf4826a1eacf tempest-ServerActionsTestOtherA-603942358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:58:33 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-cd2664bc-757c-4899-a828-bf4826a1eacf tempest-ServerActionsTestOtherA-603942358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:58:33 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-cd2664bc-757c-4899-a828-bf4826a1eacf tempest-ServerActionsTestOtherA-603942358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 15:58:33 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-cd2664bc-757c-4899-a828-bf4826a1eacf tempest-ServerActionsTestOtherA-603942358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 15:58:33 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-cd2664bc-757c-4899-a828-bf4826a1eacf tempest-ServerActionsTestOtherA-603942358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:58:33 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-cd2664bc-757c-4899-a828-bf4826a1eacf tempest-ServerActionsTestOtherA-603942358 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 15:58:33 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-cd2664bc-757c-4899-a828-bf4826a1eacf tempest-ServerActionsTestOtherA-603942358 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 15:58:33 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-cd2664bc-757c-4899-a828-bf4826a1eacf tempest-ServerActionsTestOtherA-603942358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-93d9738d-5344-4405-b96b-e31d4c227d5f 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:58:33 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-9e36c75f-140e-420e-ab88-577b010adcc7 tempest-VolumesServicesTestJSON-2098603713 None] Lock "cinder-quobyte-b70e91e8-13ae-4e30-bcfb-1a7eaf15bfd3" released by "delete_volume" :: held 0.759s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 15:58:33 devstack sudo[94200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-93d9738d-5344-4405-b96b-e31d4c227d5f 1073741824 Aug 10 15:58:33 devstack sudo[94200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:58:33 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-9e36c75f-140e-420e-ab88-577b010adcc7 tempest-VolumesServicesTestJSON-2098603713 None] Created reservations ['0b15c579-80fd-4dd1-ab48-e840819bfe87', 'c8405985-5236-4d5d-9fc7-0c071f7b8044', '3d351cda-874b-4325-97bb-2fbfeb18453d', '15f8cc71-db48-4419-8545-81a5d33d936c'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 15:58:33 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-9e36c75f-140e-420e-ab88-577b010adcc7 tempest-VolumesServicesTestJSON-2098603713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:58:33 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-9e36c75f-140e-420e-ab88-577b010adcc7 tempest-VolumesServicesTestJSON-2098603713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:58:33 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-9e36c75f-140e-420e-ab88-577b010adcc7 tempest-VolumesServicesTestJSON-2098603713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 15:58:33 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-9e36c75f-140e-420e-ab88-577b010adcc7 tempest-VolumesServicesTestJSON-2098603713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 15:58:33 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-9e36c75f-140e-420e-ab88-577b010adcc7 tempest-VolumesServicesTestJSON-2098603713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:58:33 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9e36c75f-140e-420e-ab88-577b010adcc7 tempest-VolumesServicesTestJSON-2098603713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:58:33 devstack sudo[94202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 15:58:33 devstack sudo[94202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:58:33 devstack sudo[94202]: pam_unix(sudo:session): session closed for user root Aug 10 15:58:33 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9e36c75f-140e-420e-ab88-577b010adcc7 tempest-VolumesServicesTestJSON-2098603713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.355s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:58:33 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-9e36c75f-140e-420e-ab88-577b010adcc7 tempest-VolumesServicesTestJSON-2098603713 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 15:58:33 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-9e36c75f-140e-420e-ab88-577b010adcc7 tempest-VolumesServicesTestJSON-2098603713 None] Deleted volume successfully. Aug 10 15:58:33 devstack sudo[94200]: pam_unix(sudo:session): session closed for user root Aug 10 15:58:34 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-9e36c75f-140e-420e-ab88-577b010adcc7 tempest-VolumesServicesTestJSON-2098603713 None] Lock "cinder-b70e91e8-13ae-4e30-bcfb-1a7eaf15bfd3-delete_volume" released by "delete_volume" :: held 1.363s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 15:58:34 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-cd2664bc-757c-4899-a828-bf4826a1eacf tempest-ServerActionsTestOtherA-603942358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-93d9738d-5344-4405-b96b-e31d4c227d5f 1073741824" returned: 0 in 0.563s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:58:34 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-cd2664bc-757c-4899-a828-bf4826a1eacf tempest-ServerActionsTestOtherA-603942358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-93d9738d-5344-4405-b96b-e31d4c227d5f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:58:34 devstack sudo[94209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-93d9738d-5344-4405-b96b-e31d4c227d5f Aug 10 15:58:34 devstack sudo[94209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:58:34 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-fe3d0e54-095e-46c6-8471-01fd6a404de2 tempest-VolumeTypesAccessTest-260937957 None] Acquiring lock "cinder-2bbd4541-9c87-425b-b4e6-008ce633d996-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 15:58:34 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-fe3d0e54-095e-46c6-8471-01fd6a404de2 tempest-VolumeTypesAccessTest-260937957 None] Lock "cinder-2bbd4541-9c87-425b-b4e6-008ce633d996-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 15:58:34 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-fe3d0e54-095e-46c6-8471-01fd6a404de2 tempest-VolumeTypesAccessTest-260937957 None] Acquiring lock "cinder-quobyte-2bbd4541-9c87-425b-b4e6-008ce633d996" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 15:58:34 devstack sudo[94209]: pam_unix(sudo:session): session closed for user root Aug 10 15:58:34 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-fe3d0e54-095e-46c6-8471-01fd6a404de2 tempest-VolumeTypesAccessTest-260937957 None] Lock "cinder-quobyte-2bbd4541-9c87-425b-b4e6-008ce633d996" acquired by "delete_volume" :: waited 0.033s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 15:58:34 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-cd2664bc-757c-4899-a828-bf4826a1eacf tempest-ServerActionsTestOtherA-603942358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-93d9738d-5344-4405-b96b-e31d4c227d5f" returned: 0 in 0.328s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:58:34 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-cd2664bc-757c-4899-a828-bf4826a1eacf tempest-ServerActionsTestOtherA-603942358 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 15:58:34 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-cd2664bc-757c-4899-a828-bf4826a1eacf tempest-ServerActionsTestOtherA-603942358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:58:34 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-cd2664bc-757c-4899-a828-bf4826a1eacf tempest-ServerActionsTestOtherA-603942358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10c605f4-864f-476b-b7ea-baf6aedf5e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93d9738d-5344-4405-b96b-e31d4c227d5f', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:58:34 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-cd2664bc-757c-4899-a828-bf4826a1eacf tempest-ServerActionsTestOtherA-603942358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1fb0fa6-be76-47bf-884e-94771be52038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:58:34 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[f51fb933-5a96-40dc-8db0-e3a88e40cef1]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 15:58:34 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fe3d0e54-095e-46c6-8471-01fd6a404de2 tempest-VolumeTypesAccessTest-260937957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2bbd4541-9c87-425b-b4e6-008ce633d996 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:58:34 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-cd2664bc-757c-4899-a828-bf4826a1eacf tempest-ServerActionsTestOtherA-603942358 None] Volume volume-93d9738d-5344-4405-b96b-e31d4c227d5f (93d9738d-5344-4405-b96b-e31d4c227d5f): created successfully Aug 10 15:58:34 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-cd2664bc-757c-4899-a828-bf4826a1eacf tempest-ServerActionsTestOtherA-603942358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1fb0fa6-be76-47bf-884e-94771be52038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:58:34 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-cd2664bc-757c-4899-a828-bf4826a1eacf tempest-ServerActionsTestOtherA-603942358 None] Flow 'volume_create_manager' (81f94bdd-3231-49e6-b3b9-f08ff8a9fd4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 15:58:34 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-cd2664bc-757c-4899-a828-bf4826a1eacf tempest-ServerActionsTestOtherA-603942358 None] Created volume successfully. Aug 10 15:58:34 devstack sudo[94212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2bbd4541-9c87-425b-b4e6-008ce633d996 Aug 10 15:58:34 devstack sudo[94212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:58:34 devstack sudo[94212]: pam_unix(sudo:session): session closed for user root Aug 10 15:58:34 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fe3d0e54-095e-46c6-8471-01fd6a404de2 tempest-VolumeTypesAccessTest-260937957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2bbd4541-9c87-425b-b4e6-008ce633d996" returned: 0 in 0.395s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:58:34 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fe3d0e54-095e-46c6-8471-01fd6a404de2 tempest-VolumeTypesAccessTest-260937957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2bbd4541-9c87-425b-b4e6-008ce633d996 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:58:34 devstack sudo[94217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2bbd4541-9c87-425b-b4e6-008ce633d996 Aug 10 15:58:34 devstack sudo[94217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:58:35 devstack sudo[94217]: pam_unix(sudo:session): session closed for user root Aug 10 15:58:35 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fe3d0e54-095e-46c6-8471-01fd6a404de2 tempest-VolumeTypesAccessTest-260937957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2bbd4541-9c87-425b-b4e6-008ce633d996" returned: 0 in 0.282s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:58:35 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-fe3d0e54-095e-46c6-8471-01fd6a404de2 tempest-VolumeTypesAccessTest-260937957 None] Lock "cinder-quobyte-2bbd4541-9c87-425b-b4e6-008ce633d996" released by "delete_volume" :: held 0.737s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 15:58:35 devstack cinder-volume[88641]: WARNING cinder.quota [None req-fe3d0e54-095e-46c6-8471-01fd6a404de2 tempest-VolumeTypesAccessTest-260937957 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-820534899 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-820534899, it is now deprecated. Please use the default quota class for default quota. Aug 10 15:58:35 devstack cinder-volume[88641]: WARNING cinder.quota [None req-fe3d0e54-095e-46c6-8471-01fd6a404de2 tempest-VolumeTypesAccessTest-260937957 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-820534899 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-820534899, it is now deprecated. Please use the default quota class for default quota. Aug 10 15:58:35 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-fe3d0e54-095e-46c6-8471-01fd6a404de2 tempest-VolumeTypesAccessTest-260937957 None] Created reservations ['17f10b44-d33d-4348-af89-7416b5baad7a', 'e473f8bf-c7c9-4148-afbc-28ede41bc816', '4c7b631b-35d8-4256-b8e2-d279fc80606d', 'd670ba7e-2c70-4b30-a9da-c679f89245f8'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 15:58:35 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-fe3d0e54-095e-46c6-8471-01fd6a404de2 tempest-VolumeTypesAccessTest-260937957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:58:35 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-fe3d0e54-095e-46c6-8471-01fd6a404de2 tempest-VolumeTypesAccessTest-260937957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:58:35 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-fe3d0e54-095e-46c6-8471-01fd6a404de2 tempest-VolumeTypesAccessTest-260937957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 15:58:35 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-fe3d0e54-095e-46c6-8471-01fd6a404de2 tempest-VolumeTypesAccessTest-260937957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 15:58:35 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-fe3d0e54-095e-46c6-8471-01fd6a404de2 tempest-VolumeTypesAccessTest-260937957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:58:35 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fe3d0e54-095e-46c6-8471-01fd6a404de2 tempest-VolumeTypesAccessTest-260937957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:58:35 devstack sudo[94220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 15:58:35 devstack sudo[94220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:58:35 devstack sudo[94220]: pam_unix(sudo:session): session closed for user root Aug 10 15:58:35 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fe3d0e54-095e-46c6-8471-01fd6a404de2 tempest-VolumeTypesAccessTest-260937957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.284s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:58:35 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-fe3d0e54-095e-46c6-8471-01fd6a404de2 tempest-VolumeTypesAccessTest-260937957 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 15:58:35 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-fe3d0e54-095e-46c6-8471-01fd6a404de2 tempest-VolumeTypesAccessTest-260937957 None] Deleted volume successfully. Aug 10 15:58:35 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-fe3d0e54-095e-46c6-8471-01fd6a404de2 tempest-VolumeTypesAccessTest-260937957 None] Lock "cinder-2bbd4541-9c87-425b-b4e6-008ce633d996-delete_volume" released by "delete_volume" :: held 1.323s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 15:58:36 devstack cinder-volume[88641]: DEBUG oslo_service.periodic_task [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88641) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 15:58:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:58:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:58:36 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 15:58:36 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 15:58:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:58:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:58:36 devstack sudo[94223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 15:58:36 devstack sudo[94223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:58:36 devstack sudo[94223]: pam_unix(sudo:session): session closed for user root Aug 10 15:58:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.329s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:58:36 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 15:58:36 devstack cinder-volume[88641]: DEBUG oslo_service.periodic_task [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Running periodic task VolumeManager._thread_info {{(pid=88641) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 15:58:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] thread count: 8 {{(pid=88641) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 10 15:58:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] thread info: [<_MainThread(MainThread, started 127361545748608)>, , , , , , , ] {{(pid=88641) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 10 15:58:45 devstack cinder-volume[88641]: DEBUG dbcounter [-] [88641] Writing DB stats cinder:SELECT=16,cinder:UPDATE=23,cinder:INSERT=9,cinder:DELETE=2 {{(pid=88641) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 15:58:45 devstack cinder-volume[88641]: DEBUG dbcounter [-] [88641] Writing DB stats cinder:UPDATE=27,cinder:SELECT=16,cinder:DELETE=3,cinder:INSERT=2 {{(pid=88641) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 15:58:50 devstack cinder-volume[88641]: INFO cinder.volume.manager [req-1c3d7e5f-7235-4ab3-9eb4-40a4bda9d45c req-d8625d31-cc07-42ea-9e26-ee8edccaa23b tempest-AttachVolumeNegativeTest-115562770 None] Terminate volume connection completed successfully. Aug 10 15:58:50 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [req-1c3d7e5f-7235-4ab3-9eb4-40a4bda9d45c req-d8625d31-cc07-42ea-9e26-ee8edccaa23b tempest-AttachVolumeNegativeTest-115562770 None] Deleting attachment 12f3a4fa-059e-446c-a53f-9157eb3ca6d9. {{(pid=88641) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 10 15:58:59 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-de4f8f0b-2da7-4d68-a6c2-45cef008d027 tempest-VolumesDeleteCascade-1918754692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 15:58:59 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-de4f8f0b-2da7-4d68-a6c2-45cef008d027 tempest-VolumesDeleteCascade-1918754692 None] Flow 'volume_create_manager' (b8402d94-582c-45b8-8293-5c599add44fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 15:58:59 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-de4f8f0b-2da7-4d68-a6c2-45cef008d027 tempest-VolumesDeleteCascade-1918754692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e1f17e1-4704-4840-8acb-3d520dee6d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:58:59 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-de4f8f0b-2da7-4d68-a6c2-45cef008d027 tempest-VolumesDeleteCascade-1918754692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e1f17e1-4704-4840-8acb-3d520dee6d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T13:58:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-375854715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9005ba82-fcfc-4539-bf51-65634cc74c89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90d846f54db94d0c929f31362760167e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T13:59:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T13:59:00Z,use_quota=True,user_id='15518b426406402dafa1cc06e9d62f83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:58:59 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-de4f8f0b-2da7-4d68-a6c2-45cef008d027 tempest-VolumesDeleteCascade-1918754692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75d7cb73-8c4f-4319-ad32-b6ab0e4f50ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:58:59 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-de4f8f0b-2da7-4d68-a6c2-45cef008d027 tempest-VolumesDeleteCascade-1918754692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75d7cb73-8c4f-4319-ad32-b6ab0e4f50ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:58:59 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-de4f8f0b-2da7-4d68-a6c2-45cef008d027 tempest-VolumesDeleteCascade-1918754692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (760900db-6850-421a-be41-ea651cfa8e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:58:59 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-de4f8f0b-2da7-4d68-a6c2-45cef008d027 tempest-VolumesDeleteCascade-1918754692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (760900db-6850-421a-be41-ea651cfa8e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9005ba82-fcfc-4539-bf51-65634cc74c89', 'volume_name': 'volume-9005ba82-fcfc-4539-bf51-65634cc74c89', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:58:59 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-de4f8f0b-2da7-4d68-a6c2-45cef008d027 tempest-VolumesDeleteCascade-1918754692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e2bc0a2-f92b-47b7-8590-02f12e8efc82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:58:59 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-de4f8f0b-2da7-4d68-a6c2-45cef008d027 tempest-VolumesDeleteCascade-1918754692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e2bc0a2-f92b-47b7-8590-02f12e8efc82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:58:59 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-de4f8f0b-2da7-4d68-a6c2-45cef008d027 tempest-VolumesDeleteCascade-1918754692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (982ec45f-e2b5-4a14-baec-64e87e571387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:58:59 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-de4f8f0b-2da7-4d68-a6c2-45cef008d027 tempest-VolumesDeleteCascade-1918754692 None] Volume 9005ba82-fcfc-4539-bf51-65634cc74c89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9005ba82-fcfc-4539-bf51-65634cc74c89', 'volume_size': 1} Aug 10 15:58:59 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-de4f8f0b-2da7-4d68-a6c2-45cef008d027 tempest-VolumesDeleteCascade-1918754692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:58:59 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-de4f8f0b-2da7-4d68-a6c2-45cef008d027 tempest-VolumesDeleteCascade-1918754692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:58:59 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-de4f8f0b-2da7-4d68-a6c2-45cef008d027 tempest-VolumesDeleteCascade-1918754692 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T13:58:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-375854715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9005ba82-fcfc-4539-bf51-65634cc74c89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90d846f54db94d0c929f31362760167e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T13:59:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T13:59:00Z,use_quota=True,user_id='15518b426406402dafa1cc06e9d62f83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 15:58:59 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-de4f8f0b-2da7-4d68-a6c2-45cef008d027 tempest-VolumesDeleteCascade-1918754692 None] Creating volume 9005ba82-fcfc-4539-bf51-65634cc74c89 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 15:58:59 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-de4f8f0b-2da7-4d68-a6c2-45cef008d027 tempest-VolumesDeleteCascade-1918754692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:58:59 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-de4f8f0b-2da7-4d68-a6c2-45cef008d027 tempest-VolumesDeleteCascade-1918754692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:58:59 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-de4f8f0b-2da7-4d68-a6c2-45cef008d027 tempest-VolumesDeleteCascade-1918754692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 15:58:59 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-de4f8f0b-2da7-4d68-a6c2-45cef008d027 tempest-VolumesDeleteCascade-1918754692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 15:58:59 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-de4f8f0b-2da7-4d68-a6c2-45cef008d027 tempest-VolumesDeleteCascade-1918754692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:58:59 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-de4f8f0b-2da7-4d68-a6c2-45cef008d027 tempest-VolumesDeleteCascade-1918754692 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 15:58:59 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-de4f8f0b-2da7-4d68-a6c2-45cef008d027 tempest-VolumesDeleteCascade-1918754692 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 15:58:59 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-de4f8f0b-2da7-4d68-a6c2-45cef008d027 tempest-VolumesDeleteCascade-1918754692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9005ba82-fcfc-4539-bf51-65634cc74c89 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:58:59 devstack sudo[94449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9005ba82-fcfc-4539-bf51-65634cc74c89 1073741824 Aug 10 15:58:59 devstack sudo[94449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:59:00 devstack sudo[94449]: pam_unix(sudo:session): session closed for user root Aug 10 15:59:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-de4f8f0b-2da7-4d68-a6c2-45cef008d027 tempest-VolumesDeleteCascade-1918754692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9005ba82-fcfc-4539-bf51-65634cc74c89 1073741824" returned: 0 in 0.602s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:59:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-de4f8f0b-2da7-4d68-a6c2-45cef008d027 tempest-VolumesDeleteCascade-1918754692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9005ba82-fcfc-4539-bf51-65634cc74c89 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:59:00 devstack sudo[94458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9005ba82-fcfc-4539-bf51-65634cc74c89 Aug 10 15:59:00 devstack sudo[94458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:59:00 devstack sudo[94458]: pam_unix(sudo:session): session closed for user root Aug 10 15:59:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-de4f8f0b-2da7-4d68-a6c2-45cef008d027 tempest-VolumesDeleteCascade-1918754692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9005ba82-fcfc-4539-bf51-65634cc74c89" returned: 0 in 0.303s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:59:00 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-de4f8f0b-2da7-4d68-a6c2-45cef008d027 tempest-VolumesDeleteCascade-1918754692 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 15:59:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-de4f8f0b-2da7-4d68-a6c2-45cef008d027 tempest-VolumesDeleteCascade-1918754692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:59:00 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-de4f8f0b-2da7-4d68-a6c2-45cef008d027 tempest-VolumesDeleteCascade-1918754692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (982ec45f-e2b5-4a14-baec-64e87e571387) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9005ba82-fcfc-4539-bf51-65634cc74c89', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:59:00 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-de4f8f0b-2da7-4d68-a6c2-45cef008d027 tempest-VolumesDeleteCascade-1918754692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21f8a303-e590-4bf4-ada3-862aa56da7c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:59:00 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-de4f8f0b-2da7-4d68-a6c2-45cef008d027 tempest-VolumesDeleteCascade-1918754692 None] Volume volume-9005ba82-fcfc-4539-bf51-65634cc74c89 (9005ba82-fcfc-4539-bf51-65634cc74c89): created successfully Aug 10 15:59:00 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-de4f8f0b-2da7-4d68-a6c2-45cef008d027 tempest-VolumesDeleteCascade-1918754692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21f8a303-e590-4bf4-ada3-862aa56da7c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:59:00 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-de4f8f0b-2da7-4d68-a6c2-45cef008d027 tempest-VolumesDeleteCascade-1918754692 None] Flow 'volume_create_manager' (b8402d94-582c-45b8-8293-5c599add44fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 15:59:00 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-de4f8f0b-2da7-4d68-a6c2-45cef008d027 tempest-VolumesDeleteCascade-1918754692 None] Created volume successfully. Aug 10 15:59:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-fcf8b251-611c-437f-8041-9a633aede313 tempest-VolumesDeleteCascade-1918754692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:59:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-fcf8b251-611c-437f-8041-9a633aede313 tempest-VolumesDeleteCascade-1918754692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:59:02 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-fcf8b251-611c-437f-8041-9a633aede313 tempest-VolumesDeleteCascade-1918754692 None] Creating offline snapshot 0259dc08-71e4-4fe3-a6e1-d67a2cb7a061 of volume 9005ba82-fcfc-4539-bf51-65634cc74c89 {{(pid=88641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 15:59:02 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[fadbb5a6-4d87-486c-b7dd-7b89f58c03c8]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 15:59:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fcf8b251-611c-437f-8041-9a633aede313 tempest-VolumesDeleteCascade-1918754692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9005ba82-fcfc-4539-bf51-65634cc74c89 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:59:02 devstack sudo[94479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9005ba82-fcfc-4539-bf51-65634cc74c89 Aug 10 15:59:02 devstack sudo[94479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:59:02 devstack sudo[94479]: pam_unix(sudo:session): session closed for user root Aug 10 15:59:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fcf8b251-611c-437f-8041-9a633aede313 tempest-VolumesDeleteCascade-1918754692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9005ba82-fcfc-4539-bf51-65634cc74c89" returned: 0 in 0.429s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:59:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fcf8b251-611c-437f-8041-9a633aede313 tempest-VolumesDeleteCascade-1918754692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9005ba82-fcfc-4539-bf51-65634cc74c89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9005ba82-fcfc-4539-bf51-65634cc74c89.0259dc08-71e4-4fe3-a6e1-d67a2cb7a061 1G {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:59:02 devstack sudo[94485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9005ba82-fcfc-4539-bf51-65634cc74c89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9005ba82-fcfc-4539-bf51-65634cc74c89.0259dc08-71e4-4fe3-a6e1-d67a2cb7a061 1G Aug 10 15:59:02 devstack sudo[94485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:59:03 devstack sudo[94485]: pam_unix(sudo:session): session closed for user root Aug 10 15:59:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fcf8b251-611c-437f-8041-9a633aede313 tempest-VolumesDeleteCascade-1918754692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9005ba82-fcfc-4539-bf51-65634cc74c89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9005ba82-fcfc-4539-bf51-65634cc74c89.0259dc08-71e4-4fe3-a6e1-d67a2cb7a061 1G" returned: 0 in 0.596s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:59:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fcf8b251-611c-437f-8041-9a633aede313 tempest-VolumesDeleteCascade-1918754692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9005ba82-fcfc-4539-bf51-65634cc74c89 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9005ba82-fcfc-4539-bf51-65634cc74c89.0259dc08-71e4-4fe3-a6e1-d67a2cb7a061 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:59:03 devstack sudo[94490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9005ba82-fcfc-4539-bf51-65634cc74c89 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9005ba82-fcfc-4539-bf51-65634cc74c89.0259dc08-71e4-4fe3-a6e1-d67a2cb7a061 Aug 10 15:59:03 devstack sudo[94490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:59:03 devstack sudo[94490]: pam_unix(sudo:session): session closed for user root Aug 10 15:59:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fcf8b251-611c-437f-8041-9a633aede313 tempest-VolumesDeleteCascade-1918754692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9005ba82-fcfc-4539-bf51-65634cc74c89 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9005ba82-fcfc-4539-bf51-65634cc74c89.0259dc08-71e4-4fe3-a6e1-d67a2cb7a061" returned: 0 in 0.379s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:59:03 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-fcf8b251-611c-437f-8041-9a633aede313 tempest-VolumesDeleteCascade-1918754692 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9005ba82-fcfc-4539-bf51-65634cc74c89.0259dc08-71e4-4fe3-a6e1-d67a2cb7a061 is being set with open permissions: ugo+rw Aug 10 15:59:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fcf8b251-611c-437f-8041-9a633aede313 tempest-VolumesDeleteCascade-1918754692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9005ba82-fcfc-4539-bf51-65634cc74c89.0259dc08-71e4-4fe3-a6e1-d67a2cb7a061 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:59:03 devstack sudo[94496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9005ba82-fcfc-4539-bf51-65634cc74c89.0259dc08-71e4-4fe3-a6e1-d67a2cb7a061 Aug 10 15:59:03 devstack sudo[94496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:59:04 devstack sudo[94496]: pam_unix(sudo:session): session closed for user root Aug 10 15:59:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fcf8b251-611c-437f-8041-9a633aede313 tempest-VolumesDeleteCascade-1918754692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9005ba82-fcfc-4539-bf51-65634cc74c89.0259dc08-71e4-4fe3-a6e1-d67a2cb7a061" returned: 0 in 0.281s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:59:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fcf8b251-611c-437f-8041-9a633aede313 tempest-VolumesDeleteCascade-1918754692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9005ba82-fcfc-4539-bf51-65634cc74c89.info {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:59:04 devstack sudo[94500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9005ba82-fcfc-4539-bf51-65634cc74c89.info Aug 10 15:59:04 devstack sudo[94500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:59:04 devstack sudo[94500]: pam_unix(sudo:session): session closed for user root Aug 10 15:59:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fcf8b251-611c-437f-8041-9a633aede313 tempest-VolumesDeleteCascade-1918754692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9005ba82-fcfc-4539-bf51-65634cc74c89.info" returned: 0 in 0.326s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:59:04 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-fcf8b251-611c-437f-8041-9a633aede313 tempest-VolumesDeleteCascade-1918754692 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9005ba82-fcfc-4539-bf51-65634cc74c89.info is being set with open permissions: ugo+rw Aug 10 15:59:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fcf8b251-611c-437f-8041-9a633aede313 tempest-VolumesDeleteCascade-1918754692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9005ba82-fcfc-4539-bf51-65634cc74c89.info {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:59:04 devstack sudo[94503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9005ba82-fcfc-4539-bf51-65634cc74c89.info Aug 10 15:59:04 devstack sudo[94503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:59:04 devstack sudo[94503]: pam_unix(sudo:session): session closed for user root Aug 10 15:59:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fcf8b251-611c-437f-8041-9a633aede313 tempest-VolumesDeleteCascade-1918754692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9005ba82-fcfc-4539-bf51-65634cc74c89.info" returned: 0 in 0.397s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:59:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-fcf8b251-611c-437f-8041-9a633aede313 tempest-VolumesDeleteCascade-1918754692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.535s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:59:04 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-fcf8b251-611c-437f-8041-9a633aede313 tempest-VolumesDeleteCascade-1918754692 None] Create snapshot completed successfully Aug 10 15:59:05 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-d788c7e2-13b7-47f4-97da-6753e23394a6 tempest-VolumesDeleteCascade-1918754692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:59:05 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-d788c7e2-13b7-47f4-97da-6753e23394a6 tempest-VolumesDeleteCascade-1918754692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:59:05 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-d788c7e2-13b7-47f4-97da-6753e23394a6 tempest-VolumesDeleteCascade-1918754692 None] Creating offline snapshot 097ae125-8f07-4659-8d79-78caa3639106 of volume 9005ba82-fcfc-4539-bf51-65634cc74c89 {{(pid=88641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 15:59:06 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f3d7afa-4177-4a5a-9ce8-88789a4279f9]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 15:59:06 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d788c7e2-13b7-47f4-97da-6753e23394a6 tempest-VolumesDeleteCascade-1918754692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9005ba82-fcfc-4539-bf51-65634cc74c89.0259dc08-71e4-4fe3-a6e1-d67a2cb7a061 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:59:06 devstack sudo[94557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9005ba82-fcfc-4539-bf51-65634cc74c89.0259dc08-71e4-4fe3-a6e1-d67a2cb7a061 Aug 10 15:59:06 devstack sudo[94557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:59:06 devstack sudo[94557]: pam_unix(sudo:session): session closed for user root Aug 10 15:59:06 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d788c7e2-13b7-47f4-97da-6753e23394a6 tempest-VolumesDeleteCascade-1918754692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9005ba82-fcfc-4539-bf51-65634cc74c89.0259dc08-71e4-4fe3-a6e1-d67a2cb7a061" returned: 0 in 0.694s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:59:06 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-d788c7e2-13b7-47f4-97da-6753e23394a6 tempest-VolumesDeleteCascade-1918754692 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9005ba82-fcfc-4539-bf51-65634cc74c89(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 15:59:06 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d788c7e2-13b7-47f4-97da-6753e23394a6 tempest-VolumesDeleteCascade-1918754692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9005ba82-fcfc-4539-bf51-65634cc74c89.0259dc08-71e4-4fe3-a6e1-d67a2cb7a061,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9005ba82-fcfc-4539-bf51-65634cc74c89.097ae125-8f07-4659-8d79-78caa3639106 1G {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:59:06 devstack sudo[94584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9005ba82-fcfc-4539-bf51-65634cc74c89.0259dc08-71e4-4fe3-a6e1-d67a2cb7a061,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9005ba82-fcfc-4539-bf51-65634cc74c89.097ae125-8f07-4659-8d79-78caa3639106 1G Aug 10 15:59:06 devstack sudo[94584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:59:07 devstack sudo[94584]: pam_unix(sudo:session): session closed for user root Aug 10 15:59:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d788c7e2-13b7-47f4-97da-6753e23394a6 tempest-VolumesDeleteCascade-1918754692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9005ba82-fcfc-4539-bf51-65634cc74c89.0259dc08-71e4-4fe3-a6e1-d67a2cb7a061,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9005ba82-fcfc-4539-bf51-65634cc74c89.097ae125-8f07-4659-8d79-78caa3639106 1G" returned: 0 in 0.710s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:59:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d788c7e2-13b7-47f4-97da-6753e23394a6 tempest-VolumesDeleteCascade-1918754692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9005ba82-fcfc-4539-bf51-65634cc74c89.0259dc08-71e4-4fe3-a6e1-d67a2cb7a061 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9005ba82-fcfc-4539-bf51-65634cc74c89.097ae125-8f07-4659-8d79-78caa3639106 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:59:07 devstack sudo[94605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9005ba82-fcfc-4539-bf51-65634cc74c89.0259dc08-71e4-4fe3-a6e1-d67a2cb7a061 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9005ba82-fcfc-4539-bf51-65634cc74c89.097ae125-8f07-4659-8d79-78caa3639106 Aug 10 15:59:07 devstack sudo[94605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:59:07 devstack sudo[94605]: pam_unix(sudo:session): session closed for user root Aug 10 15:59:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d788c7e2-13b7-47f4-97da-6753e23394a6 tempest-VolumesDeleteCascade-1918754692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9005ba82-fcfc-4539-bf51-65634cc74c89.0259dc08-71e4-4fe3-a6e1-d67a2cb7a061 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9005ba82-fcfc-4539-bf51-65634cc74c89.097ae125-8f07-4659-8d79-78caa3639106" returned: 0 in 0.388s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:59:07 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-d788c7e2-13b7-47f4-97da-6753e23394a6 tempest-VolumesDeleteCascade-1918754692 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9005ba82-fcfc-4539-bf51-65634cc74c89.097ae125-8f07-4659-8d79-78caa3639106 is being set with open permissions: ugo+rw Aug 10 15:59:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d788c7e2-13b7-47f4-97da-6753e23394a6 tempest-VolumesDeleteCascade-1918754692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9005ba82-fcfc-4539-bf51-65634cc74c89.097ae125-8f07-4659-8d79-78caa3639106 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:59:07 devstack sudo[94611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9005ba82-fcfc-4539-bf51-65634cc74c89.097ae125-8f07-4659-8d79-78caa3639106 Aug 10 15:59:07 devstack sudo[94611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:59:08 devstack sudo[94611]: pam_unix(sudo:session): session closed for user root Aug 10 15:59:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d788c7e2-13b7-47f4-97da-6753e23394a6 tempest-VolumesDeleteCascade-1918754692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9005ba82-fcfc-4539-bf51-65634cc74c89.097ae125-8f07-4659-8d79-78caa3639106" returned: 0 in 0.308s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:59:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-d788c7e2-13b7-47f4-97da-6753e23394a6 tempest-VolumesDeleteCascade-1918754692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.310s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:59:08 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-d788c7e2-13b7-47f4-97da-6753e23394a6 tempest-VolumesDeleteCascade-1918754692 None] Create snapshot completed successfully Aug 10 15:59:09 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-208d15cf-991e-4369-8238-65391c4bad2a tempest-VolumesDeleteCascade-1918754692 None] Acquiring lock "cinder-9005ba82-fcfc-4539-bf51-65634cc74c89-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 15:59:09 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-208d15cf-991e-4369-8238-65391c4bad2a tempest-VolumesDeleteCascade-1918754692 None] Lock "cinder-9005ba82-fcfc-4539-bf51-65634cc74c89-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 15:59:09 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-208d15cf-991e-4369-8238-65391c4bad2a tempest-VolumesDeleteCascade-1918754692 None] Performing cascade delete. {{(pid=88641) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Aug 10 15:59:09 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-208d15cf-991e-4369-8238-65391c4bad2a tempest-VolumesDeleteCascade-1918754692 None] Acquiring lock "cinder-0259dc08-71e4-4fe3-a6e1-d67a2cb7a061-delete_snapshot" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 15:59:09 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-208d15cf-991e-4369-8238-65391c4bad2a tempest-VolumesDeleteCascade-1918754692 None] Lock "cinder-0259dc08-71e4-4fe3-a6e1-d67a2cb7a061-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 15:59:09 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-208d15cf-991e-4369-8238-65391c4bad2a tempest-VolumesDeleteCascade-1918754692 None] Acquiring lock "cinder-quobyte-9005ba82-fcfc-4539-bf51-65634cc74c89" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 15:59:09 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-208d15cf-991e-4369-8238-65391c4bad2a tempest-VolumesDeleteCascade-1918754692 None] Lock "cinder-quobyte-9005ba82-fcfc-4539-bf51-65634cc74c89" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 15:59:09 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-208d15cf-991e-4369-8238-65391c4bad2a tempest-VolumesDeleteCascade-1918754692 None] Acquiring lock "cinder-quobyte-0259dc08-71e4-4fe3-a6e1-d67a2cb7a061" by "_delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 15:59:09 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-208d15cf-991e-4369-8238-65391c4bad2a tempest-VolumesDeleteCascade-1918754692 None] Lock "cinder-quobyte-0259dc08-71e4-4fe3-a6e1-d67a2cb7a061" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 15:59:09 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-208d15cf-991e-4369-8238-65391c4bad2a tempest-VolumesDeleteCascade-1918754692 None] Deleting offline snapshot 0259dc08-71e4-4fe3-a6e1-d67a2cb7a061 of volume 9005ba82-fcfc-4539-bf51-65634cc74c89 {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 15:59:09 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-208d15cf-991e-4369-8238-65391c4bad2a tempest-VolumesDeleteCascade-1918754692 None] snapshot_file for this snap is: volume-9005ba82-fcfc-4539-bf51-65634cc74c89.0259dc08-71e4-4fe3-a6e1-d67a2cb7a061 {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 15:59:09 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c9bf74-282d-424d-8dcf-255505bba09c]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 15:59:09 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-208d15cf-991e-4369-8238-65391c4bad2a tempest-VolumesDeleteCascade-1918754692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9005ba82-fcfc-4539-bf51-65634cc74c89.0259dc08-71e4-4fe3-a6e1-d67a2cb7a061 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:59:09 devstack sudo[94619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9005ba82-fcfc-4539-bf51-65634cc74c89.0259dc08-71e4-4fe3-a6e1-d67a2cb7a061 Aug 10 15:59:09 devstack sudo[94619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:59:10 devstack sudo[94619]: pam_unix(sudo:session): session closed for user root Aug 10 15:59:10 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-208d15cf-991e-4369-8238-65391c4bad2a tempest-VolumesDeleteCascade-1918754692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9005ba82-fcfc-4539-bf51-65634cc74c89.0259dc08-71e4-4fe3-a6e1-d67a2cb7a061" returned: 0 in 0.673s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:59:10 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-208d15cf-991e-4369-8238-65391c4bad2a tempest-VolumesDeleteCascade-1918754692 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9005ba82-fcfc-4539-bf51-65634cc74c89(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 15:59:10 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0216cb8-239a-4d9d-b630-f2071d65c1d0]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 15:59:10 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-208d15cf-991e-4369-8238-65391c4bad2a tempest-VolumesDeleteCascade-1918754692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9005ba82-fcfc-4539-bf51-65634cc74c89 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:59:10 devstack sudo[94624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9005ba82-fcfc-4539-bf51-65634cc74c89 Aug 10 15:59:10 devstack sudo[94624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:59:11 devstack sudo[94624]: pam_unix(sudo:session): session closed for user root Aug 10 15:59:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-208d15cf-991e-4369-8238-65391c4bad2a tempest-VolumesDeleteCascade-1918754692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9005ba82-fcfc-4539-bf51-65634cc74c89" returned: 0 in 0.867s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:59:11 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dedb2a7-cabf-4ed1-94cf-4b577bb3738f]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 15:59:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-208d15cf-991e-4369-8238-65391c4bad2a tempest-VolumesDeleteCascade-1918754692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9005ba82-fcfc-4539-bf51-65634cc74c89.097ae125-8f07-4659-8d79-78caa3639106 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:59:11 devstack sudo[94630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9005ba82-fcfc-4539-bf51-65634cc74c89.097ae125-8f07-4659-8d79-78caa3639106 Aug 10 15:59:11 devstack sudo[94630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:59:11 devstack sudo[94630]: pam_unix(sudo:session): session closed for user root Aug 10 15:59:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-208d15cf-991e-4369-8238-65391c4bad2a tempest-VolumesDeleteCascade-1918754692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9005ba82-fcfc-4539-bf51-65634cc74c89.097ae125-8f07-4659-8d79-78caa3639106" returned: 0 in 0.586s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:59:11 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-208d15cf-991e-4369-8238-65391c4bad2a tempest-VolumesDeleteCascade-1918754692 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9005ba82-fcfc-4539-bf51-65634cc74c89(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 15:59:11 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed3eaf6c-0f3d-4b92-91e0-463e03c56d9e]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 15:59:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-208d15cf-991e-4369-8238-65391c4bad2a tempest-VolumesDeleteCascade-1918754692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9005ba82-fcfc-4539-bf51-65634cc74c89.0259dc08-71e4-4fe3-a6e1-d67a2cb7a061 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:59:12 devstack sudo[94638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9005ba82-fcfc-4539-bf51-65634cc74c89.0259dc08-71e4-4fe3-a6e1-d67a2cb7a061 Aug 10 15:59:12 devstack sudo[94638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:59:12 devstack sudo[94638]: pam_unix(sudo:session): session closed for user root Aug 10 15:59:12 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-208d15cf-991e-4369-8238-65391c4bad2a tempest-VolumesDeleteCascade-1918754692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9005ba82-fcfc-4539-bf51-65634cc74c89.0259dc08-71e4-4fe3-a6e1-d67a2cb7a061" returned: 0 in 0.532s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:59:12 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-208d15cf-991e-4369-8238-65391c4bad2a tempest-VolumesDeleteCascade-1918754692 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9005ba82-fcfc-4539-bf51-65634cc74c89(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 15:59:12 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[8807f132-f6a6-4b82-aa42-dfb8941b87e0]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 15:59:12 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-208d15cf-991e-4369-8238-65391c4bad2a tempest-VolumesDeleteCascade-1918754692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9005ba82-fcfc-4539-bf51-65634cc74c89 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:59:12 devstack sudo[94648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9005ba82-fcfc-4539-bf51-65634cc74c89 Aug 10 15:59:12 devstack sudo[94648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:59:12 devstack sudo[94648]: pam_unix(sudo:session): session closed for user root Aug 10 15:59:12 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-208d15cf-991e-4369-8238-65391c4bad2a tempest-VolumesDeleteCascade-1918754692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9005ba82-fcfc-4539-bf51-65634cc74c89" returned: 0 in 0.541s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:59:12 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-208d15cf-991e-4369-8238-65391c4bad2a tempest-VolumesDeleteCascade-1918754692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9005ba82-fcfc-4539-bf51-65634cc74c89.0259dc08-71e4-4fe3-a6e1-d67a2cb7a061 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:59:12 devstack sudo[94659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9005ba82-fcfc-4539-bf51-65634cc74c89.0259dc08-71e4-4fe3-a6e1-d67a2cb7a061 Aug 10 15:59:12 devstack sudo[94659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:59:13 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-12e54c1e-5fd8-441d-a0df-393fbdbd6db9 req-580847ae-b639-4b0f-9810-45c230d4d810 tempest-ServerActionsTestOtherA-603942358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:59:13 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-12e54c1e-5fd8-441d-a0df-393fbdbd6db9 req-580847ae-b639-4b0f-9810-45c230d4d810 tempest-ServerActionsTestOtherA-603942358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:59:13 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-12e54c1e-5fd8-441d-a0df-393fbdbd6db9 req-580847ae-b639-4b0f-9810-45c230d4d810 tempest-ServerActionsTestOtherA-603942358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:59:13 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [req-12e54c1e-5fd8-441d-a0df-393fbdbd6db9 req-580847ae-b639-4b0f-9810-45c230d4d810 tempest-ServerActionsTestOtherA-603942358 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc', 'name': 'volume-93d9738d-5344-4405-b96b-e31d4c227d5f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '31109727-5cec-4d13-806e-c5d98d5d8e17', 'enforce_multipath': True} {{(pid=88641) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 10 15:59:13 devstack cinder-volume[88641]: INFO cinder.volume.manager [req-12e54c1e-5fd8-441d-a0df-393fbdbd6db9 req-580847ae-b639-4b0f-9810-45c230d4d810 tempest-ServerActionsTestOtherA-603942358 None] attachment_update completed successfully. Aug 10 15:59:13 devstack sudo[94659]: pam_unix(sudo:session): session closed for user root Aug 10 15:59:13 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-208d15cf-991e-4369-8238-65391c4bad2a tempest-VolumesDeleteCascade-1918754692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9005ba82-fcfc-4539-bf51-65634cc74c89.0259dc08-71e4-4fe3-a6e1-d67a2cb7a061" returned: 0 in 0.538s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:59:13 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-208d15cf-991e-4369-8238-65391c4bad2a tempest-VolumesDeleteCascade-1918754692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9005ba82-fcfc-4539-bf51-65634cc74c89.0259dc08-71e4-4fe3-a6e1-d67a2cb7a061 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:59:13 devstack sudo[94670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9005ba82-fcfc-4539-bf51-65634cc74c89.0259dc08-71e4-4fe3-a6e1-d67a2cb7a061 Aug 10 15:59:13 devstack sudo[94670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:59:13 devstack sudo[94670]: pam_unix(sudo:session): session closed for user root Aug 10 15:59:13 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-208d15cf-991e-4369-8238-65391c4bad2a tempest-VolumesDeleteCascade-1918754692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9005ba82-fcfc-4539-bf51-65634cc74c89.0259dc08-71e4-4fe3-a6e1-d67a2cb7a061" returned: 0 in 0.396s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:59:13 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-208d15cf-991e-4369-8238-65391c4bad2a tempest-VolumesDeleteCascade-1918754692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9005ba82-fcfc-4539-bf51-65634cc74c89 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9005ba82-fcfc-4539-bf51-65634cc74c89.097ae125-8f07-4659-8d79-78caa3639106 -F qcow2 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:59:13 devstack sudo[95053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9005ba82-fcfc-4539-bf51-65634cc74c89 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9005ba82-fcfc-4539-bf51-65634cc74c89.097ae125-8f07-4659-8d79-78caa3639106 -F qcow2 Aug 10 15:59:13 devstack sudo[95053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:59:14 devstack sudo[95053]: pam_unix(sudo:session): session closed for user root Aug 10 15:59:14 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-208d15cf-991e-4369-8238-65391c4bad2a tempest-VolumesDeleteCascade-1918754692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9005ba82-fcfc-4539-bf51-65634cc74c89 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9005ba82-fcfc-4539-bf51-65634cc74c89.097ae125-8f07-4659-8d79-78caa3639106 -F qcow2" returned: 0 in 0.539s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:59:14 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-208d15cf-991e-4369-8238-65391c4bad2a tempest-VolumesDeleteCascade-1918754692 None] Lock "cinder-quobyte-0259dc08-71e4-4fe3-a6e1-d67a2cb7a061" released by "_delete_snapshot" :: held 4.967s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 15:59:14 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-208d15cf-991e-4369-8238-65391c4bad2a tempest-VolumesDeleteCascade-1918754692 None] Lock "cinder-quobyte-9005ba82-fcfc-4539-bf51-65634cc74c89" released by "delete_snapshot" :: held 5.016s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 15:59:14 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-208d15cf-991e-4369-8238-65391c4bad2a tempest-VolumesDeleteCascade-1918754692 None] Created reservations ['ae85dbe6-3b03-4ab6-9307-38c9d6d95fa6', '9d9066b9-a197-462e-9a48-22c0615164c9', '411b371b-c74c-4c7f-9d77-a1a64d17193d', '3fbcebbe-76d5-4a32-8874-89ce2cc0d2be'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 15:59:14 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-208d15cf-991e-4369-8238-65391c4bad2a tempest-VolumesDeleteCascade-1918754692 None] Delete snapshot completed successfully. Aug 10 15:59:14 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-208d15cf-991e-4369-8238-65391c4bad2a tempest-VolumesDeleteCascade-1918754692 None] Lock "cinder-0259dc08-71e4-4fe3-a6e1-d67a2cb7a061-delete_snapshot" released by "delete_snapshot" :: held 5.390s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 15:59:14 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-208d15cf-991e-4369-8238-65391c4bad2a tempest-VolumesDeleteCascade-1918754692 None] Acquiring lock "cinder-097ae125-8f07-4659-8d79-78caa3639106-delete_snapshot" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 15:59:14 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-208d15cf-991e-4369-8238-65391c4bad2a tempest-VolumesDeleteCascade-1918754692 None] Lock "cinder-097ae125-8f07-4659-8d79-78caa3639106-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 15:59:14 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-208d15cf-991e-4369-8238-65391c4bad2a tempest-VolumesDeleteCascade-1918754692 None] Acquiring lock "cinder-quobyte-9005ba82-fcfc-4539-bf51-65634cc74c89" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 15:59:14 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-208d15cf-991e-4369-8238-65391c4bad2a tempest-VolumesDeleteCascade-1918754692 None] Lock "cinder-quobyte-9005ba82-fcfc-4539-bf51-65634cc74c89" acquired by "delete_snapshot" :: waited 0.038s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 15:59:14 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-208d15cf-991e-4369-8238-65391c4bad2a tempest-VolumesDeleteCascade-1918754692 None] Acquiring lock "cinder-quobyte-097ae125-8f07-4659-8d79-78caa3639106" by "_delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 15:59:14 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-208d15cf-991e-4369-8238-65391c4bad2a tempest-VolumesDeleteCascade-1918754692 None] Lock "cinder-quobyte-097ae125-8f07-4659-8d79-78caa3639106" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 15:59:14 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-208d15cf-991e-4369-8238-65391c4bad2a tempest-VolumesDeleteCascade-1918754692 None] Deleting offline snapshot 097ae125-8f07-4659-8d79-78caa3639106 of volume 9005ba82-fcfc-4539-bf51-65634cc74c89 {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 15:59:14 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-208d15cf-991e-4369-8238-65391c4bad2a tempest-VolumesDeleteCascade-1918754692 None] snapshot_file for this snap is: volume-9005ba82-fcfc-4539-bf51-65634cc74c89.097ae125-8f07-4659-8d79-78caa3639106 {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 15:59:15 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[a703d4a2-6c2c-49a7-ba6c-6a7556fd0690]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 15:59:15 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-208d15cf-991e-4369-8238-65391c4bad2a tempest-VolumesDeleteCascade-1918754692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9005ba82-fcfc-4539-bf51-65634cc74c89.097ae125-8f07-4659-8d79-78caa3639106 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:59:15 devstack sudo[95064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9005ba82-fcfc-4539-bf51-65634cc74c89.097ae125-8f07-4659-8d79-78caa3639106 Aug 10 15:59:15 devstack sudo[95064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:59:15 devstack sudo[95064]: pam_unix(sudo:session): session closed for user root Aug 10 15:59:15 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-208d15cf-991e-4369-8238-65391c4bad2a tempest-VolumesDeleteCascade-1918754692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9005ba82-fcfc-4539-bf51-65634cc74c89.097ae125-8f07-4659-8d79-78caa3639106" returned: 0 in 0.501s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:59:15 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-208d15cf-991e-4369-8238-65391c4bad2a tempest-VolumesDeleteCascade-1918754692 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9005ba82-fcfc-4539-bf51-65634cc74c89(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 15:59:15 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[18bfb6d2-3845-4b0b-81db-302deeb033ab]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 15:59:15 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-208d15cf-991e-4369-8238-65391c4bad2a tempest-VolumesDeleteCascade-1918754692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9005ba82-fcfc-4539-bf51-65634cc74c89 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:59:15 devstack sudo[95070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9005ba82-fcfc-4539-bf51-65634cc74c89 Aug 10 15:59:15 devstack sudo[95070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:59:15 devstack sudo[95070]: pam_unix(sudo:session): session closed for user root Aug 10 15:59:15 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-208d15cf-991e-4369-8238-65391c4bad2a tempest-VolumesDeleteCascade-1918754692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9005ba82-fcfc-4539-bf51-65634cc74c89" returned: 0 in 0.429s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:59:15 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-208d15cf-991e-4369-8238-65391c4bad2a tempest-VolumesDeleteCascade-1918754692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9005ba82-fcfc-4539-bf51-65634cc74c89.097ae125-8f07-4659-8d79-78caa3639106 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:59:16 devstack sudo[95076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9005ba82-fcfc-4539-bf51-65634cc74c89.097ae125-8f07-4659-8d79-78caa3639106 Aug 10 15:59:16 devstack sudo[95076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:59:16 devstack sudo[95076]: pam_unix(sudo:session): session closed for user root Aug 10 15:59:16 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-208d15cf-991e-4369-8238-65391c4bad2a tempest-VolumesDeleteCascade-1918754692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9005ba82-fcfc-4539-bf51-65634cc74c89.097ae125-8f07-4659-8d79-78caa3639106" returned: 0 in 0.548s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:59:16 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-208d15cf-991e-4369-8238-65391c4bad2a tempest-VolumesDeleteCascade-1918754692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9005ba82-fcfc-4539-bf51-65634cc74c89.097ae125-8f07-4659-8d79-78caa3639106 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:59:16 devstack sudo[95084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9005ba82-fcfc-4539-bf51-65634cc74c89.097ae125-8f07-4659-8d79-78caa3639106 Aug 10 15:59:16 devstack sudo[95084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:59:16 devstack sudo[95084]: pam_unix(sudo:session): session closed for user root Aug 10 15:59:16 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-208d15cf-991e-4369-8238-65391c4bad2a tempest-VolumesDeleteCascade-1918754692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9005ba82-fcfc-4539-bf51-65634cc74c89.097ae125-8f07-4659-8d79-78caa3639106" returned: 0 in 0.371s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:59:16 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-208d15cf-991e-4369-8238-65391c4bad2a tempest-VolumesDeleteCascade-1918754692 None] Lock "cinder-quobyte-097ae125-8f07-4659-8d79-78caa3639106" released by "_delete_snapshot" :: held 2.010s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 15:59:16 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-208d15cf-991e-4369-8238-65391c4bad2a tempest-VolumesDeleteCascade-1918754692 None] Lock "cinder-quobyte-9005ba82-fcfc-4539-bf51-65634cc74c89" released by "delete_snapshot" :: held 2.057s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 15:59:17 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-208d15cf-991e-4369-8238-65391c4bad2a tempest-VolumesDeleteCascade-1918754692 None] Created reservations ['09a65055-93fb-4d39-a445-9ffd0b1901ef', '9fe4b1c7-9e17-43c6-8703-ed1b8edf3d54', '63da934d-377e-4db4-ae85-037083ef4295', 'f2e07688-65f5-4ce2-8658-a6242aed2150'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 15:59:17 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-208d15cf-991e-4369-8238-65391c4bad2a tempest-VolumesDeleteCascade-1918754692 None] Delete snapshot completed successfully. Aug 10 15:59:17 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-208d15cf-991e-4369-8238-65391c4bad2a tempest-VolumesDeleteCascade-1918754692 None] Lock "cinder-097ae125-8f07-4659-8d79-78caa3639106-delete_snapshot" released by "delete_snapshot" :: held 2.294s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 15:59:17 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-208d15cf-991e-4369-8238-65391c4bad2a tempest-VolumesDeleteCascade-1918754692 None] Snapshots deleted, issuing volume delete {{(pid=88641) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Aug 10 15:59:17 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-208d15cf-991e-4369-8238-65391c4bad2a tempest-VolumesDeleteCascade-1918754692 None] Acquiring lock "cinder-quobyte-9005ba82-fcfc-4539-bf51-65634cc74c89" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 15:59:17 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-208d15cf-991e-4369-8238-65391c4bad2a tempest-VolumesDeleteCascade-1918754692 None] Lock "cinder-quobyte-9005ba82-fcfc-4539-bf51-65634cc74c89" acquired by "delete_volume" :: waited 0.033s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 15:59:17 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab0852e-2c76-4aa3-9b2e-2855da6569a6]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 15:59:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-208d15cf-991e-4369-8238-65391c4bad2a tempest-VolumesDeleteCascade-1918754692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9005ba82-fcfc-4539-bf51-65634cc74c89 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:59:17 devstack sudo[95091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9005ba82-fcfc-4539-bf51-65634cc74c89 Aug 10 15:59:17 devstack sudo[95091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:59:17 devstack sudo[95091]: pam_unix(sudo:session): session closed for user root Aug 10 15:59:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-208d15cf-991e-4369-8238-65391c4bad2a tempest-VolumesDeleteCascade-1918754692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9005ba82-fcfc-4539-bf51-65634cc74c89" returned: 0 in 0.531s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:59:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-208d15cf-991e-4369-8238-65391c4bad2a tempest-VolumesDeleteCascade-1918754692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9005ba82-fcfc-4539-bf51-65634cc74c89 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:59:17 devstack sudo[95102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9005ba82-fcfc-4539-bf51-65634cc74c89 Aug 10 15:59:17 devstack sudo[95102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:59:17 devstack cinder-volume[88641]: INFO cinder.volume.manager [req-417fae05-7c90-4739-914b-9d70e32c64cd req-05dfe807-b925-4c08-8e5b-a5e2e7e16e5f tempest-ServerActionsTestOtherA-603942358 None] Terminate volume connection completed successfully. Aug 10 15:59:17 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [req-417fae05-7c90-4739-914b-9d70e32c64cd req-05dfe807-b925-4c08-8e5b-a5e2e7e16e5f tempest-ServerActionsTestOtherA-603942358 None] Deleting attachment 31109727-5cec-4d13-806e-c5d98d5d8e17. {{(pid=88641) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 10 15:59:18 devstack sudo[95102]: pam_unix(sudo:session): session closed for user root Aug 10 15:59:18 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-208d15cf-991e-4369-8238-65391c4bad2a tempest-VolumesDeleteCascade-1918754692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9005ba82-fcfc-4539-bf51-65634cc74c89" returned: 0 in 0.636s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:59:18 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-208d15cf-991e-4369-8238-65391c4bad2a tempest-VolumesDeleteCascade-1918754692 None] Lock "cinder-quobyte-9005ba82-fcfc-4539-bf51-65634cc74c89" released by "delete_volume" :: held 1.280s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 15:59:18 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-208d15cf-991e-4369-8238-65391c4bad2a tempest-VolumesDeleteCascade-1918754692 None] Created reservations ['d6b5e4f1-f75d-4fd7-a23f-4e560e74552e', '7f6161fa-79c8-40e2-bede-a465808173f8', '1156fce3-7008-45c8-9778-c4739044c52c', '70a1b9df-8e6f-4412-8b93-fc2d7b579a35'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 15:59:18 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-208d15cf-991e-4369-8238-65391c4bad2a tempest-VolumesDeleteCascade-1918754692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:59:18 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-208d15cf-991e-4369-8238-65391c4bad2a tempest-VolumesDeleteCascade-1918754692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:59:18 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-208d15cf-991e-4369-8238-65391c4bad2a tempest-VolumesDeleteCascade-1918754692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 15:59:18 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-208d15cf-991e-4369-8238-65391c4bad2a tempest-VolumesDeleteCascade-1918754692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 15:59:18 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-208d15cf-991e-4369-8238-65391c4bad2a tempest-VolumesDeleteCascade-1918754692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:59:18 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-208d15cf-991e-4369-8238-65391c4bad2a tempest-VolumesDeleteCascade-1918754692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:59:18 devstack sudo[95147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 15:59:18 devstack sudo[95147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:59:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-417fae05-7c90-4739-914b-9d70e32c64cd req-f19e0459-abe6-4a77-bc1a-f00ed132fc92 tempest-ServerActionsTestOtherA-603942358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:59:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-417fae05-7c90-4739-914b-9d70e32c64cd req-f19e0459-abe6-4a77-bc1a-f00ed132fc92 tempest-ServerActionsTestOtherA-603942358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:59:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-417fae05-7c90-4739-914b-9d70e32c64cd req-f19e0459-abe6-4a77-bc1a-f00ed132fc92 tempest-ServerActionsTestOtherA-603942358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:59:19 devstack sudo[95147]: pam_unix(sudo:session): session closed for user root Aug 10 15:59:19 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [req-417fae05-7c90-4739-914b-9d70e32c64cd req-f19e0459-abe6-4a77-bc1a-f00ed132fc92 tempest-ServerActionsTestOtherA-603942358 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc', 'name': 'volume-93d9738d-5344-4405-b96b-e31d4c227d5f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '335db6ef-2598-474a-8fd9-f4be69f49021', 'enforce_multipath': True} {{(pid=88641) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 10 15:59:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-208d15cf-991e-4369-8238-65391c4bad2a tempest-VolumesDeleteCascade-1918754692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.672s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:59:19 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-208d15cf-991e-4369-8238-65391c4bad2a tempest-VolumesDeleteCascade-1918754692 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 15:59:19 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-208d15cf-991e-4369-8238-65391c4bad2a tempest-VolumesDeleteCascade-1918754692 None] Deleted volume successfully. Aug 10 15:59:19 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-208d15cf-991e-4369-8238-65391c4bad2a tempest-VolumesDeleteCascade-1918754692 None] Lock "cinder-9005ba82-fcfc-4539-bf51-65634cc74c89-delete_volume" released by "delete_volume" :: held 10.361s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 15:59:19 devstack cinder-volume[88641]: INFO cinder.volume.manager [req-417fae05-7c90-4739-914b-9d70e32c64cd req-f19e0459-abe6-4a77-bc1a-f00ed132fc92 tempest-ServerActionsTestOtherA-603942358 None] attachment_update completed successfully. Aug 10 15:59:20 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f6737b7-bdee-4964-b34a-7cffd552e158 tempest-VolumesDeleteCascade-1918754692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 15:59:20 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-5f6737b7-bdee-4964-b34a-7cffd552e158 tempest-VolumesDeleteCascade-1918754692 None] Flow 'volume_create_manager' (19d3951e-e755-46cd-bf81-577fd5dbfecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 15:59:20 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-5f6737b7-bdee-4964-b34a-7cffd552e158 tempest-VolumesDeleteCascade-1918754692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bd84003-d87d-47d2-83b4-19a323252055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:59:20 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-5f6737b7-bdee-4964-b34a-7cffd552e158 tempest-VolumesDeleteCascade-1918754692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bd84003-d87d-47d2-83b4-19a323252055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T13:59:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-98775772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21bca8a7-c625-47b9-9cd7-60f9436b5b86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90d846f54db94d0c929f31362760167e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T13:59:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T13:59:21Z,use_quota=True,user_id='15518b426406402dafa1cc06e9d62f83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:59:21 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-5f6737b7-bdee-4964-b34a-7cffd552e158 tempest-VolumesDeleteCascade-1918754692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (314a6983-a337-42f4-9c7c-24a9ade66864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:59:21 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-5f6737b7-bdee-4964-b34a-7cffd552e158 tempest-VolumesDeleteCascade-1918754692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (314a6983-a337-42f4-9c7c-24a9ade66864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:59:21 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-5f6737b7-bdee-4964-b34a-7cffd552e158 tempest-VolumesDeleteCascade-1918754692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfde8fb5-dd50-4859-b64a-5c40c027816f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:59:21 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-5f6737b7-bdee-4964-b34a-7cffd552e158 tempest-VolumesDeleteCascade-1918754692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfde8fb5-dd50-4859-b64a-5c40c027816f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21bca8a7-c625-47b9-9cd7-60f9436b5b86', 'volume_name': 'volume-21bca8a7-c625-47b9-9cd7-60f9436b5b86', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:59:21 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-5f6737b7-bdee-4964-b34a-7cffd552e158 tempest-VolumesDeleteCascade-1918754692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (833af249-f83d-4325-ad9c-ffa31d34cec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:59:21 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-5f6737b7-bdee-4964-b34a-7cffd552e158 tempest-VolumesDeleteCascade-1918754692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (833af249-f83d-4325-ad9c-ffa31d34cec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:59:21 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-5f6737b7-bdee-4964-b34a-7cffd552e158 tempest-VolumesDeleteCascade-1918754692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cceb695-ec34-435a-9595-9c1071afa7cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:59:21 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-5f6737b7-bdee-4964-b34a-7cffd552e158 tempest-VolumesDeleteCascade-1918754692 None] Volume 21bca8a7-c625-47b9-9cd7-60f9436b5b86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21bca8a7-c625-47b9-9cd7-60f9436b5b86', 'volume_size': 1} Aug 10 15:59:21 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-5f6737b7-bdee-4964-b34a-7cffd552e158 tempest-VolumesDeleteCascade-1918754692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:59:21 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-5f6737b7-bdee-4964-b34a-7cffd552e158 tempest-VolumesDeleteCascade-1918754692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:59:21 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-5f6737b7-bdee-4964-b34a-7cffd552e158 tempest-VolumesDeleteCascade-1918754692 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T13:59:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-98775772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21bca8a7-c625-47b9-9cd7-60f9436b5b86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90d846f54db94d0c929f31362760167e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T13:59:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T13:59:21Z,use_quota=True,user_id='15518b426406402dafa1cc06e9d62f83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 15:59:21 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-5f6737b7-bdee-4964-b34a-7cffd552e158 tempest-VolumesDeleteCascade-1918754692 None] Creating volume 21bca8a7-c625-47b9-9cd7-60f9436b5b86 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 15:59:21 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-5f6737b7-bdee-4964-b34a-7cffd552e158 tempest-VolumesDeleteCascade-1918754692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:59:21 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-5f6737b7-bdee-4964-b34a-7cffd552e158 tempest-VolumesDeleteCascade-1918754692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:59:21 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-5f6737b7-bdee-4964-b34a-7cffd552e158 tempest-VolumesDeleteCascade-1918754692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 15:59:21 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-5f6737b7-bdee-4964-b34a-7cffd552e158 tempest-VolumesDeleteCascade-1918754692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 15:59:21 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-5f6737b7-bdee-4964-b34a-7cffd552e158 tempest-VolumesDeleteCascade-1918754692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:59:21 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-5f6737b7-bdee-4964-b34a-7cffd552e158 tempest-VolumesDeleteCascade-1918754692 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 15:59:21 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-5f6737b7-bdee-4964-b34a-7cffd552e158 tempest-VolumesDeleteCascade-1918754692 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 15:59:21 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5f6737b7-bdee-4964-b34a-7cffd552e158 tempest-VolumesDeleteCascade-1918754692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-21bca8a7-c625-47b9-9cd7-60f9436b5b86 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:59:21 devstack sudo[95196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-21bca8a7-c625-47b9-9cd7-60f9436b5b86 1073741824 Aug 10 15:59:21 devstack sudo[95196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:59:21 devstack sudo[95196]: pam_unix(sudo:session): session closed for user root Aug 10 15:59:21 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5f6737b7-bdee-4964-b34a-7cffd552e158 tempest-VolumesDeleteCascade-1918754692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-21bca8a7-c625-47b9-9cd7-60f9436b5b86 1073741824" returned: 0 in 0.757s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:59:21 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5f6737b7-bdee-4964-b34a-7cffd552e158 tempest-VolumesDeleteCascade-1918754692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-21bca8a7-c625-47b9-9cd7-60f9436b5b86 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:59:21 devstack sudo[95278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-21bca8a7-c625-47b9-9cd7-60f9436b5b86 Aug 10 15:59:21 devstack sudo[95278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:59:22 devstack sudo[95278]: pam_unix(sudo:session): session closed for user root Aug 10 15:59:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5f6737b7-bdee-4964-b34a-7cffd552e158 tempest-VolumesDeleteCascade-1918754692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-21bca8a7-c625-47b9-9cd7-60f9436b5b86" returned: 0 in 0.458s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:59:22 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-5f6737b7-bdee-4964-b34a-7cffd552e158 tempest-VolumesDeleteCascade-1918754692 None] <== create_volume: return (1282ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 15:59:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-5f6737b7-bdee-4964-b34a-7cffd552e158 tempest-VolumesDeleteCascade-1918754692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.286s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:59:22 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-5f6737b7-bdee-4964-b34a-7cffd552e158 tempest-VolumesDeleteCascade-1918754692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cceb695-ec34-435a-9595-9c1071afa7cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21bca8a7-c625-47b9-9cd7-60f9436b5b86', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:59:22 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-5f6737b7-bdee-4964-b34a-7cffd552e158 tempest-VolumesDeleteCascade-1918754692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aafca984-65d2-49dc-9a70-64d51456da7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:59:22 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-5f6737b7-bdee-4964-b34a-7cffd552e158 tempest-VolumesDeleteCascade-1918754692 None] Volume volume-21bca8a7-c625-47b9-9cd7-60f9436b5b86 (21bca8a7-c625-47b9-9cd7-60f9436b5b86): created successfully Aug 10 15:59:22 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-5f6737b7-bdee-4964-b34a-7cffd552e158 tempest-VolumesDeleteCascade-1918754692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aafca984-65d2-49dc-9a70-64d51456da7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:59:22 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-5f6737b7-bdee-4964-b34a-7cffd552e158 tempest-VolumesDeleteCascade-1918754692 None] Flow 'volume_create_manager' (19d3951e-e755-46cd-bf81-577fd5dbfecb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 15:59:22 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-5f6737b7-bdee-4964-b34a-7cffd552e158 tempest-VolumesDeleteCascade-1918754692 None] Created volume successfully. Aug 10 15:59:23 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-684bcfa1-61a9-4dc6-b300-2f61b47233cc tempest-VolumesDeleteCascade-1918754692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:59:23 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-684bcfa1-61a9-4dc6-b300-2f61b47233cc tempest-VolumesDeleteCascade-1918754692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:59:23 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-684bcfa1-61a9-4dc6-b300-2f61b47233cc tempest-VolumesDeleteCascade-1918754692 None] Creating offline snapshot ac7f0b1a-222d-4d73-bd0a-e63fa6319f2e of volume 21bca8a7-c625-47b9-9cd7-60f9436b5b86 {{(pid=88641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 15:59:23 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[98640000-ae96-4867-8ca1-0ff69dc7028e]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 15:59:23 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-684bcfa1-61a9-4dc6-b300-2f61b47233cc tempest-VolumesDeleteCascade-1918754692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-21bca8a7-c625-47b9-9cd7-60f9436b5b86 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:59:23 devstack sudo[95634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-21bca8a7-c625-47b9-9cd7-60f9436b5b86 Aug 10 15:59:23 devstack sudo[95634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:59:23 devstack sudo[95634]: pam_unix(sudo:session): session closed for user root Aug 10 15:59:23 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-684bcfa1-61a9-4dc6-b300-2f61b47233cc tempest-VolumesDeleteCascade-1918754692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-21bca8a7-c625-47b9-9cd7-60f9436b5b86" returned: 0 in 0.450s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:59:23 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-684bcfa1-61a9-4dc6-b300-2f61b47233cc tempest-VolumesDeleteCascade-1918754692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-21bca8a7-c625-47b9-9cd7-60f9436b5b86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-21bca8a7-c625-47b9-9cd7-60f9436b5b86.ac7f0b1a-222d-4d73-bd0a-e63fa6319f2e 1G {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:59:23 devstack sudo[95653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-21bca8a7-c625-47b9-9cd7-60f9436b5b86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-21bca8a7-c625-47b9-9cd7-60f9436b5b86.ac7f0b1a-222d-4d73-bd0a-e63fa6319f2e 1G Aug 10 15:59:23 devstack sudo[95653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:59:24 devstack sudo[95653]: pam_unix(sudo:session): session closed for user root Aug 10 15:59:24 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-684bcfa1-61a9-4dc6-b300-2f61b47233cc tempest-VolumesDeleteCascade-1918754692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-21bca8a7-c625-47b9-9cd7-60f9436b5b86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-21bca8a7-c625-47b9-9cd7-60f9436b5b86.ac7f0b1a-222d-4d73-bd0a-e63fa6319f2e 1G" returned: 0 in 0.670s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:59:24 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-684bcfa1-61a9-4dc6-b300-2f61b47233cc tempest-VolumesDeleteCascade-1918754692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21bca8a7-c625-47b9-9cd7-60f9436b5b86 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-21bca8a7-c625-47b9-9cd7-60f9436b5b86.ac7f0b1a-222d-4d73-bd0a-e63fa6319f2e {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:59:24 devstack sudo[95660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21bca8a7-c625-47b9-9cd7-60f9436b5b86 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-21bca8a7-c625-47b9-9cd7-60f9436b5b86.ac7f0b1a-222d-4d73-bd0a-e63fa6319f2e Aug 10 15:59:24 devstack sudo[95660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:59:24 devstack sudo[95660]: pam_unix(sudo:session): session closed for user root Aug 10 15:59:24 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-684bcfa1-61a9-4dc6-b300-2f61b47233cc tempest-VolumesDeleteCascade-1918754692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21bca8a7-c625-47b9-9cd7-60f9436b5b86 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-21bca8a7-c625-47b9-9cd7-60f9436b5b86.ac7f0b1a-222d-4d73-bd0a-e63fa6319f2e" returned: 0 in 0.412s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:59:24 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-684bcfa1-61a9-4dc6-b300-2f61b47233cc tempest-VolumesDeleteCascade-1918754692 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-21bca8a7-c625-47b9-9cd7-60f9436b5b86.ac7f0b1a-222d-4d73-bd0a-e63fa6319f2e is being set with open permissions: ugo+rw Aug 10 15:59:24 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-684bcfa1-61a9-4dc6-b300-2f61b47233cc tempest-VolumesDeleteCascade-1918754692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-21bca8a7-c625-47b9-9cd7-60f9436b5b86.ac7f0b1a-222d-4d73-bd0a-e63fa6319f2e {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:59:24 devstack sudo[95668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-21bca8a7-c625-47b9-9cd7-60f9436b5b86.ac7f0b1a-222d-4d73-bd0a-e63fa6319f2e Aug 10 15:59:24 devstack sudo[95668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:59:25 devstack sudo[95668]: pam_unix(sudo:session): session closed for user root Aug 10 15:59:25 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-684bcfa1-61a9-4dc6-b300-2f61b47233cc tempest-VolumesDeleteCascade-1918754692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-21bca8a7-c625-47b9-9cd7-60f9436b5b86.ac7f0b1a-222d-4d73-bd0a-e63fa6319f2e" returned: 0 in 0.360s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:59:25 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-684bcfa1-61a9-4dc6-b300-2f61b47233cc tempest-VolumesDeleteCascade-1918754692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-21bca8a7-c625-47b9-9cd7-60f9436b5b86.info {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:59:25 devstack sudo[95672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-21bca8a7-c625-47b9-9cd7-60f9436b5b86.info Aug 10 15:59:25 devstack sudo[95672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:59:25 devstack sudo[95672]: pam_unix(sudo:session): session closed for user root Aug 10 15:59:25 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-684bcfa1-61a9-4dc6-b300-2f61b47233cc tempest-VolumesDeleteCascade-1918754692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-21bca8a7-c625-47b9-9cd7-60f9436b5b86.info" returned: 0 in 0.323s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:59:25 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-684bcfa1-61a9-4dc6-b300-2f61b47233cc tempest-VolumesDeleteCascade-1918754692 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-21bca8a7-c625-47b9-9cd7-60f9436b5b86.info is being set with open permissions: ugo+rw Aug 10 15:59:25 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-684bcfa1-61a9-4dc6-b300-2f61b47233cc tempest-VolumesDeleteCascade-1918754692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-21bca8a7-c625-47b9-9cd7-60f9436b5b86.info {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:59:25 devstack sudo[95675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-21bca8a7-c625-47b9-9cd7-60f9436b5b86.info Aug 10 15:59:25 devstack sudo[95675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:59:26 devstack sudo[95675]: pam_unix(sudo:session): session closed for user root Aug 10 15:59:26 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-684bcfa1-61a9-4dc6-b300-2f61b47233cc tempest-VolumesDeleteCascade-1918754692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-21bca8a7-c625-47b9-9cd7-60f9436b5b86.info" returned: 0 in 0.436s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:59:26 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-684bcfa1-61a9-4dc6-b300-2f61b47233cc tempest-VolumesDeleteCascade-1918754692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.800s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:59:26 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-684bcfa1-61a9-4dc6-b300-2f61b47233cc tempest-VolumesDeleteCascade-1918754692 None] Create snapshot completed successfully Aug 10 15:59:27 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c2d01a4-99e3-4ebd-b44d-e32c7bd9ea15 tempest-VolumesDeleteCascade-1918754692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 15:59:27 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-6c2d01a4-99e3-4ebd-b44d-e32c7bd9ea15 tempest-VolumesDeleteCascade-1918754692 None] Flow 'volume_create_manager' (a09e94f2-2582-45aa-bd1e-8956414e259b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 15:59:27 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-6c2d01a4-99e3-4ebd-b44d-e32c7bd9ea15 tempest-VolumesDeleteCascade-1918754692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e86bf29a-d47d-4d18-8847-e9f1f6556d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:59:27 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-6c2d01a4-99e3-4ebd-b44d-e32c7bd9ea15 tempest-VolumesDeleteCascade-1918754692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e86bf29a-d47d-4d18-8847-e9f1f6556d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T13:59:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1089768756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fd632d1-c10a-4ca0-bf77-18aaee01547e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90d846f54db94d0c929f31362760167e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T13:59:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ac7f0b1a-222d-4d73-bd0a-e63fa6319f2e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T13:59:27Z,use_quota=True,user_id='15518b426406402dafa1cc06e9d62f83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:59:27 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-6c2d01a4-99e3-4ebd-b44d-e32c7bd9ea15 tempest-VolumesDeleteCascade-1918754692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef40d1bd-c139-4199-8619-33da3bd28330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:59:27 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-6c2d01a4-99e3-4ebd-b44d-e32c7bd9ea15 tempest-VolumesDeleteCascade-1918754692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef40d1bd-c139-4199-8619-33da3bd28330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:59:27 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-6c2d01a4-99e3-4ebd-b44d-e32c7bd9ea15 tempest-VolumesDeleteCascade-1918754692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4d3826b-8381-4385-9930-9392a9b615c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:59:27 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-6c2d01a4-99e3-4ebd-b44d-e32c7bd9ea15 tempest-VolumesDeleteCascade-1918754692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4d3826b-8381-4385-9930-9392a9b615c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0fd632d1-c10a-4ca0-bf77-18aaee01547e', 'volume_name': 'volume-0fd632d1-c10a-4ca0-bf77-18aaee01547e', 'volume_size': 1, 'snapshot_id': 'ac7f0b1a-222d-4d73-bd0a-e63fa6319f2e'}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:59:27 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-6c2d01a4-99e3-4ebd-b44d-e32c7bd9ea15 tempest-VolumesDeleteCascade-1918754692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a7e9345-7745-4125-abea-b799d3779cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:59:27 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-6c2d01a4-99e3-4ebd-b44d-e32c7bd9ea15 tempest-VolumesDeleteCascade-1918754692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a7e9345-7745-4125-abea-b799d3779cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:59:27 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-6c2d01a4-99e3-4ebd-b44d-e32c7bd9ea15 tempest-VolumesDeleteCascade-1918754692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (644f5379-3f33-4749-8d09-28309f7d3f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:59:27 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-6c2d01a4-99e3-4ebd-b44d-e32c7bd9ea15 tempest-VolumesDeleteCascade-1918754692 None] Volume 0fd632d1-c10a-4ca0-bf77-18aaee01547e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0fd632d1-c10a-4ca0-bf77-18aaee01547e', 'volume_size': 1, 'snapshot_id': 'ac7f0b1a-222d-4d73-bd0a-e63fa6319f2e'} Aug 10 15:59:27 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-6c2d01a4-99e3-4ebd-b44d-e32c7bd9ea15 tempest-VolumesDeleteCascade-1918754692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:59:27 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-6c2d01a4-99e3-4ebd-b44d-e32c7bd9ea15 tempest-VolumesDeleteCascade-1918754692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.003s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:59:27 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-6c2d01a4-99e3-4ebd-b44d-e32c7bd9ea15 tempest-VolumesDeleteCascade-1918754692 None] Acquiring lock "cinder-quobyte-ac7f0b1a-222d-4d73-bd0a-e63fa6319f2e-0fd632d1-c10a-4ca0-bf77-18aaee01547e" by "_create_volume_from_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 15:59:27 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-6c2d01a4-99e3-4ebd-b44d-e32c7bd9ea15 tempest-VolumesDeleteCascade-1918754692 None] Lock "cinder-quobyte-ac7f0b1a-222d-4d73-bd0a-e63fa6319f2e-0fd632d1-c10a-4ca0-bf77-18aaee01547e" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 15:59:27 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-6c2d01a4-99e3-4ebd-b44d-e32c7bd9ea15 tempest-VolumesDeleteCascade-1918754692 None] Creating volume 0fd632d1-c10a-4ca0-bf77-18aaee01547e from snapshot ac7f0b1a-222d-4d73-bd0a-e63fa6319f2e {{(pid=88641) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 10 15:59:27 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-6c2d01a4-99e3-4ebd-b44d-e32c7bd9ea15 tempest-VolumesDeleteCascade-1918754692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:59:27 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-6c2d01a4-99e3-4ebd-b44d-e32c7bd9ea15 tempest-VolumesDeleteCascade-1918754692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:59:27 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-6c2d01a4-99e3-4ebd-b44d-e32c7bd9ea15 tempest-VolumesDeleteCascade-1918754692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 15:59:27 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-6c2d01a4-99e3-4ebd-b44d-e32c7bd9ea15 tempest-VolumesDeleteCascade-1918754692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 15:59:27 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-6c2d01a4-99e3-4ebd-b44d-e32c7bd9ea15 tempest-VolumesDeleteCascade-1918754692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:59:27 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-6c2d01a4-99e3-4ebd-b44d-e32c7bd9ea15 tempest-VolumesDeleteCascade-1918754692 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 15:59:27 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-6c2d01a4-99e3-4ebd-b44d-e32c7bd9ea15 tempest-VolumesDeleteCascade-1918754692 None] Acquiring lock "cinder-quobyte-0fd632d1-c10a-4ca0-bf77-18aaee01547e" by "_copy_volume_from_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 15:59:27 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-6c2d01a4-99e3-4ebd-b44d-e32c7bd9ea15 tempest-VolumesDeleteCascade-1918754692 None] Lock "cinder-quobyte-0fd632d1-c10a-4ca0-bf77-18aaee01547e" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 15:59:27 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-6c2d01a4-99e3-4ebd-b44d-e32c7bd9ea15 tempest-VolumesDeleteCascade-1918754692 None] snapshot: ac7f0b1a-222d-4d73-bd0a-e63fa6319f2e, volume: 0fd632d1-c10a-4ca0-bf77-18aaee01547e, {{(pid=88641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 10 15:59:28 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-6c2d01a4-99e3-4ebd-b44d-e32c7bd9ea15 tempest-VolumesDeleteCascade-1918754692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:59:28 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-6c2d01a4-99e3-4ebd-b44d-e32c7bd9ea15 tempest-VolumesDeleteCascade-1918754692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:59:28 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-6c2d01a4-99e3-4ebd-b44d-e32c7bd9ea15 tempest-VolumesDeleteCascade-1918754692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 15:59:28 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-6c2d01a4-99e3-4ebd-b44d-e32c7bd9ea15 tempest-VolumesDeleteCascade-1918754692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 15:59:28 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-6c2d01a4-99e3-4ebd-b44d-e32c7bd9ea15 tempest-VolumesDeleteCascade-1918754692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:59:28 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f9e766f-bf78-4893-8957-b1d24e19af90]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 15:59:28 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6c2d01a4-99e3-4ebd-b44d-e32c7bd9ea15 tempest-VolumesDeleteCascade-1918754692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-21bca8a7-c625-47b9-9cd7-60f9436b5b86.ac7f0b1a-222d-4d73-bd0a-e63fa6319f2e {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:59:28 devstack sudo[95680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-21bca8a7-c625-47b9-9cd7-60f9436b5b86.ac7f0b1a-222d-4d73-bd0a-e63fa6319f2e Aug 10 15:59:28 devstack sudo[95680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:59:28 devstack sudo[95680]: pam_unix(sudo:session): session closed for user root Aug 10 15:59:28 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6c2d01a4-99e3-4ebd-b44d-e32c7bd9ea15 tempest-VolumesDeleteCascade-1918754692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-21bca8a7-c625-47b9-9cd7-60f9436b5b86.ac7f0b1a-222d-4d73-bd0a-e63fa6319f2e" returned: 0 in 0.748s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:59:28 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-6c2d01a4-99e3-4ebd-b44d-e32c7bd9ea15 tempest-VolumesDeleteCascade-1918754692 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21bca8a7-c625-47b9-9cd7-60f9436b5b86(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 15:59:28 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c23bc1a-11a4-401e-a75d-dcc63e96d9bb]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 15:59:28 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6c2d01a4-99e3-4ebd-b44d-e32c7bd9ea15 tempest-VolumesDeleteCascade-1918754692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-21bca8a7-c625-47b9-9cd7-60f9436b5b86 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:59:29 devstack sudo[95702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-21bca8a7-c625-47b9-9cd7-60f9436b5b86 Aug 10 15:59:29 devstack sudo[95702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:59:29 devstack sudo[95702]: pam_unix(sudo:session): session closed for user root Aug 10 15:59:29 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6c2d01a4-99e3-4ebd-b44d-e32c7bd9ea15 tempest-VolumesDeleteCascade-1918754692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-21bca8a7-c625-47b9-9cd7-60f9436b5b86" returned: 0 in 0.523s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:59:29 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-6c2d01a4-99e3-4ebd-b44d-e32c7bd9ea15 tempest-VolumesDeleteCascade-1918754692 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-21bca8a7-c625-47b9-9cd7-60f9436b5b86 {{(pid=88641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 10 15:59:29 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-6c2d01a4-99e3-4ebd-b44d-e32c7bd9ea15 tempest-VolumesDeleteCascade-1918754692 None] Creating direct copy from snapshot {{(pid=88641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 10 15:59:29 devstack cinder-volume[88641]: DEBUG cinder.utils [None req-6c2d01a4-99e3-4ebd-b44d-e32c7bd9ea15 tempest-VolumesDeleteCascade-1918754692 None] Path /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-0fd632d1-c10a-4ca0-bf77-18aaee01547e not found in is_blk_device check {{(pid=88641) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 10 15:59:29 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6c2d01a4-99e3-4ebd-b44d-e32c7bd9ea15 tempest-VolumesDeleteCascade-1918754692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-21bca8a7-c625-47b9-9cd7-60f9436b5b86 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-0fd632d1-c10a-4ca0-bf77-18aaee01547e {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:59:29 devstack sudo[95718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-21bca8a7-c625-47b9-9cd7-60f9436b5b86 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-0fd632d1-c10a-4ca0-bf77-18aaee01547e Aug 10 15:59:29 devstack sudo[95718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:59:32 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-d45d25ac-cdc0-4976-880c-5de32110e2f0 tempest-AttachVolumeNegativeTest-115562770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 15:59:32 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d45d25ac-cdc0-4976-880c-5de32110e2f0 tempest-AttachVolumeNegativeTest-115562770 None] Flow 'volume_create_manager' (89d8aa03-87a1-4af5-9c1e-4862e883df3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 15:59:32 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d45d25ac-cdc0-4976-880c-5de32110e2f0 tempest-AttachVolumeNegativeTest-115562770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69e0e037-6e07-458d-b309-c0ba51bcf251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:59:32 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d45d25ac-cdc0-4976-880c-5de32110e2f0 tempest-AttachVolumeNegativeTest-115562770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69e0e037-6e07-458d-b309-c0ba51bcf251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T13:59:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-880441432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e65b158e-64ec-4b88-9bca-2eba16b3bb5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1ea2d0922df4e428db877fa475d5545',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T13:59:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T13:59:33Z,use_quota=True,user_id='96c1046256454dda9eac6d8c860ab370',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:59:32 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d45d25ac-cdc0-4976-880c-5de32110e2f0 tempest-AttachVolumeNegativeTest-115562770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bb672fd-ade1-425f-85c5-9c465199e305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:59:33 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d45d25ac-cdc0-4976-880c-5de32110e2f0 tempest-AttachVolumeNegativeTest-115562770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bb672fd-ade1-425f-85c5-9c465199e305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:59:33 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d45d25ac-cdc0-4976-880c-5de32110e2f0 tempest-AttachVolumeNegativeTest-115562770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d78fc7f-7de9-4495-ac05-62b0b5f648bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:59:33 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d45d25ac-cdc0-4976-880c-5de32110e2f0 tempest-AttachVolumeNegativeTest-115562770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d78fc7f-7de9-4495-ac05-62b0b5f648bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e65b158e-64ec-4b88-9bca-2eba16b3bb5e', 'volume_name': 'volume-e65b158e-64ec-4b88-9bca-2eba16b3bb5e', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:59:33 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d45d25ac-cdc0-4976-880c-5de32110e2f0 tempest-AttachVolumeNegativeTest-115562770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd0a3c3b-f8a8-4e13-8cd6-51004c265785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:59:33 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d45d25ac-cdc0-4976-880c-5de32110e2f0 tempest-AttachVolumeNegativeTest-115562770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd0a3c3b-f8a8-4e13-8cd6-51004c265785) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:59:33 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d45d25ac-cdc0-4976-880c-5de32110e2f0 tempest-AttachVolumeNegativeTest-115562770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4b92d92-9f18-4471-a5f6-cc9fb35bfad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:59:33 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-d45d25ac-cdc0-4976-880c-5de32110e2f0 tempest-AttachVolumeNegativeTest-115562770 None] Volume e65b158e-64ec-4b88-9bca-2eba16b3bb5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e65b158e-64ec-4b88-9bca-2eba16b3bb5e', 'volume_size': 1} Aug 10 15:59:33 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-d45d25ac-cdc0-4976-880c-5de32110e2f0 tempest-AttachVolumeNegativeTest-115562770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:59:36 devstack cinder-volume[88641]: DEBUG oslo_service.periodic_task [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88641) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 15:59:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:59:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:59:36 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 15:59:36 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 15:59:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:59:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:59:36 devstack sudo[95750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 15:59:36 devstack sudo[95750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:59:37 devstack sudo[95718]: pam_unix(sudo:session): session closed for user root Aug 10 15:59:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6c2d01a4-99e3-4ebd-b44d-e32c7bd9ea15 tempest-VolumesDeleteCascade-1918754692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-21bca8a7-c625-47b9-9cd7-60f9436b5b86 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-0fd632d1-c10a-4ca0-bf77-18aaee01547e" returned: 0 in 7.987s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:59:37 devstack cinder-volume[88641]: DEBUG cinder.image.image_utils [None req-6c2d01a4-99e3-4ebd-b44d-e32c7bd9ea15 tempest-VolumesDeleteCascade-1918754692 None] Image conversion details: src /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-21bca8a7-c625-47b9-9cd7-60f9436b5b86, size 1024.00 MB, duration 7.99 sec, destination /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-0fd632d1-c10a-4ca0-bf77-18aaee01547e {{(pid=88641) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 10 15:59:37 devstack cinder-volume[88641]: INFO cinder.image.image_utils [None req-6c2d01a4-99e3-4ebd-b44d-e32c7bd9ea15 tempest-VolumesDeleteCascade-1918754692 None] Converted 1024.00 MB image at 128.19 MB/s Aug 10 15:59:37 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-6c2d01a4-99e3-4ebd-b44d-e32c7bd9ea15 tempest-VolumesDeleteCascade-1918754692 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-0fd632d1-c10a-4ca0-bf77-18aaee01547e is being set with open permissions: ugo+rw Aug 10 15:59:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6c2d01a4-99e3-4ebd-b44d-e32c7bd9ea15 tempest-VolumesDeleteCascade-1918754692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-0fd632d1-c10a-4ca0-bf77-18aaee01547e {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:59:37 devstack sudo[95754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-0fd632d1-c10a-4ca0-bf77-18aaee01547e Aug 10 15:59:37 devstack sudo[95754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:59:37 devstack sudo[95750]: pam_unix(sudo:session): session closed for user root Aug 10 15:59:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.944s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:59:37 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 15:59:37 devstack cinder-volume[88641]: DEBUG oslo_service.periodic_task [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Running periodic task VolumeManager._thread_info {{(pid=88641) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 15:59:37 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] thread count: 8 {{(pid=88641) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 10 15:59:37 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] thread info: [<_MainThread(MainThread, started 127361545748608)>, , , , , , , ] {{(pid=88641) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 10 15:59:37 devstack sudo[95754]: pam_unix(sudo:session): session closed for user root Aug 10 15:59:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6c2d01a4-99e3-4ebd-b44d-e32c7bd9ea15 tempest-VolumesDeleteCascade-1918754692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-0fd632d1-c10a-4ca0-bf77-18aaee01547e" returned: 0 in 0.305s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:59:37 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-6c2d01a4-99e3-4ebd-b44d-e32c7bd9ea15 tempest-VolumesDeleteCascade-1918754692 None] Lock "cinder-quobyte-0fd632d1-c10a-4ca0-bf77-18aaee01547e" released by "_copy_volume_from_snapshot" :: held 9.765s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 15:59:37 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-6c2d01a4-99e3-4ebd-b44d-e32c7bd9ea15 tempest-VolumesDeleteCascade-1918754692 None] Lock "cinder-quobyte-ac7f0b1a-222d-4d73-bd0a-e63fa6319f2e-0fd632d1-c10a-4ca0-bf77-18aaee01547e" released by "_create_volume_from_snapshot" :: held 9.909s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 15:59:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-6c2d01a4-99e3-4ebd-b44d-e32c7bd9ea15 tempest-VolumesDeleteCascade-1918754692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.947s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:59:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-d45d25ac-cdc0-4976-880c-5de32110e2f0 tempest-AttachVolumeNegativeTest-115562770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.734s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:59:37 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-d45d25ac-cdc0-4976-880c-5de32110e2f0 tempest-AttachVolumeNegativeTest-115562770 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T13:59:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-880441432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e65b158e-64ec-4b88-9bca-2eba16b3bb5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1ea2d0922df4e428db877fa475d5545',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T13:59:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T13:59:33Z,use_quota=True,user_id='96c1046256454dda9eac6d8c860ab370',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 15:59:37 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-d45d25ac-cdc0-4976-880c-5de32110e2f0 tempest-AttachVolumeNegativeTest-115562770 None] Creating volume e65b158e-64ec-4b88-9bca-2eba16b3bb5e {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 15:59:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-d45d25ac-cdc0-4976-880c-5de32110e2f0 tempest-AttachVolumeNegativeTest-115562770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:59:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-d45d25ac-cdc0-4976-880c-5de32110e2f0 tempest-AttachVolumeNegativeTest-115562770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:59:37 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-d45d25ac-cdc0-4976-880c-5de32110e2f0 tempest-AttachVolumeNegativeTest-115562770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 15:59:37 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-d45d25ac-cdc0-4976-880c-5de32110e2f0 tempest-AttachVolumeNegativeTest-115562770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 15:59:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-d45d25ac-cdc0-4976-880c-5de32110e2f0 tempest-AttachVolumeNegativeTest-115562770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:59:37 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-d45d25ac-cdc0-4976-880c-5de32110e2f0 tempest-AttachVolumeNegativeTest-115562770 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 15:59:37 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-d45d25ac-cdc0-4976-880c-5de32110e2f0 tempest-AttachVolumeNegativeTest-115562770 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 15:59:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d45d25ac-cdc0-4976-880c-5de32110e2f0 tempest-AttachVolumeNegativeTest-115562770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-e65b158e-64ec-4b88-9bca-2eba16b3bb5e 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:59:37 devstack sudo[95762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-e65b158e-64ec-4b88-9bca-2eba16b3bb5e 1073741824 Aug 10 15:59:37 devstack sudo[95762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:59:37 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-6c2d01a4-99e3-4ebd-b44d-e32c7bd9ea15 tempest-VolumesDeleteCascade-1918754692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (644f5379-3f33-4749-8d09-28309f7d3f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fd632d1-c10a-4ca0-bf77-18aaee01547e', 'volume_size': 1, 'snapshot_id': 'ac7f0b1a-222d-4d73-bd0a-e63fa6319f2e'}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:59:37 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-6c2d01a4-99e3-4ebd-b44d-e32c7bd9ea15 tempest-VolumesDeleteCascade-1918754692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5fd5cec-fa74-4567-92f9-c99503c31660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:59:37 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-6c2d01a4-99e3-4ebd-b44d-e32c7bd9ea15 tempest-VolumesDeleteCascade-1918754692 None] Volume volume-0fd632d1-c10a-4ca0-bf77-18aaee01547e (0fd632d1-c10a-4ca0-bf77-18aaee01547e): created successfully Aug 10 15:59:37 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-6c2d01a4-99e3-4ebd-b44d-e32c7bd9ea15 tempest-VolumesDeleteCascade-1918754692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5fd5cec-fa74-4567-92f9-c99503c31660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:59:37 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-6c2d01a4-99e3-4ebd-b44d-e32c7bd9ea15 tempest-VolumesDeleteCascade-1918754692 None] Flow 'volume_create_manager' (a09e94f2-2582-45aa-bd1e-8956414e259b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 15:59:37 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-6c2d01a4-99e3-4ebd-b44d-e32c7bd9ea15 tempest-VolumesDeleteCascade-1918754692 None] Created volume successfully. Aug 10 15:59:38 devstack sudo[95762]: pam_unix(sudo:session): session closed for user root Aug 10 15:59:38 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d45d25ac-cdc0-4976-880c-5de32110e2f0 tempest-AttachVolumeNegativeTest-115562770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-e65b158e-64ec-4b88-9bca-2eba16b3bb5e 1073741824" returned: 0 in 0.863s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:59:38 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d45d25ac-cdc0-4976-880c-5de32110e2f0 tempest-AttachVolumeNegativeTest-115562770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-e65b158e-64ec-4b88-9bca-2eba16b3bb5e {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:59:38 devstack sudo[95804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-e65b158e-64ec-4b88-9bca-2eba16b3bb5e Aug 10 15:59:38 devstack sudo[95804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:59:39 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-0bef7176-abcc-4a83-80cf-1b3147717b34 tempest-VolumesDeleteCascade-1918754692 None] Acquiring lock "cinder-21bca8a7-c625-47b9-9cd7-60f9436b5b86-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 15:59:39 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-0bef7176-abcc-4a83-80cf-1b3147717b34 tempest-VolumesDeleteCascade-1918754692 None] Lock "cinder-21bca8a7-c625-47b9-9cd7-60f9436b5b86-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 15:59:39 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-0bef7176-abcc-4a83-80cf-1b3147717b34 tempest-VolumesDeleteCascade-1918754692 None] Performing cascade delete. {{(pid=88641) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Aug 10 15:59:39 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-0bef7176-abcc-4a83-80cf-1b3147717b34 tempest-VolumesDeleteCascade-1918754692 None] Acquiring lock "cinder-ac7f0b1a-222d-4d73-bd0a-e63fa6319f2e-delete_snapshot" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 15:59:39 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-0bef7176-abcc-4a83-80cf-1b3147717b34 tempest-VolumesDeleteCascade-1918754692 None] Lock "cinder-ac7f0b1a-222d-4d73-bd0a-e63fa6319f2e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 15:59:39 devstack sudo[95804]: pam_unix(sudo:session): session closed for user root Aug 10 15:59:39 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d45d25ac-cdc0-4976-880c-5de32110e2f0 tempest-AttachVolumeNegativeTest-115562770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-e65b158e-64ec-4b88-9bca-2eba16b3bb5e" returned: 0 in 0.515s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:59:39 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-d45d25ac-cdc0-4976-880c-5de32110e2f0 tempest-AttachVolumeNegativeTest-115562770 None] <== create_volume: return (1463ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 15:59:39 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-d45d25ac-cdc0-4976-880c-5de32110e2f0 tempest-AttachVolumeNegativeTest-115562770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.469s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:59:39 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d45d25ac-cdc0-4976-880c-5de32110e2f0 tempest-AttachVolumeNegativeTest-115562770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4b92d92-9f18-4471-a5f6-cc9fb35bfad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e65b158e-64ec-4b88-9bca-2eba16b3bb5e', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:59:39 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d45d25ac-cdc0-4976-880c-5de32110e2f0 tempest-AttachVolumeNegativeTest-115562770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4699b9d-3d4e-4d1b-a686-d4b4c656e524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:59:39 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-0bef7176-abcc-4a83-80cf-1b3147717b34 tempest-VolumesDeleteCascade-1918754692 None] Acquiring lock "cinder-quobyte-21bca8a7-c625-47b9-9cd7-60f9436b5b86" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 15:59:39 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-d45d25ac-cdc0-4976-880c-5de32110e2f0 tempest-AttachVolumeNegativeTest-115562770 None] Volume volume-e65b158e-64ec-4b88-9bca-2eba16b3bb5e (e65b158e-64ec-4b88-9bca-2eba16b3bb5e): created successfully Aug 10 15:59:39 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d45d25ac-cdc0-4976-880c-5de32110e2f0 tempest-AttachVolumeNegativeTest-115562770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4699b9d-3d4e-4d1b-a686-d4b4c656e524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:59:39 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d45d25ac-cdc0-4976-880c-5de32110e2f0 tempest-AttachVolumeNegativeTest-115562770 None] Flow 'volume_create_manager' (89d8aa03-87a1-4af5-9c1e-4862e883df3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 15:59:39 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-0bef7176-abcc-4a83-80cf-1b3147717b34 tempest-VolumesDeleteCascade-1918754692 None] Lock "cinder-quobyte-21bca8a7-c625-47b9-9cd7-60f9436b5b86" acquired by "delete_snapshot" :: waited 0.041s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 15:59:39 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-0bef7176-abcc-4a83-80cf-1b3147717b34 tempest-VolumesDeleteCascade-1918754692 None] Acquiring lock "cinder-quobyte-ac7f0b1a-222d-4d73-bd0a-e63fa6319f2e" by "_delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 15:59:39 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-d45d25ac-cdc0-4976-880c-5de32110e2f0 tempest-AttachVolumeNegativeTest-115562770 None] Created volume successfully. Aug 10 15:59:39 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-0bef7176-abcc-4a83-80cf-1b3147717b34 tempest-VolumesDeleteCascade-1918754692 None] Lock "cinder-quobyte-ac7f0b1a-222d-4d73-bd0a-e63fa6319f2e" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 15:59:39 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-0bef7176-abcc-4a83-80cf-1b3147717b34 tempest-VolumesDeleteCascade-1918754692 None] Deleting offline snapshot ac7f0b1a-222d-4d73-bd0a-e63fa6319f2e of volume 21bca8a7-c625-47b9-9cd7-60f9436b5b86 {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 15:59:39 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-0bef7176-abcc-4a83-80cf-1b3147717b34 tempest-VolumesDeleteCascade-1918754692 None] snapshot_file for this snap is: volume-21bca8a7-c625-47b9-9cd7-60f9436b5b86.ac7f0b1a-222d-4d73-bd0a-e63fa6319f2e {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 15:59:39 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d2c9bca-579a-46e6-a3d2-f9dc167b4f70]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 15:59:39 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0bef7176-abcc-4a83-80cf-1b3147717b34 tempest-VolumesDeleteCascade-1918754692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-21bca8a7-c625-47b9-9cd7-60f9436b5b86.ac7f0b1a-222d-4d73-bd0a-e63fa6319f2e {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:59:39 devstack sudo[95836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-21bca8a7-c625-47b9-9cd7-60f9436b5b86.ac7f0b1a-222d-4d73-bd0a-e63fa6319f2e Aug 10 15:59:39 devstack sudo[95836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:59:40 devstack sudo[95836]: pam_unix(sudo:session): session closed for user root Aug 10 15:59:40 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0bef7176-abcc-4a83-80cf-1b3147717b34 tempest-VolumesDeleteCascade-1918754692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-21bca8a7-c625-47b9-9cd7-60f9436b5b86.ac7f0b1a-222d-4d73-bd0a-e63fa6319f2e" returned: 0 in 0.581s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:59:40 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-0bef7176-abcc-4a83-80cf-1b3147717b34 tempest-VolumesDeleteCascade-1918754692 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21bca8a7-c625-47b9-9cd7-60f9436b5b86(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 15:59:40 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[febd2891-ab79-4e15-bc7c-f0c743c0172d]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 15:59:40 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0bef7176-abcc-4a83-80cf-1b3147717b34 tempest-VolumesDeleteCascade-1918754692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-21bca8a7-c625-47b9-9cd7-60f9436b5b86 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:59:40 devstack sudo[95864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-21bca8a7-c625-47b9-9cd7-60f9436b5b86 Aug 10 15:59:40 devstack sudo[95864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:59:40 devstack sudo[95864]: pam_unix(sudo:session): session closed for user root Aug 10 15:59:40 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0bef7176-abcc-4a83-80cf-1b3147717b34 tempest-VolumesDeleteCascade-1918754692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-21bca8a7-c625-47b9-9cd7-60f9436b5b86" returned: 0 in 0.640s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:59:40 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0bef7176-abcc-4a83-80cf-1b3147717b34 tempest-VolumesDeleteCascade-1918754692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-21bca8a7-c625-47b9-9cd7-60f9436b5b86.ac7f0b1a-222d-4d73-bd0a-e63fa6319f2e {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:59:40 devstack sudo[95888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-21bca8a7-c625-47b9-9cd7-60f9436b5b86.ac7f0b1a-222d-4d73-bd0a-e63fa6319f2e Aug 10 15:59:40 devstack sudo[95888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:59:40 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-4afaf6ab-6439-4e47-bb01-fa01575d4413 req-be1ded08-5d55-4c03-9032-a504a2da9e50 tempest-AttachVolumeNegativeTest-115562770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:59:40 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-4afaf6ab-6439-4e47-bb01-fa01575d4413 req-be1ded08-5d55-4c03-9032-a504a2da9e50 tempest-AttachVolumeNegativeTest-115562770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:59:40 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-4afaf6ab-6439-4e47-bb01-fa01575d4413 req-be1ded08-5d55-4c03-9032-a504a2da9e50 tempest-AttachVolumeNegativeTest-115562770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:59:41 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [req-4afaf6ab-6439-4e47-bb01-fa01575d4413 req-be1ded08-5d55-4c03-9032-a504a2da9e50 tempest-AttachVolumeNegativeTest-115562770 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc', 'name': 'volume-e65b158e-64ec-4b88-9bca-2eba16b3bb5e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '69f8a782-5c6f-43a7-b644-589c0ab11bb0', 'enforce_multipath': True} {{(pid=88641) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 10 15:59:41 devstack cinder-volume[88641]: INFO cinder.volume.manager [req-4afaf6ab-6439-4e47-bb01-fa01575d4413 req-be1ded08-5d55-4c03-9032-a504a2da9e50 tempest-AttachVolumeNegativeTest-115562770 None] attachment_update completed successfully. Aug 10 15:59:41 devstack sudo[95888]: pam_unix(sudo:session): session closed for user root Aug 10 15:59:41 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0bef7176-abcc-4a83-80cf-1b3147717b34 tempest-VolumesDeleteCascade-1918754692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-21bca8a7-c625-47b9-9cd7-60f9436b5b86.ac7f0b1a-222d-4d73-bd0a-e63fa6319f2e" returned: 0 in 0.435s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:59:41 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0bef7176-abcc-4a83-80cf-1b3147717b34 tempest-VolumesDeleteCascade-1918754692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-21bca8a7-c625-47b9-9cd7-60f9436b5b86.ac7f0b1a-222d-4d73-bd0a-e63fa6319f2e {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:59:41 devstack sudo[95901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-21bca8a7-c625-47b9-9cd7-60f9436b5b86.ac7f0b1a-222d-4d73-bd0a-e63fa6319f2e Aug 10 15:59:41 devstack sudo[95901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:59:41 devstack sudo[95901]: pam_unix(sudo:session): session closed for user root Aug 10 15:59:41 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0bef7176-abcc-4a83-80cf-1b3147717b34 tempest-VolumesDeleteCascade-1918754692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-21bca8a7-c625-47b9-9cd7-60f9436b5b86.ac7f0b1a-222d-4d73-bd0a-e63fa6319f2e" returned: 0 in 0.306s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:59:41 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-0bef7176-abcc-4a83-80cf-1b3147717b34 tempest-VolumesDeleteCascade-1918754692 None] Lock "cinder-quobyte-ac7f0b1a-222d-4d73-bd0a-e63fa6319f2e" released by "_delete_snapshot" :: held 2.133s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 15:59:41 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-0bef7176-abcc-4a83-80cf-1b3147717b34 tempest-VolumesDeleteCascade-1918754692 None] Lock "cinder-quobyte-21bca8a7-c625-47b9-9cd7-60f9436b5b86" released by "delete_snapshot" :: held 2.189s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 15:59:41 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-0bef7176-abcc-4a83-80cf-1b3147717b34 tempest-VolumesDeleteCascade-1918754692 None] Created reservations ['39a4b019-ab9b-4ec3-8e63-992e72198ecc', '1efcd44d-e397-4760-85ba-9d13526ad5ac', '09bd920a-322d-4a34-ace5-9b3c2a7022fc', 'abaa2953-b2c2-4850-984b-48c4aef92a77'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 15:59:41 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-0bef7176-abcc-4a83-80cf-1b3147717b34 tempest-VolumesDeleteCascade-1918754692 None] Delete snapshot completed successfully. Aug 10 15:59:41 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-0bef7176-abcc-4a83-80cf-1b3147717b34 tempest-VolumesDeleteCascade-1918754692 None] Lock "cinder-ac7f0b1a-222d-4d73-bd0a-e63fa6319f2e-delete_snapshot" released by "delete_snapshot" :: held 2.521s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 15:59:41 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-0bef7176-abcc-4a83-80cf-1b3147717b34 tempest-VolumesDeleteCascade-1918754692 None] Snapshots deleted, issuing volume delete {{(pid=88641) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Aug 10 15:59:41 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-0bef7176-abcc-4a83-80cf-1b3147717b34 tempest-VolumesDeleteCascade-1918754692 None] Acquiring lock "cinder-quobyte-21bca8a7-c625-47b9-9cd7-60f9436b5b86" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 15:59:41 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-0bef7176-abcc-4a83-80cf-1b3147717b34 tempest-VolumesDeleteCascade-1918754692 None] Lock "cinder-quobyte-21bca8a7-c625-47b9-9cd7-60f9436b5b86" acquired by "delete_volume" :: waited 0.048s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 15:59:41 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[1576751a-894e-4bc0-beb3-1a0a1d99e380]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 15:59:41 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0bef7176-abcc-4a83-80cf-1b3147717b34 tempest-VolumesDeleteCascade-1918754692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-21bca8a7-c625-47b9-9cd7-60f9436b5b86 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:59:42 devstack sudo[95936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-21bca8a7-c625-47b9-9cd7-60f9436b5b86 Aug 10 15:59:42 devstack sudo[95936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:59:42 devstack sudo[95936]: pam_unix(sudo:session): session closed for user root Aug 10 15:59:42 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0bef7176-abcc-4a83-80cf-1b3147717b34 tempest-VolumesDeleteCascade-1918754692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-21bca8a7-c625-47b9-9cd7-60f9436b5b86" returned: 0 in 0.456s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:59:42 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0bef7176-abcc-4a83-80cf-1b3147717b34 tempest-VolumesDeleteCascade-1918754692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-21bca8a7-c625-47b9-9cd7-60f9436b5b86 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:59:42 devstack sudo[95942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-21bca8a7-c625-47b9-9cd7-60f9436b5b86 Aug 10 15:59:42 devstack sudo[95942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:59:42 devstack sudo[95942]: pam_unix(sudo:session): session closed for user root Aug 10 15:59:42 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0bef7176-abcc-4a83-80cf-1b3147717b34 tempest-VolumesDeleteCascade-1918754692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-21bca8a7-c625-47b9-9cd7-60f9436b5b86" returned: 0 in 0.309s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:59:42 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-0bef7176-abcc-4a83-80cf-1b3147717b34 tempest-VolumesDeleteCascade-1918754692 None] Lock "cinder-quobyte-21bca8a7-c625-47b9-9cd7-60f9436b5b86" released by "delete_volume" :: held 0.896s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 15:59:42 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-0bef7176-abcc-4a83-80cf-1b3147717b34 tempest-VolumesDeleteCascade-1918754692 None] Created reservations ['6e1ea072-9143-4892-98af-3f67d93cec47', '68cd57b0-001e-427f-97da-024968e5a30f', '0f6239d7-9c11-4f5a-870b-e2f4abdad0f5', '82c0d810-540f-47c5-a3ac-657166fe8e59'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 15:59:42 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-0bef7176-abcc-4a83-80cf-1b3147717b34 tempest-VolumesDeleteCascade-1918754692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:59:42 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-0bef7176-abcc-4a83-80cf-1b3147717b34 tempest-VolumesDeleteCascade-1918754692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:59:42 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-0bef7176-abcc-4a83-80cf-1b3147717b34 tempest-VolumesDeleteCascade-1918754692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 15:59:42 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-0bef7176-abcc-4a83-80cf-1b3147717b34 tempest-VolumesDeleteCascade-1918754692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 15:59:42 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-0bef7176-abcc-4a83-80cf-1b3147717b34 tempest-VolumesDeleteCascade-1918754692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:59:42 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0bef7176-abcc-4a83-80cf-1b3147717b34 tempest-VolumesDeleteCascade-1918754692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:59:42 devstack sudo[95945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 15:59:42 devstack sudo[95945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:59:43 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d49d853-368e-40d8-ba7f-537033c3eeb3 tempest-VolumesActionsTest-1607702842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 15:59:43 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-4d49d853-368e-40d8-ba7f-537033c3eeb3 tempest-VolumesActionsTest-1607702842 None] Flow 'volume_create_manager' (94f000f1-d520-43ff-bcb3-7f70acd86af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 15:59:43 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-4d49d853-368e-40d8-ba7f-537033c3eeb3 tempest-VolumesActionsTest-1607702842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc949d33-bd48-4b95-8b4d-c4709ad54617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:59:43 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-4d49d853-368e-40d8-ba7f-537033c3eeb3 tempest-VolumesActionsTest-1607702842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc949d33-bd48-4b95-8b4d-c4709ad54617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T13:59:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-643627177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=457346de-8ca1-4969-97a8-dfb4b4a89a93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9b0f3e24b1745dfa296d6952a3510ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T13:59:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T13:59:43Z,use_quota=True,user_id='b1ab3f855d0845f2bf2219223053d679',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:59:43 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-4d49d853-368e-40d8-ba7f-537033c3eeb3 tempest-VolumesActionsTest-1607702842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21622815-fb17-4cf7-b011-59d63daa04f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:59:43 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-4d49d853-368e-40d8-ba7f-537033c3eeb3 tempest-VolumesActionsTest-1607702842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21622815-fb17-4cf7-b011-59d63daa04f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:59:43 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-4d49d853-368e-40d8-ba7f-537033c3eeb3 tempest-VolumesActionsTest-1607702842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eed644ad-13f8-4516-8976-ec019de81c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:59:43 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-4d49d853-368e-40d8-ba7f-537033c3eeb3 tempest-VolumesActionsTest-1607702842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eed644ad-13f8-4516-8976-ec019de81c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '457346de-8ca1-4969-97a8-dfb4b4a89a93', 'volume_name': 'volume-457346de-8ca1-4969-97a8-dfb4b4a89a93', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:59:43 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-4d49d853-368e-40d8-ba7f-537033c3eeb3 tempest-VolumesActionsTest-1607702842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cae85d4e-390f-4858-9e81-30b5b32cdc38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:59:43 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-4d49d853-368e-40d8-ba7f-537033c3eeb3 tempest-VolumesActionsTest-1607702842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cae85d4e-390f-4858-9e81-30b5b32cdc38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:59:43 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-4d49d853-368e-40d8-ba7f-537033c3eeb3 tempest-VolumesActionsTest-1607702842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fba54f0f-34a5-4ee8-848a-311079e5c8e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:59:43 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-4d49d853-368e-40d8-ba7f-537033c3eeb3 tempest-VolumesActionsTest-1607702842 None] Volume 457346de-8ca1-4969-97a8-dfb4b4a89a93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-457346de-8ca1-4969-97a8-dfb4b4a89a93', 'volume_size': 1} Aug 10 15:59:43 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-4d49d853-368e-40d8-ba7f-537033c3eeb3 tempest-VolumesActionsTest-1607702842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:59:43 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-4d49d853-368e-40d8-ba7f-537033c3eeb3 tempest-VolumesActionsTest-1607702842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:59:43 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-4d49d853-368e-40d8-ba7f-537033c3eeb3 tempest-VolumesActionsTest-1607702842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T13:59:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-643627177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=457346de-8ca1-4969-97a8-dfb4b4a89a93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9b0f3e24b1745dfa296d6952a3510ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T13:59:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T13:59:43Z,use_quota=True,user_id='b1ab3f855d0845f2bf2219223053d679',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 15:59:43 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-4d49d853-368e-40d8-ba7f-537033c3eeb3 tempest-VolumesActionsTest-1607702842 None] Creating volume 457346de-8ca1-4969-97a8-dfb4b4a89a93 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 15:59:43 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-4d49d853-368e-40d8-ba7f-537033c3eeb3 tempest-VolumesActionsTest-1607702842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:59:43 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-4d49d853-368e-40d8-ba7f-537033c3eeb3 tempest-VolumesActionsTest-1607702842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:59:43 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-4d49d853-368e-40d8-ba7f-537033c3eeb3 tempest-VolumesActionsTest-1607702842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 15:59:43 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-4d49d853-368e-40d8-ba7f-537033c3eeb3 tempest-VolumesActionsTest-1607702842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 15:59:43 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-4d49d853-368e-40d8-ba7f-537033c3eeb3 tempest-VolumesActionsTest-1607702842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:59:43 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-4d49d853-368e-40d8-ba7f-537033c3eeb3 tempest-VolumesActionsTest-1607702842 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 15:59:43 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-4d49d853-368e-40d8-ba7f-537033c3eeb3 tempest-VolumesActionsTest-1607702842 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 15:59:43 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4d49d853-368e-40d8-ba7f-537033c3eeb3 tempest-VolumesActionsTest-1607702842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-457346de-8ca1-4969-97a8-dfb4b4a89a93 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:59:43 devstack sudo[95948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-457346de-8ca1-4969-97a8-dfb4b4a89a93 1073741824 Aug 10 15:59:43 devstack sudo[95948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:59:43 devstack sudo[95945]: pam_unix(sudo:session): session closed for user root Aug 10 15:59:43 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0bef7176-abcc-4a83-80cf-1b3147717b34 tempest-VolumesDeleteCascade-1918754692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.414s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:59:43 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-0bef7176-abcc-4a83-80cf-1b3147717b34 tempest-VolumesDeleteCascade-1918754692 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 15:59:43 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-0bef7176-abcc-4a83-80cf-1b3147717b34 tempest-VolumesDeleteCascade-1918754692 None] Deleted volume successfully. Aug 10 15:59:43 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-0bef7176-abcc-4a83-80cf-1b3147717b34 tempest-VolumesDeleteCascade-1918754692 None] Lock "cinder-21bca8a7-c625-47b9-9cd7-60f9436b5b86-delete_volume" released by "delete_volume" :: held 4.277s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 15:59:43 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-60433e89-336e-421b-bac2-69ef1e5e1933 tempest-VolumesDeleteCascade-1918754692 None] Acquiring lock "cinder-0fd632d1-c10a-4ca0-bf77-18aaee01547e-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 15:59:43 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-60433e89-336e-421b-bac2-69ef1e5e1933 tempest-VolumesDeleteCascade-1918754692 None] Lock "cinder-0fd632d1-c10a-4ca0-bf77-18aaee01547e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 15:59:43 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-60433e89-336e-421b-bac2-69ef1e5e1933 tempest-VolumesDeleteCascade-1918754692 None] Acquiring lock "cinder-quobyte-0fd632d1-c10a-4ca0-bf77-18aaee01547e" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 15:59:43 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-60433e89-336e-421b-bac2-69ef1e5e1933 tempest-VolumesDeleteCascade-1918754692 None] Lock "cinder-quobyte-0fd632d1-c10a-4ca0-bf77-18aaee01547e" acquired by "delete_volume" :: waited 0.034s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 15:59:43 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[335bd882-b204-428b-90ac-a0b04f3dd299]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 15:59:43 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-60433e89-336e-421b-bac2-69ef1e5e1933 tempest-VolumesDeleteCascade-1918754692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-0fd632d1-c10a-4ca0-bf77-18aaee01547e {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:59:44 devstack sudo[95948]: pam_unix(sudo:session): session closed for user root Aug 10 15:59:44 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4d49d853-368e-40d8-ba7f-537033c3eeb3 tempest-VolumesActionsTest-1607702842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-457346de-8ca1-4969-97a8-dfb4b4a89a93 1073741824" returned: 0 in 0.775s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:59:44 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4d49d853-368e-40d8-ba7f-537033c3eeb3 tempest-VolumesActionsTest-1607702842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-457346de-8ca1-4969-97a8-dfb4b4a89a93 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:59:44 devstack sudo[95957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-457346de-8ca1-4969-97a8-dfb4b4a89a93 Aug 10 15:59:44 devstack sudo[95957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:59:44 devstack sudo[95955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-0fd632d1-c10a-4ca0-bf77-18aaee01547e Aug 10 15:59:44 devstack sudo[95955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:59:44 devstack sudo[95955]: pam_unix(sudo:session): session closed for user root Aug 10 15:59:44 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-60433e89-336e-421b-bac2-69ef1e5e1933 tempest-VolumesDeleteCascade-1918754692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-0fd632d1-c10a-4ca0-bf77-18aaee01547e" returned: 0 in 0.465s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:59:44 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-60433e89-336e-421b-bac2-69ef1e5e1933 tempest-VolumesDeleteCascade-1918754692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-0fd632d1-c10a-4ca0-bf77-18aaee01547e {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:59:44 devstack sudo[95969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-0fd632d1-c10a-4ca0-bf77-18aaee01547e Aug 10 15:59:44 devstack sudo[95969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:59:44 devstack sudo[95957]: pam_unix(sudo:session): session closed for user root Aug 10 15:59:44 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4d49d853-368e-40d8-ba7f-537033c3eeb3 tempest-VolumesActionsTest-1607702842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-457346de-8ca1-4969-97a8-dfb4b4a89a93" returned: 0 in 0.462s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:59:44 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-4d49d853-368e-40d8-ba7f-537033c3eeb3 tempest-VolumesActionsTest-1607702842 None] <== create_volume: return (1297ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 15:59:44 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-4d49d853-368e-40d8-ba7f-537033c3eeb3 tempest-VolumesActionsTest-1607702842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.300s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:59:44 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-4d49d853-368e-40d8-ba7f-537033c3eeb3 tempest-VolumesActionsTest-1607702842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fba54f0f-34a5-4ee8-848a-311079e5c8e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-457346de-8ca1-4969-97a8-dfb4b4a89a93', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:59:44 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-4d49d853-368e-40d8-ba7f-537033c3eeb3 tempest-VolumesActionsTest-1607702842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aecad8c0-aeab-4303-93d1-d17cc39f8b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:59:44 devstack cinder-volume[88641]: INFO cinder.volume.manager [req-b57559e8-3a11-4e4e-aa0b-013466672866 req-ff1cdc3e-c9f6-4548-bc9d-fee35bb32b43 tempest-AttachVolumeNegativeTest-115562770 None] Terminate volume connection completed successfully. Aug 10 15:59:44 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [req-b57559e8-3a11-4e4e-aa0b-013466672866 req-ff1cdc3e-c9f6-4548-bc9d-fee35bb32b43 tempest-AttachVolumeNegativeTest-115562770 None] Deleting attachment 69f8a782-5c6f-43a7-b644-589c0ab11bb0. {{(pid=88641) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 10 15:59:44 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-4d49d853-368e-40d8-ba7f-537033c3eeb3 tempest-VolumesActionsTest-1607702842 None] Volume volume-457346de-8ca1-4969-97a8-dfb4b4a89a93 (457346de-8ca1-4969-97a8-dfb4b4a89a93): created successfully Aug 10 15:59:44 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-4d49d853-368e-40d8-ba7f-537033c3eeb3 tempest-VolumesActionsTest-1607702842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aecad8c0-aeab-4303-93d1-d17cc39f8b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:59:44 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-4d49d853-368e-40d8-ba7f-537033c3eeb3 tempest-VolumesActionsTest-1607702842 None] Flow 'volume_create_manager' (94f000f1-d520-43ff-bcb3-7f70acd86af7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 15:59:44 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-4d49d853-368e-40d8-ba7f-537033c3eeb3 tempest-VolumesActionsTest-1607702842 None] Created volume successfully. Aug 10 15:59:44 devstack sudo[95969]: pam_unix(sudo:session): session closed for user root Aug 10 15:59:44 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-60433e89-336e-421b-bac2-69ef1e5e1933 tempest-VolumesDeleteCascade-1918754692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-0fd632d1-c10a-4ca0-bf77-18aaee01547e" returned: 0 in 0.408s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:59:44 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-60433e89-336e-421b-bac2-69ef1e5e1933 tempest-VolumesDeleteCascade-1918754692 None] Lock "cinder-quobyte-0fd632d1-c10a-4ca0-bf77-18aaee01547e" released by "delete_volume" :: held 0.942s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 15:59:44 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-60433e89-336e-421b-bac2-69ef1e5e1933 tempest-VolumesDeleteCascade-1918754692 None] Created reservations ['587973b1-51b4-43d6-95c5-e1465ddac586', '93b5ac5a-cc02-4757-967f-63e21f8157bb', 'eccdb87d-0d7e-4dd5-9203-7bf58f67ad86', '82d5aa4c-d611-467c-af15-554b68ddb1d5'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 15:59:45 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-60433e89-336e-421b-bac2-69ef1e5e1933 tempest-VolumesDeleteCascade-1918754692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:59:45 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-60433e89-336e-421b-bac2-69ef1e5e1933 tempest-VolumesDeleteCascade-1918754692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:59:45 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-60433e89-336e-421b-bac2-69ef1e5e1933 tempest-VolumesDeleteCascade-1918754692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 15:59:45 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-60433e89-336e-421b-bac2-69ef1e5e1933 tempest-VolumesDeleteCascade-1918754692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 15:59:45 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-60433e89-336e-421b-bac2-69ef1e5e1933 tempest-VolumesDeleteCascade-1918754692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:59:45 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-60433e89-336e-421b-bac2-69ef1e5e1933 tempest-VolumesDeleteCascade-1918754692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:59:45 devstack sudo[95972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 15:59:45 devstack sudo[95972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:59:45 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-c963ec5a-e5fe-4ccd-89df-af4363ab2206 tempest-VolumesActionsTest-1607702842 None] Acquiring lock "cinder-457346de-8ca1-4969-97a8-dfb4b4a89a93" by "attach_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 15:59:45 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-c963ec5a-e5fe-4ccd-89df-af4363ab2206 tempest-VolumesActionsTest-1607702842 None] Lock "cinder-457346de-8ca1-4969-97a8-dfb4b4a89a93" acquired by "attach_volume" :: waited 0.034s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 15:59:45 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-c963ec5a-e5fe-4ccd-89df-af4363ab2206 tempest-VolumesActionsTest-1607702842 None] Attaching volume 457346de-8ca1-4969-97a8-dfb4b4a89a93 to instance 17d71de6-143c-48de-9a00-25f044e1b744 at mountpoint /dev/vdb on host None. Aug 10 15:59:45 devstack cinder-volume[88641]: DEBUG dbcounter [-] [88641] Writing DB stats cinder:SELECT=78,cinder:UPDATE=64,cinder:DELETE=5,cinder:INSERT=16 {{(pid=88641) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 15:59:45 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-c963ec5a-e5fe-4ccd-89df-af4363ab2206 tempest-VolumesActionsTest-1607702842 None] Attach volume completed successfully. Aug 10 15:59:45 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-c963ec5a-e5fe-4ccd-89df-af4363ab2206 tempest-VolumesActionsTest-1607702842 None] Lock "cinder-457346de-8ca1-4969-97a8-dfb4b4a89a93" released by "attach_volume" :: held 0.161s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 15:59:45 devstack sudo[95972]: pam_unix(sudo:session): session closed for user root Aug 10 15:59:45 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-60433e89-336e-421b-bac2-69ef1e5e1933 tempest-VolumesDeleteCascade-1918754692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.345s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:59:45 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-60433e89-336e-421b-bac2-69ef1e5e1933 tempest-VolumesDeleteCascade-1918754692 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 15:59:45 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-60433e89-336e-421b-bac2-69ef1e5e1933 tempest-VolumesDeleteCascade-1918754692 None] Deleted volume successfully. Aug 10 15:59:45 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-60433e89-336e-421b-bac2-69ef1e5e1933 tempest-VolumesDeleteCascade-1918754692 None] Lock "cinder-0fd632d1-c10a-4ca0-bf77-18aaee01547e-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 15:59:45 devstack cinder-volume[88641]: DEBUG dbcounter [-] [88641] Writing DB stats cinder:SELECT=80,cinder:UPDATE=68,cinder:INSERT=17,cinder:DELETE=6 {{(pid=88641) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 15:59:45 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-ae9f5f9f-86af-47b1-b5b1-4c2cfe3e068c tempest-VolumesActionsTest-456021455 None] Terminate volume connection completed successfully. Aug 10 15:59:45 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-ae9f5f9f-86af-47b1-b5b1-4c2cfe3e068c tempest-VolumesActionsTest-456021455 None] Acquiring lock "cinder-457346de-8ca1-4969-97a8-dfb4b4a89a93-detach_volume" by "detach_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 15:59:45 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-ae9f5f9f-86af-47b1-b5b1-4c2cfe3e068c tempest-VolumesActionsTest-456021455 None] Lock "cinder-457346de-8ca1-4969-97a8-dfb4b4a89a93-detach_volume" acquired by "detach_volume" :: waited 0.020s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 15:59:45 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-ae9f5f9f-86af-47b1-b5b1-4c2cfe3e068c tempest-VolumesActionsTest-456021455 None] Detaching volume 457346de-8ca1-4969-97a8-dfb4b4a89a93 from instance 17d71de6-143c-48de-9a00-25f044e1b744. Aug 10 15:59:46 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-ae9f5f9f-86af-47b1-b5b1-4c2cfe3e068c tempest-VolumesActionsTest-456021455 None] Detach volume completed successfully. Aug 10 15:59:46 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-ae9f5f9f-86af-47b1-b5b1-4c2cfe3e068c tempest-VolumesActionsTest-456021455 None] Lock "cinder-457346de-8ca1-4969-97a8-dfb4b4a89a93-detach_volume" released by "detach_volume" :: held 0.072s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 15:59:46 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-cf0d4900-eaaa-44a2-afa5-09d6d9d412a3 tempest-VolumesActionsTest-1607702842 None] Acquiring lock "cinder-457346de-8ca1-4969-97a8-dfb4b4a89a93-detach_volume" by "detach_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 15:59:46 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-cf0d4900-eaaa-44a2-afa5-09d6d9d412a3 tempest-VolumesActionsTest-1607702842 None] Lock "cinder-457346de-8ca1-4969-97a8-dfb4b4a89a93-detach_volume" acquired by "detach_volume" :: waited 0.045s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 15:59:46 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-cf0d4900-eaaa-44a2-afa5-09d6d9d412a3 tempest-VolumesActionsTest-1607702842 None] Volume detach called, but volume not attached. Aug 10 15:59:46 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-cf0d4900-eaaa-44a2-afa5-09d6d9d412a3 tempest-VolumesActionsTest-1607702842 None] Lock "cinder-457346de-8ca1-4969-97a8-dfb4b4a89a93-detach_volume" released by "detach_volume" :: held 0.045s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 15:59:46 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-8c5a8984-27f4-4a95-af52-932bbacd2c4b tempest-VolumesActionsTest-1607702842 None] Acquiring lock "cinder-457346de-8ca1-4969-97a8-dfb4b4a89a93-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 15:59:46 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-8c5a8984-27f4-4a95-af52-932bbacd2c4b tempest-VolumesActionsTest-1607702842 None] Lock "cinder-457346de-8ca1-4969-97a8-dfb4b4a89a93-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 15:59:47 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-8c5a8984-27f4-4a95-af52-932bbacd2c4b tempest-VolumesActionsTest-1607702842 None] Acquiring lock "cinder-quobyte-457346de-8ca1-4969-97a8-dfb4b4a89a93" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 15:59:47 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-8c5a8984-27f4-4a95-af52-932bbacd2c4b tempest-VolumesActionsTest-1607702842 None] Lock "cinder-quobyte-457346de-8ca1-4969-97a8-dfb4b4a89a93" acquired by "delete_volume" :: waited 0.036s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 15:59:47 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab4e234c-94c3-468a-808f-5481e65f3d10]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 15:59:47 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-8c5a8984-27f4-4a95-af52-932bbacd2c4b tempest-VolumesActionsTest-1607702842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-457346de-8ca1-4969-97a8-dfb4b4a89a93 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:59:47 devstack sudo[96020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-457346de-8ca1-4969-97a8-dfb4b4a89a93 Aug 10 15:59:47 devstack sudo[96020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:59:47 devstack sudo[96020]: pam_unix(sudo:session): session closed for user root Aug 10 15:59:48 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-8c5a8984-27f4-4a95-af52-932bbacd2c4b tempest-VolumesActionsTest-1607702842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-457346de-8ca1-4969-97a8-dfb4b4a89a93" returned: 0 in 0.856s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:59:48 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-8c5a8984-27f4-4a95-af52-932bbacd2c4b tempest-VolumesActionsTest-1607702842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-457346de-8ca1-4969-97a8-dfb4b4a89a93 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:59:48 devstack sudo[96042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-457346de-8ca1-4969-97a8-dfb4b4a89a93 Aug 10 15:59:48 devstack sudo[96042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:59:48 devstack sudo[96042]: pam_unix(sudo:session): session closed for user root Aug 10 15:59:48 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-8c5a8984-27f4-4a95-af52-932bbacd2c4b tempest-VolumesActionsTest-1607702842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-457346de-8ca1-4969-97a8-dfb4b4a89a93" returned: 0 in 0.729s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:59:48 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-8c5a8984-27f4-4a95-af52-932bbacd2c4b tempest-VolumesActionsTest-1607702842 None] Lock "cinder-quobyte-457346de-8ca1-4969-97a8-dfb4b4a89a93" released by "delete_volume" :: held 1.701s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 15:59:48 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-8c5a8984-27f4-4a95-af52-932bbacd2c4b tempest-VolumesActionsTest-1607702842 None] Created reservations ['6043225b-9532-457b-9a45-7c25b175ae9d', '993a615b-02fa-43ee-b1a7-b363abdf05f0', '417fba52-3fed-4a74-97b2-bca5a767be0d', 'fc7767bb-5b0d-41eb-b01a-75ae00304f23'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 15:59:48 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-8c5a8984-27f4-4a95-af52-932bbacd2c4b tempest-VolumesActionsTest-1607702842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:59:48 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-8c5a8984-27f4-4a95-af52-932bbacd2c4b tempest-VolumesActionsTest-1607702842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:59:48 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-8c5a8984-27f4-4a95-af52-932bbacd2c4b tempest-VolumesActionsTest-1607702842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 15:59:48 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-8c5a8984-27f4-4a95-af52-932bbacd2c4b tempest-VolumesActionsTest-1607702842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 15:59:48 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-8c5a8984-27f4-4a95-af52-932bbacd2c4b tempest-VolumesActionsTest-1607702842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:59:48 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-8c5a8984-27f4-4a95-af52-932bbacd2c4b tempest-VolumesActionsTest-1607702842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:59:49 devstack sudo[96051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 15:59:49 devstack sudo[96051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:59:49 devstack cinder-volume[88641]: INFO cinder.volume.manager [req-1554dc0e-5dff-41c7-abfe-d88c954eb3a5 req-36557294-5d84-46fc-8215-3020a9426fac tempest-ServerActionsTestOtherA-603942358 None] Terminate volume connection completed successfully. Aug 10 15:59:49 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [req-1554dc0e-5dff-41c7-abfe-d88c954eb3a5 req-36557294-5d84-46fc-8215-3020a9426fac tempest-ServerActionsTestOtherA-603942358 None] Deleting attachment 335db6ef-2598-474a-8fd9-f4be69f49021. {{(pid=88641) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 10 15:59:49 devstack sudo[96051]: pam_unix(sudo:session): session closed for user root Aug 10 15:59:49 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-8c5a8984-27f4-4a95-af52-932bbacd2c4b tempest-VolumesActionsTest-1607702842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.754s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:59:49 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-8c5a8984-27f4-4a95-af52-932bbacd2c4b tempest-VolumesActionsTest-1607702842 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 15:59:49 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-8c5a8984-27f4-4a95-af52-932bbacd2c4b tempest-VolumesActionsTest-1607702842 None] Deleted volume successfully. Aug 10 15:59:49 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-8c5a8984-27f4-4a95-af52-932bbacd2c4b tempest-VolumesActionsTest-1607702842 None] Lock "cinder-457346de-8ca1-4969-97a8-dfb4b4a89a93-delete_volume" released by "delete_volume" :: held 2.818s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 15:59:53 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fdf92b1-7691-40dd-8bff-03ddcd158595 tempest-VolumesNegativeTest-2005735804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 15:59:53 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2fdf92b1-7691-40dd-8bff-03ddcd158595 tempest-VolumesNegativeTest-2005735804 None] Flow 'volume_create_manager' (c786bf84-60ca-49ca-8eb8-cffd64d65655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 15:59:53 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2fdf92b1-7691-40dd-8bff-03ddcd158595 tempest-VolumesNegativeTest-2005735804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3899bcb9-97a4-4e91-b901-9df7c7c3c48b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:59:53 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2fdf92b1-7691-40dd-8bff-03ddcd158595 tempest-VolumesNegativeTest-2005735804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3899bcb9-97a4-4e91-b901-9df7c7c3c48b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T13:59:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1291170098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4020d04f-ad08-4ad5-b5e0-5d36c47b64ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7a27d7ee7104b7e81016cda6846fda8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T13:59:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T13:59:53Z,use_quota=True,user_id='78fb4e80ca6a40919b7dcaf91ec5e29a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:59:53 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2fdf92b1-7691-40dd-8bff-03ddcd158595 tempest-VolumesNegativeTest-2005735804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67667c1b-69cf-4b71-80f9-328a9a22f1ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:59:53 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2fdf92b1-7691-40dd-8bff-03ddcd158595 tempest-VolumesNegativeTest-2005735804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67667c1b-69cf-4b71-80f9-328a9a22f1ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:59:53 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2fdf92b1-7691-40dd-8bff-03ddcd158595 tempest-VolumesNegativeTest-2005735804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (984e9151-66ce-4e04-9cdf-2094df367181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:59:53 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2fdf92b1-7691-40dd-8bff-03ddcd158595 tempest-VolumesNegativeTest-2005735804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (984e9151-66ce-4e04-9cdf-2094df367181) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4020d04f-ad08-4ad5-b5e0-5d36c47b64ba', 'volume_name': 'volume-4020d04f-ad08-4ad5-b5e0-5d36c47b64ba', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:59:53 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2fdf92b1-7691-40dd-8bff-03ddcd158595 tempest-VolumesNegativeTest-2005735804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (947b37b5-1505-4c6f-9894-3777fa5faa10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:59:53 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2fdf92b1-7691-40dd-8bff-03ddcd158595 tempest-VolumesNegativeTest-2005735804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (947b37b5-1505-4c6f-9894-3777fa5faa10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:59:53 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2fdf92b1-7691-40dd-8bff-03ddcd158595 tempest-VolumesNegativeTest-2005735804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81c488c3-86fd-48ba-ba1d-c00026008fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:59:53 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-2fdf92b1-7691-40dd-8bff-03ddcd158595 tempest-VolumesNegativeTest-2005735804 None] Volume 4020d04f-ad08-4ad5-b5e0-5d36c47b64ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4020d04f-ad08-4ad5-b5e0-5d36c47b64ba', 'volume_size': 1} Aug 10 15:59:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-2fdf92b1-7691-40dd-8bff-03ddcd158595 tempest-VolumesNegativeTest-2005735804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:59:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-2fdf92b1-7691-40dd-8bff-03ddcd158595 tempest-VolumesNegativeTest-2005735804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:59:53 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-2fdf92b1-7691-40dd-8bff-03ddcd158595 tempest-VolumesNegativeTest-2005735804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T13:59:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1291170098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4020d04f-ad08-4ad5-b5e0-5d36c47b64ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7a27d7ee7104b7e81016cda6846fda8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T13:59:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T13:59:53Z,use_quota=True,user_id='78fb4e80ca6a40919b7dcaf91ec5e29a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 15:59:53 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-2fdf92b1-7691-40dd-8bff-03ddcd158595 tempest-VolumesNegativeTest-2005735804 None] Creating volume 4020d04f-ad08-4ad5-b5e0-5d36c47b64ba {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 15:59:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-2fdf92b1-7691-40dd-8bff-03ddcd158595 tempest-VolumesNegativeTest-2005735804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:59:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-2fdf92b1-7691-40dd-8bff-03ddcd158595 tempest-VolumesNegativeTest-2005735804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:59:53 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-2fdf92b1-7691-40dd-8bff-03ddcd158595 tempest-VolumesNegativeTest-2005735804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 15:59:53 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-2fdf92b1-7691-40dd-8bff-03ddcd158595 tempest-VolumesNegativeTest-2005735804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 15:59:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-2fdf92b1-7691-40dd-8bff-03ddcd158595 tempest-VolumesNegativeTest-2005735804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:59:53 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-2fdf92b1-7691-40dd-8bff-03ddcd158595 tempest-VolumesNegativeTest-2005735804 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 15:59:53 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-2fdf92b1-7691-40dd-8bff-03ddcd158595 tempest-VolumesNegativeTest-2005735804 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 15:59:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-2fdf92b1-7691-40dd-8bff-03ddcd158595 tempest-VolumesNegativeTest-2005735804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4020d04f-ad08-4ad5-b5e0-5d36c47b64ba 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:59:53 devstack sudo[96113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4020d04f-ad08-4ad5-b5e0-5d36c47b64ba 1073741824 Aug 10 15:59:53 devstack sudo[96113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:59:54 devstack sudo[96113]: pam_unix(sudo:session): session closed for user root Aug 10 15:59:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-2fdf92b1-7691-40dd-8bff-03ddcd158595 tempest-VolumesNegativeTest-2005735804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4020d04f-ad08-4ad5-b5e0-5d36c47b64ba 1073741824" returned: 0 in 0.613s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:59:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-2fdf92b1-7691-40dd-8bff-03ddcd158595 tempest-VolumesNegativeTest-2005735804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4020d04f-ad08-4ad5-b5e0-5d36c47b64ba {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:59:54 devstack sudo[96120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4020d04f-ad08-4ad5-b5e0-5d36c47b64ba Aug 10 15:59:54 devstack sudo[96120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:59:54 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-bce9e874-73f8-4b03-bb82-657c9dcf6c8a tempest-VolumesActionsTest-1607702842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 15:59:54 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bce9e874-73f8-4b03-bb82-657c9dcf6c8a tempest-VolumesActionsTest-1607702842 None] Flow 'volume_create_manager' (f3cea45c-26da-4576-84a3-1db4b5f4e2bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 15:59:54 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bce9e874-73f8-4b03-bb82-657c9dcf6c8a tempest-VolumesActionsTest-1607702842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b6e984a-e1fc-40c1-a20d-f60f5d5b2cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:59:54 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bce9e874-73f8-4b03-bb82-657c9dcf6c8a tempest-VolumesActionsTest-1607702842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b6e984a-e1fc-40c1-a20d-f60f5d5b2cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T13:59:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1208696143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73b510b7-96d5-422d-b213-b80bb7a330b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9b0f3e24b1745dfa296d6952a3510ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T13:59:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T13:59:54Z,use_quota=True,user_id='b1ab3f855d0845f2bf2219223053d679',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:59:54 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bce9e874-73f8-4b03-bb82-657c9dcf6c8a tempest-VolumesActionsTest-1607702842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02992bdb-9ccb-47ac-9d34-cf235fa9dd61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:59:54 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bce9e874-73f8-4b03-bb82-657c9dcf6c8a tempest-VolumesActionsTest-1607702842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02992bdb-9ccb-47ac-9d34-cf235fa9dd61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:59:54 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bce9e874-73f8-4b03-bb82-657c9dcf6c8a tempest-VolumesActionsTest-1607702842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01e79d2f-3322-438c-8926-404def189440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:59:54 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bce9e874-73f8-4b03-bb82-657c9dcf6c8a tempest-VolumesActionsTest-1607702842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01e79d2f-3322-438c-8926-404def189440) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73b510b7-96d5-422d-b213-b80bb7a330b1', 'volume_name': 'volume-73b510b7-96d5-422d-b213-b80bb7a330b1', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:59:54 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bce9e874-73f8-4b03-bb82-657c9dcf6c8a tempest-VolumesActionsTest-1607702842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e87f5c9e-ddf1-47cb-9fc5-f5c3557a76af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:59:54 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bce9e874-73f8-4b03-bb82-657c9dcf6c8a tempest-VolumesActionsTest-1607702842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e87f5c9e-ddf1-47cb-9fc5-f5c3557a76af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:59:54 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bce9e874-73f8-4b03-bb82-657c9dcf6c8a tempest-VolumesActionsTest-1607702842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d493c0da-8942-4eb2-b7a7-68e1a2689fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:59:54 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-bce9e874-73f8-4b03-bb82-657c9dcf6c8a tempest-VolumesActionsTest-1607702842 None] Volume 73b510b7-96d5-422d-b213-b80bb7a330b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73b510b7-96d5-422d-b213-b80bb7a330b1', 'volume_size': 1} Aug 10 15:59:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bce9e874-73f8-4b03-bb82-657c9dcf6c8a tempest-VolumesActionsTest-1607702842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:59:54 devstack sudo[96120]: pam_unix(sudo:session): session closed for user root Aug 10 15:59:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-2fdf92b1-7691-40dd-8bff-03ddcd158595 tempest-VolumesNegativeTest-2005735804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4020d04f-ad08-4ad5-b5e0-5d36c47b64ba" returned: 0 in 0.371s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:59:54 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-2fdf92b1-7691-40dd-8bff-03ddcd158595 tempest-VolumesNegativeTest-2005735804 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 15:59:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-2fdf92b1-7691-40dd-8bff-03ddcd158595 tempest-VolumesNegativeTest-2005735804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:59:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bce9e874-73f8-4b03-bb82-657c9dcf6c8a tempest-VolumesActionsTest-1607702842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.120s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:59:54 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-bce9e874-73f8-4b03-bb82-657c9dcf6c8a tempest-VolumesActionsTest-1607702842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T13:59:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1208696143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73b510b7-96d5-422d-b213-b80bb7a330b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9b0f3e24b1745dfa296d6952a3510ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T13:59:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T13:59:54Z,use_quota=True,user_id='b1ab3f855d0845f2bf2219223053d679',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 15:59:54 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-bce9e874-73f8-4b03-bb82-657c9dcf6c8a tempest-VolumesActionsTest-1607702842 None] Creating volume 73b510b7-96d5-422d-b213-b80bb7a330b1 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 15:59:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bce9e874-73f8-4b03-bb82-657c9dcf6c8a tempest-VolumesActionsTest-1607702842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:59:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bce9e874-73f8-4b03-bb82-657c9dcf6c8a tempest-VolumesActionsTest-1607702842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:59:54 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-bce9e874-73f8-4b03-bb82-657c9dcf6c8a tempest-VolumesActionsTest-1607702842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 15:59:54 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-bce9e874-73f8-4b03-bb82-657c9dcf6c8a tempest-VolumesActionsTest-1607702842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 15:59:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bce9e874-73f8-4b03-bb82-657c9dcf6c8a tempest-VolumesActionsTest-1607702842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:59:54 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-bce9e874-73f8-4b03-bb82-657c9dcf6c8a tempest-VolumesActionsTest-1607702842 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 15:59:54 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-bce9e874-73f8-4b03-bb82-657c9dcf6c8a tempest-VolumesActionsTest-1607702842 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 15:59:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bce9e874-73f8-4b03-bb82-657c9dcf6c8a tempest-VolumesActionsTest-1607702842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-73b510b7-96d5-422d-b213-b80bb7a330b1 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:59:54 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2fdf92b1-7691-40dd-8bff-03ddcd158595 tempest-VolumesNegativeTest-2005735804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81c488c3-86fd-48ba-ba1d-c00026008fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4020d04f-ad08-4ad5-b5e0-5d36c47b64ba', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:59:54 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2fdf92b1-7691-40dd-8bff-03ddcd158595 tempest-VolumesNegativeTest-2005735804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a15c655-ae90-4140-ad17-04b03f4f5490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:59:54 devstack sudo[96123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-73b510b7-96d5-422d-b213-b80bb7a330b1 1073741824 Aug 10 15:59:54 devstack sudo[96123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:59:54 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-2fdf92b1-7691-40dd-8bff-03ddcd158595 tempest-VolumesNegativeTest-2005735804 None] Volume volume-4020d04f-ad08-4ad5-b5e0-5d36c47b64ba (4020d04f-ad08-4ad5-b5e0-5d36c47b64ba): created successfully Aug 10 15:59:54 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2fdf92b1-7691-40dd-8bff-03ddcd158595 tempest-VolumesNegativeTest-2005735804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a15c655-ae90-4140-ad17-04b03f4f5490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:59:54 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2fdf92b1-7691-40dd-8bff-03ddcd158595 tempest-VolumesNegativeTest-2005735804 None] Flow 'volume_create_manager' (c786bf84-60ca-49ca-8eb8-cffd64d65655) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 15:59:54 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-2fdf92b1-7691-40dd-8bff-03ddcd158595 tempest-VolumesNegativeTest-2005735804 None] Created volume successfully. Aug 10 15:59:54 devstack sudo[96123]: pam_unix(sudo:session): session closed for user root Aug 10 15:59:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bce9e874-73f8-4b03-bb82-657c9dcf6c8a tempest-VolumesActionsTest-1607702842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-73b510b7-96d5-422d-b213-b80bb7a330b1 1073741824" returned: 0 in 0.519s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:59:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bce9e874-73f8-4b03-bb82-657c9dcf6c8a tempest-VolumesActionsTest-1607702842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-73b510b7-96d5-422d-b213-b80bb7a330b1 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:59:55 devstack sudo[96129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-73b510b7-96d5-422d-b213-b80bb7a330b1 Aug 10 15:59:55 devstack sudo[96129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:59:55 devstack sudo[96129]: pam_unix(sudo:session): session closed for user root Aug 10 15:59:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bce9e874-73f8-4b03-bb82-657c9dcf6c8a tempest-VolumesActionsTest-1607702842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-73b510b7-96d5-422d-b213-b80bb7a330b1" returned: 0 in 0.311s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:59:55 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-bce9e874-73f8-4b03-bb82-657c9dcf6c8a tempest-VolumesActionsTest-1607702842 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 15:59:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bce9e874-73f8-4b03-bb82-657c9dcf6c8a tempest-VolumesActionsTest-1607702842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:59:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bce9e874-73f8-4b03-bb82-657c9dcf6c8a tempest-VolumesActionsTest-1607702842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d493c0da-8942-4eb2-b7a7-68e1a2689fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73b510b7-96d5-422d-b213-b80bb7a330b1', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:59:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bce9e874-73f8-4b03-bb82-657c9dcf6c8a tempest-VolumesActionsTest-1607702842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb46674e-c9c6-4b67-8fef-965f13109c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:59:55 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-bce9e874-73f8-4b03-bb82-657c9dcf6c8a tempest-VolumesActionsTest-1607702842 None] Volume volume-73b510b7-96d5-422d-b213-b80bb7a330b1 (73b510b7-96d5-422d-b213-b80bb7a330b1): created successfully Aug 10 15:59:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bce9e874-73f8-4b03-bb82-657c9dcf6c8a tempest-VolumesActionsTest-1607702842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb46674e-c9c6-4b67-8fef-965f13109c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:59:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bce9e874-73f8-4b03-bb82-657c9dcf6c8a tempest-VolumesActionsTest-1607702842 None] Flow 'volume_create_manager' (f3cea45c-26da-4576-84a3-1db4b5f4e2bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 15:59:55 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-bce9e874-73f8-4b03-bb82-657c9dcf6c8a tempest-VolumesActionsTest-1607702842 None] Created volume successfully. Aug 10 15:59:56 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-925c8aa1-8d84-412a-ac41-ec5b4afc2a3d tempest-VolumesActionsTest-456021455 None] Acquiring lock "cinder-73b510b7-96d5-422d-b213-b80bb7a330b1-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 15:59:56 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-925c8aa1-8d84-412a-ac41-ec5b4afc2a3d tempest-VolumesActionsTest-456021455 None] Lock "cinder-73b510b7-96d5-422d-b213-b80bb7a330b1-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 15:59:56 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-925c8aa1-8d84-412a-ac41-ec5b4afc2a3d tempest-VolumesActionsTest-456021455 None] Acquiring lock "cinder-quobyte-73b510b7-96d5-422d-b213-b80bb7a330b1" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 15:59:56 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-925c8aa1-8d84-412a-ac41-ec5b4afc2a3d tempest-VolumesActionsTest-456021455 None] Lock "cinder-quobyte-73b510b7-96d5-422d-b213-b80bb7a330b1" acquired by "delete_volume" :: waited 0.026s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 15:59:56 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2877081-509a-464f-b4cf-6516762d064e]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 15:59:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-925c8aa1-8d84-412a-ac41-ec5b4afc2a3d tempest-VolumesActionsTest-456021455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-73b510b7-96d5-422d-b213-b80bb7a330b1 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:59:56 devstack sudo[96135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-73b510b7-96d5-422d-b213-b80bb7a330b1 Aug 10 15:59:56 devstack sudo[96135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:59:57 devstack sudo[96135]: pam_unix(sudo:session): session closed for user root Aug 10 15:59:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-925c8aa1-8d84-412a-ac41-ec5b4afc2a3d tempest-VolumesActionsTest-456021455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-73b510b7-96d5-422d-b213-b80bb7a330b1" returned: 0 in 0.558s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:59:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-925c8aa1-8d84-412a-ac41-ec5b4afc2a3d tempest-VolumesActionsTest-456021455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-73b510b7-96d5-422d-b213-b80bb7a330b1 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:59:57 devstack sudo[96141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-73b510b7-96d5-422d-b213-b80bb7a330b1 Aug 10 15:59:57 devstack sudo[96141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:59:57 devstack sudo[96141]: pam_unix(sudo:session): session closed for user root Aug 10 15:59:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-925c8aa1-8d84-412a-ac41-ec5b4afc2a3d tempest-VolumesActionsTest-456021455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-73b510b7-96d5-422d-b213-b80bb7a330b1" returned: 0 in 0.315s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:59:57 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-925c8aa1-8d84-412a-ac41-ec5b4afc2a3d tempest-VolumesActionsTest-456021455 None] Lock "cinder-quobyte-73b510b7-96d5-422d-b213-b80bb7a330b1" released by "delete_volume" :: held 0.959s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 15:59:57 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-925c8aa1-8d84-412a-ac41-ec5b4afc2a3d tempest-VolumesActionsTest-456021455 None] Created reservations ['b56876fd-e70e-4889-b226-218173c33225', 'bdc2771f-8ae4-49d0-8868-722d5d02f0a1', 'd9eef756-c04a-45a2-8664-e37190c9be89', 'ddd06ecb-bd92-44cd-a3a6-340e54014de8'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 15:59:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-925c8aa1-8d84-412a-ac41-ec5b4afc2a3d tempest-VolumesActionsTest-456021455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:59:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-925c8aa1-8d84-412a-ac41-ec5b4afc2a3d tempest-VolumesActionsTest-456021455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:59:57 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-925c8aa1-8d84-412a-ac41-ec5b4afc2a3d tempest-VolumesActionsTest-456021455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 15:59:57 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-925c8aa1-8d84-412a-ac41-ec5b4afc2a3d tempest-VolumesActionsTest-456021455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 15:59:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-925c8aa1-8d84-412a-ac41-ec5b4afc2a3d tempest-VolumesActionsTest-456021455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:59:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-925c8aa1-8d84-412a-ac41-ec5b4afc2a3d tempest-VolumesActionsTest-456021455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:59:57 devstack sudo[96144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 15:59:57 devstack sudo[96144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 15:59:58 devstack sudo[96144]: pam_unix(sudo:session): session closed for user root Aug 10 15:59:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-925c8aa1-8d84-412a-ac41-ec5b4afc2a3d tempest-VolumesActionsTest-456021455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.315s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 15:59:58 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-925c8aa1-8d84-412a-ac41-ec5b4afc2a3d tempest-VolumesActionsTest-456021455 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 15:59:58 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-925c8aa1-8d84-412a-ac41-ec5b4afc2a3d tempest-VolumesActionsTest-456021455 None] Deleted volume successfully. Aug 10 15:59:58 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-925c8aa1-8d84-412a-ac41-ec5b4afc2a3d tempest-VolumesActionsTest-456021455 None] Lock "cinder-73b510b7-96d5-422d-b213-b80bb7a330b1-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 15:59:58 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7d9fd38-2953-4ddf-989b-1f088619dd00 tempest-ServerActionsTestOtherA-603942358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 15:59:58 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d7d9fd38-2953-4ddf-989b-1f088619dd00 tempest-ServerActionsTestOtherA-603942358 None] Flow 'volume_create_manager' (8c1d87cc-c1da-4876-ae4b-52d8e96f0ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 15:59:58 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d7d9fd38-2953-4ddf-989b-1f088619dd00 tempest-ServerActionsTestOtherA-603942358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f04fa02a-bf30-465a-a29d-c312c1c124ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:59:58 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d7d9fd38-2953-4ddf-989b-1f088619dd00 tempest-ServerActionsTestOtherA-603942358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f04fa02a-bf30-465a-a29d-c312c1c124ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T13:59:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-99997593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50d4e265-39fd-46c6-9b38-06971e2c547f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03078de0c6d743b39bc32b527af6f07c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T13:59:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T13:59:58Z,use_quota=True,user_id='f91a8a33d77e4544805d3c8ea355f55a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:59:58 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d7d9fd38-2953-4ddf-989b-1f088619dd00 tempest-ServerActionsTestOtherA-603942358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08111966-6b11-4594-afc6-491b8c158e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:59:58 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d7d9fd38-2953-4ddf-989b-1f088619dd00 tempest-ServerActionsTestOtherA-603942358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08111966-6b11-4594-afc6-491b8c158e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:59:58 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d7d9fd38-2953-4ddf-989b-1f088619dd00 tempest-ServerActionsTestOtherA-603942358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5c21787-3ed2-4a8a-8e78-2106de7e8746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:59:58 devstack cinder-volume[88641]: DEBUG cinder.image.glance [None req-d7d9fd38-2953-4ddf-989b-1f088619dd00 tempest-ServerActionsTestOtherA-603942358 None] Creating Keystone auth plugin from conf {{(pid=88641) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 10 15:59:59 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d7d9fd38-2953-4ddf-989b-1f088619dd00 tempest-ServerActionsTestOtherA-603942358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5c21787-3ed2-4a8a-8e78-2106de7e8746) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '50d4e265-39fd-46c6-9b38-06971e2c547f', 'volume_name': 'volume-50d4e265-39fd-46c6-9b38-06971e2c547f', 'volume_size': 1, 'image_id': '94d8702e-9652-4319-94ff-fc0294ea1b4b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/94d8702e-9652-4319-94ff-fc0294ea1b4b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9e18d747214f4822be3dc7f3bd0a3775', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '94d8702e-9652-4319-94ff-fc0294ea1b4b', 'created_at': datetime.datetime(2026, 8, 10, 13, 48, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 10, 13, 48, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/94d8702e-9652-4319-94ff-fc0294ea1b4b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:59:59 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d7d9fd38-2953-4ddf-989b-1f088619dd00 tempest-ServerActionsTestOtherA-603942358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e87185b9-3236-409a-8076-fa81851a0020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:59:59 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d7d9fd38-2953-4ddf-989b-1f088619dd00 tempest-ServerActionsTestOtherA-603942358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e87185b9-3236-409a-8076-fa81851a0020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:59:59 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d7d9fd38-2953-4ddf-989b-1f088619dd00 tempest-ServerActionsTestOtherA-603942358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bb56d2e-952e-45aa-a05d-380762a50500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:59:59 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-d7d9fd38-2953-4ddf-989b-1f088619dd00 tempest-ServerActionsTestOtherA-603942358 None] Volume 50d4e265-39fd-46c6-9b38-06971e2c547f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-50d4e265-39fd-46c6-9b38-06971e2c547f', 'volume_size': 1, 'image_id': '94d8702e-9652-4319-94ff-fc0294ea1b4b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/94d8702e-9652-4319-94ff-fc0294ea1b4b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9e18d747214f4822be3dc7f3bd0a3775', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '94d8702e-9652-4319-94ff-fc0294ea1b4b', 'created_at': datetime.datetime(2026, 8, 10, 13, 48, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 10, 13, 48, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/94d8702e-9652-4319-94ff-fc0294ea1b4b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 10 15:59:59 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7d9fd38-2953-4ddf-989b-1f088619dd00 tempest-ServerActionsTestOtherA-603942358 None] Trying to clone 50d4e265-39fd-46c6-9b38-06971e2c547f from image 94d8702e-9652-4319-94ff-fc0294ea1b4b at location (None, [{'url': 'file:///opt/stack/data/glance/images/94d8702e-9652-4319-94ff-fc0294ea1b4b', 'metadata': {}}]). {{(pid=88641) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 10 15:59:59 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-aecf519b-22be-467f-850f-163cd5258301 tempest-VolumesActionsTest-1607702842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 15:59:59 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-aecf519b-22be-467f-850f-163cd5258301 tempest-VolumesActionsTest-1607702842 None] Flow 'volume_create_manager' (5335bb60-c451-4a81-a07f-7f0a93531aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 15:59:59 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-aecf519b-22be-467f-850f-163cd5258301 tempest-VolumesActionsTest-1607702842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22b7fe85-3cd3-4712-8cdb-46b6aaeb75d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:59:59 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-aecf519b-22be-467f-850f-163cd5258301 tempest-VolumesActionsTest-1607702842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22b7fe85-3cd3-4712-8cdb-46b6aaeb75d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T13:59:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1562995033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=112a6b63-e871-4732-9cce-0b308abbe286,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9b0f3e24b1745dfa296d6952a3510ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:00:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:00:00Z,use_quota=True,user_id='b1ab3f855d0845f2bf2219223053d679',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:59:59 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-aecf519b-22be-467f-850f-163cd5258301 tempest-VolumesActionsTest-1607702842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f132dd03-74cc-43fd-bfe8-398203cced78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:59:59 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-aecf519b-22be-467f-850f-163cd5258301 tempest-VolumesActionsTest-1607702842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f132dd03-74cc-43fd-bfe8-398203cced78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:59:59 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-aecf519b-22be-467f-850f-163cd5258301 tempest-VolumesActionsTest-1607702842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c3895c4-c14a-4652-8508-099f28e74fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:59:59 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-aecf519b-22be-467f-850f-163cd5258301 tempest-VolumesActionsTest-1607702842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c3895c4-c14a-4652-8508-099f28e74fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '112a6b63-e871-4732-9cce-0b308abbe286', 'volume_name': 'volume-112a6b63-e871-4732-9cce-0b308abbe286', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:59:59 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-aecf519b-22be-467f-850f-163cd5258301 tempest-VolumesActionsTest-1607702842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (136c1d73-0efc-4b83-a7d7-945329e97e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:59:59 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-aecf519b-22be-467f-850f-163cd5258301 tempest-VolumesActionsTest-1607702842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (136c1d73-0efc-4b83-a7d7-945329e97e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 15:59:59 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-aecf519b-22be-467f-850f-163cd5258301 tempest-VolumesActionsTest-1607702842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08361d5d-ad67-41dc-9745-438eb7a6d404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 15:59:59 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-aecf519b-22be-467f-850f-163cd5258301 tempest-VolumesActionsTest-1607702842 None] Volume 112a6b63-e871-4732-9cce-0b308abbe286: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-112a6b63-e871-4732-9cce-0b308abbe286', 'volume_size': 1} Aug 10 15:59:59 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-aecf519b-22be-467f-850f-163cd5258301 tempest-VolumesActionsTest-1607702842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:59:59 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-aecf519b-22be-467f-850f-163cd5258301 tempest-VolumesActionsTest-1607702842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:59:59 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-aecf519b-22be-467f-850f-163cd5258301 tempest-VolumesActionsTest-1607702842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T13:59:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1562995033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=112a6b63-e871-4732-9cce-0b308abbe286,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9b0f3e24b1745dfa296d6952a3510ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:00:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:00:00Z,use_quota=True,user_id='b1ab3f855d0845f2bf2219223053d679',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 15:59:59 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-aecf519b-22be-467f-850f-163cd5258301 tempest-VolumesActionsTest-1607702842 None] Creating volume 112a6b63-e871-4732-9cce-0b308abbe286 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 15:59:59 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-aecf519b-22be-467f-850f-163cd5258301 tempest-VolumesActionsTest-1607702842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 15:59:59 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-aecf519b-22be-467f-850f-163cd5258301 tempest-VolumesActionsTest-1607702842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 15:59:59 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-aecf519b-22be-467f-850f-163cd5258301 tempest-VolumesActionsTest-1607702842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 15:59:59 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-aecf519b-22be-467f-850f-163cd5258301 tempest-VolumesActionsTest-1607702842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 15:59:59 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-aecf519b-22be-467f-850f-163cd5258301 tempest-VolumesActionsTest-1607702842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 15:59:59 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-aecf519b-22be-467f-850f-163cd5258301 tempest-VolumesActionsTest-1607702842 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 15:59:59 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-aecf519b-22be-467f-850f-163cd5258301 tempest-VolumesActionsTest-1607702842 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 15:59:59 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-aecf519b-22be-467f-850f-163cd5258301 tempest-VolumesActionsTest-1607702842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-112a6b63-e871-4732-9cce-0b308abbe286 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 15:59:59 devstack cinder-volume[88641]: DEBUG cinder.image.image_utils [None req-d7d9fd38-2953-4ddf-989b-1f088619dd00 tempest-ServerActionsTestOtherA-603942358 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_94d8702e-9652-4319-94ff-fc0294ea1b4b_kgjs4jx7devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88641) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 10 15:59:59 devstack cinder-volume[88641]: INFO cinder.image.image_utils [None req-d7d9fd38-2953-4ddf-989b-1f088619dd00 tempest-ServerActionsTestOtherA-603942358 None] Image download 20.69 MB at 20.69 MB/s Aug 10 15:59:59 devstack sudo[96187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-112a6b63-e871-4732-9cce-0b308abbe286 1073741824 Aug 10 15:59:59 devstack sudo[96187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:00:00 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b82831d-119c-4b69-8745-3105af7785cf]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:00:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d7d9fd38-2953-4ddf-989b-1f088619dd00 tempest-ServerActionsTestOtherA-603942358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94d8702e-9652-4319-94ff-fc0294ea1b4b_kgjs4jx7devstack@QuobyteHD {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:00:00 devstack sudo[96190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94d8702e-9652-4319-94ff-fc0294ea1b4b_kgjs4jx7devstack@QuobyteHD Aug 10 16:00:00 devstack sudo[96190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:00:00 devstack sudo[96190]: pam_unix(sudo:session): session closed for user root Aug 10 16:00:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d7d9fd38-2953-4ddf-989b-1f088619dd00 tempest-ServerActionsTestOtherA-603942358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94d8702e-9652-4319-94ff-fc0294ea1b4b_kgjs4jx7devstack@QuobyteHD" returned: 0 in 0.657s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:00:00 devstack cinder-volume[88641]: DEBUG cinder.image.image_utils [None req-d7d9fd38-2953-4ddf-989b-1f088619dd00 tempest-ServerActionsTestOtherA-603942358 None] Temporary image 94d8702e-9652-4319-94ff-fc0294ea1b4b is fetched for user f91a8a33d77e4544805d3c8ea355f55a. {{(pid=88641) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 10 16:00:00 devstack sudo[96187]: pam_unix(sudo:session): session closed for user root Aug 10 16:00:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-aecf519b-22be-467f-850f-163cd5258301 tempest-VolumesActionsTest-1607702842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-112a6b63-e871-4732-9cce-0b308abbe286 1073741824" returned: 0 in 0.797s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:00:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-aecf519b-22be-467f-850f-163cd5258301 tempest-VolumesActionsTest-1607702842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-112a6b63-e871-4732-9cce-0b308abbe286 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:00:00 devstack sudo[96199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-112a6b63-e871-4732-9cce-0b308abbe286 Aug 10 16:00:00 devstack sudo[96199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:00:00 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff1bab63-4e30-474e-86d4-22c65e2dead1]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:00:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d7d9fd38-2953-4ddf-989b-1f088619dd00 tempest-ServerActionsTestOtherA-603942358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94d8702e-9652-4319-94ff-fc0294ea1b4b_kgjs4jx7devstack@QuobyteHD {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:00:00 devstack sudo[96202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94d8702e-9652-4319-94ff-fc0294ea1b4b_kgjs4jx7devstack@QuobyteHD Aug 10 16:00:00 devstack sudo[96202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:00:01 devstack sudo[96199]: pam_unix(sudo:session): session closed for user root Aug 10 16:00:01 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-aecf519b-22be-467f-850f-163cd5258301 tempest-VolumesActionsTest-1607702842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-112a6b63-e871-4732-9cce-0b308abbe286" returned: 0 in 0.368s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:00:01 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-aecf519b-22be-467f-850f-163cd5258301 tempest-VolumesActionsTest-1607702842 None] <== create_volume: return (1252ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:00:01 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-aecf519b-22be-467f-850f-163cd5258301 tempest-VolumesActionsTest-1607702842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.255s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:00:01 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-aecf519b-22be-467f-850f-163cd5258301 tempest-VolumesActionsTest-1607702842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08361d5d-ad67-41dc-9745-438eb7a6d404) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-112a6b63-e871-4732-9cce-0b308abbe286', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:00:01 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-aecf519b-22be-467f-850f-163cd5258301 tempest-VolumesActionsTest-1607702842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b10a66c-9987-4971-9e09-768c13310e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:00:01 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-aecf519b-22be-467f-850f-163cd5258301 tempest-VolumesActionsTest-1607702842 None] Volume volume-112a6b63-e871-4732-9cce-0b308abbe286 (112a6b63-e871-4732-9cce-0b308abbe286): created successfully Aug 10 16:00:01 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-aecf519b-22be-467f-850f-163cd5258301 tempest-VolumesActionsTest-1607702842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b10a66c-9987-4971-9e09-768c13310e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:00:01 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-aecf519b-22be-467f-850f-163cd5258301 tempest-VolumesActionsTest-1607702842 None] Flow 'volume_create_manager' (5335bb60-c451-4a81-a07f-7f0a93531aa6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:00:01 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-aecf519b-22be-467f-850f-163cd5258301 tempest-VolumesActionsTest-1607702842 None] Created volume successfully. Aug 10 16:00:01 devstack sudo[96202]: pam_unix(sudo:session): session closed for user root Aug 10 16:00:01 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d7d9fd38-2953-4ddf-989b-1f088619dd00 tempest-ServerActionsTestOtherA-603942358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94d8702e-9652-4319-94ff-fc0294ea1b4b_kgjs4jx7devstack@QuobyteHD" returned: 0 in 0.435s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:00:01 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-d7d9fd38-2953-4ddf-989b-1f088619dd00 tempest-ServerActionsTestOtherA-603942358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:00:01 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-d7d9fd38-2953-4ddf-989b-1f088619dd00 tempest-ServerActionsTestOtherA-603942358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:00:01 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-d7d9fd38-2953-4ddf-989b-1f088619dd00 tempest-ServerActionsTestOtherA-603942358 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T13:59:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-99997593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50d4e265-39fd-46c6-9b38-06971e2c547f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03078de0c6d743b39bc32b527af6f07c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T13:59:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T13:59:58Z,use_quota=True,user_id='f91a8a33d77e4544805d3c8ea355f55a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:00:01 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-d7d9fd38-2953-4ddf-989b-1f088619dd00 tempest-ServerActionsTestOtherA-603942358 None] Creating volume 50d4e265-39fd-46c6-9b38-06971e2c547f {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:00:01 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-d7d9fd38-2953-4ddf-989b-1f088619dd00 tempest-ServerActionsTestOtherA-603942358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:00:01 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-d7d9fd38-2953-4ddf-989b-1f088619dd00 tempest-ServerActionsTestOtherA-603942358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:00:01 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-d7d9fd38-2953-4ddf-989b-1f088619dd00 tempest-ServerActionsTestOtherA-603942358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:00:01 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-d7d9fd38-2953-4ddf-989b-1f088619dd00 tempest-ServerActionsTestOtherA-603942358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:00:01 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-d7d9fd38-2953-4ddf-989b-1f088619dd00 tempest-ServerActionsTestOtherA-603942358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:00:01 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-d7d9fd38-2953-4ddf-989b-1f088619dd00 tempest-ServerActionsTestOtherA-603942358 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:00:01 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-d7d9fd38-2953-4ddf-989b-1f088619dd00 tempest-ServerActionsTestOtherA-603942358 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:00:01 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d7d9fd38-2953-4ddf-989b-1f088619dd00 tempest-ServerActionsTestOtherA-603942358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-50d4e265-39fd-46c6-9b38-06971e2c547f 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:00:01 devstack sudo[96210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-50d4e265-39fd-46c6-9b38-06971e2c547f 1073741824 Aug 10 16:00:01 devstack sudo[96210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:00:02 devstack sudo[96210]: pam_unix(sudo:session): session closed for user root Aug 10 16:00:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d7d9fd38-2953-4ddf-989b-1f088619dd00 tempest-ServerActionsTestOtherA-603942358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-50d4e265-39fd-46c6-9b38-06971e2c547f 1073741824" returned: 0 in 0.828s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:00:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d7d9fd38-2953-4ddf-989b-1f088619dd00 tempest-ServerActionsTestOtherA-603942358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-50d4e265-39fd-46c6-9b38-06971e2c547f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:00:02 devstack sudo[96233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-50d4e265-39fd-46c6-9b38-06971e2c547f Aug 10 16:00:02 devstack sudo[96233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:00:02 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-77b03316-494a-4c2f-bc74-56df4f001137 tempest-VolumesActionsTest-456021455 None] Acquiring lock "cinder-112a6b63-e871-4732-9cce-0b308abbe286-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:00:02 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-77b03316-494a-4c2f-bc74-56df4f001137 tempest-VolumesActionsTest-456021455 None] Lock "cinder-112a6b63-e871-4732-9cce-0b308abbe286-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:00:02 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-77b03316-494a-4c2f-bc74-56df4f001137 tempest-VolumesActionsTest-456021455 None] Acquiring lock "cinder-quobyte-112a6b63-e871-4732-9cce-0b308abbe286" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:00:02 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-77b03316-494a-4c2f-bc74-56df4f001137 tempest-VolumesActionsTest-456021455 None] Lock "cinder-quobyte-112a6b63-e871-4732-9cce-0b308abbe286" acquired by "delete_volume" :: waited 0.022s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:00:02 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[df21405e-c341-44e3-952a-f6be1bf418ce]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:00:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-77b03316-494a-4c2f-bc74-56df4f001137 tempest-VolumesActionsTest-456021455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-112a6b63-e871-4732-9cce-0b308abbe286 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:00:02 devstack sudo[96233]: pam_unix(sudo:session): session closed for user root Aug 10 16:00:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d7d9fd38-2953-4ddf-989b-1f088619dd00 tempest-ServerActionsTestOtherA-603942358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-50d4e265-39fd-46c6-9b38-06971e2c547f" returned: 0 in 0.421s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:00:02 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-d7d9fd38-2953-4ddf-989b-1f088619dd00 tempest-ServerActionsTestOtherA-603942358 None] <== create_volume: return (1380ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:00:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-d7d9fd38-2953-4ddf-989b-1f088619dd00 tempest-ServerActionsTestOtherA-603942358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.386s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:00:02 devstack sudo[96236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-112a6b63-e871-4732-9cce-0b308abbe286 Aug 10 16:00:02 devstack sudo[96236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:00:02 devstack cinder-volume[88641]: DEBUG cinder.volume.volume_utils [None req-d7d9fd38-2953-4ddf-989b-1f088619dd00 tempest-ServerActionsTestOtherA-603942358 None] Attempting download of 94d8702e-9652-4319-94ff-fc0294ea1b4b ((None, [{'url': 'file:///opt/stack/data/glance/images/94d8702e-9652-4319-94ff-fc0294ea1b4b', 'metadata': {}}])) to volume 50d4e265-39fd-46c6-9b38-06971e2c547f. {{(pid=88641) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 10 16:00:02 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b66cbe1-5b77-4aba-8fbc-7d90ddd1bae1]: (4, 'raw') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:00:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d7d9fd38-2953-4ddf-989b-1f088619dd00 tempest-ServerActionsTestOtherA-603942358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_94d8702e-9652-4319-94ff-fc0294ea1b4b_bgynm230 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:00:02 devstack sudo[96239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_94d8702e-9652-4319-94ff-fc0294ea1b4b_bgynm230 Aug 10 16:00:02 devstack sudo[96239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:00:03 devstack sudo[96236]: pam_unix(sudo:session): session closed for user root Aug 10 16:00:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-77b03316-494a-4c2f-bc74-56df4f001137 tempest-VolumesActionsTest-456021455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-112a6b63-e871-4732-9cce-0b308abbe286" returned: 0 in 0.579s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:00:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-77b03316-494a-4c2f-bc74-56df4f001137 tempest-VolumesActionsTest-456021455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-112a6b63-e871-4732-9cce-0b308abbe286 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:00:03 devstack sudo[96244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-112a6b63-e871-4732-9cce-0b308abbe286 Aug 10 16:00:03 devstack sudo[96244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:00:03 devstack sudo[96239]: pam_unix(sudo:session): session closed for user root Aug 10 16:00:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d7d9fd38-2953-4ddf-989b-1f088619dd00 tempest-ServerActionsTestOtherA-603942358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_94d8702e-9652-4319-94ff-fc0294ea1b4b_bgynm230" returned: 0 in 0.598s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:00:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d7d9fd38-2953-4ddf-989b-1f088619dd00 tempest-ServerActionsTestOtherA-603942358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_94d8702e-9652-4319-94ff-fc0294ea1b4b_bgynm230 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:00:03 devstack sudo[96244]: pam_unix(sudo:session): session closed for user root Aug 10 16:00:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-77b03316-494a-4c2f-bc74-56df4f001137 tempest-VolumesActionsTest-456021455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-112a6b63-e871-4732-9cce-0b308abbe286" returned: 0 in 0.666s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:00:03 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-77b03316-494a-4c2f-bc74-56df4f001137 tempest-VolumesActionsTest-456021455 None] Lock "cinder-quobyte-112a6b63-e871-4732-9cce-0b308abbe286" released by "delete_volume" :: held 1.326s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:00:03 devstack sudo[96261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_94d8702e-9652-4319-94ff-fc0294ea1b4b_bgynm230 Aug 10 16:00:03 devstack sudo[96261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:00:03 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-77b03316-494a-4c2f-bc74-56df4f001137 tempest-VolumesActionsTest-456021455 None] Created reservations ['fd9b72eb-644d-460f-8c82-3a948789776f', '28222b91-2236-4499-9f10-ed5c62d9a798', '43b8417f-5529-46f6-bd9d-8c5dbb4ffdde', 'e633d4fc-f82d-492b-a416-6cf84ba9351e'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:00:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-77b03316-494a-4c2f-bc74-56df4f001137 tempest-VolumesActionsTest-456021455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:00:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-77b03316-494a-4c2f-bc74-56df4f001137 tempest-VolumesActionsTest-456021455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:00:04 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-77b03316-494a-4c2f-bc74-56df4f001137 tempest-VolumesActionsTest-456021455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:00:04 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-77b03316-494a-4c2f-bc74-56df4f001137 tempest-VolumesActionsTest-456021455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:00:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-77b03316-494a-4c2f-bc74-56df4f001137 tempest-VolumesActionsTest-456021455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:00:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-77b03316-494a-4c2f-bc74-56df4f001137 tempest-VolumesActionsTest-456021455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:00:04 devstack sudo[96261]: pam_unix(sudo:session): session closed for user root Aug 10 16:00:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d7d9fd38-2953-4ddf-989b-1f088619dd00 tempest-ServerActionsTestOtherA-603942358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_94d8702e-9652-4319-94ff-fc0294ea1b4b_bgynm230" returned: 1 in 0.703s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:00:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d7d9fd38-2953-4ddf-989b-1f088619dd00 tempest-ServerActionsTestOtherA-603942358 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_94d8702e-9652-4319-94ff-fc0294ea1b4b_bgynm230' failed. Not Retrying. {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 10 16:00:04 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d7c88c-a045-4e1e-9e7d-5e121235faa2]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:00:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d7d9fd38-2953-4ddf-989b-1f088619dd00 tempest-ServerActionsTestOtherA-603942358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94d8702e-9652-4319-94ff-fc0294ea1b4b_kgjs4jx7devstack@QuobyteHD {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:00:04 devstack sudo[96296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:00:04 devstack sudo[96296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:00:04 devstack sudo[96301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94d8702e-9652-4319-94ff-fc0294ea1b4b_kgjs4jx7devstack@QuobyteHD Aug 10 16:00:04 devstack sudo[96301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:00:04 devstack sudo[96296]: pam_unix(sudo:session): session closed for user root Aug 10 16:00:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-77b03316-494a-4c2f-bc74-56df4f001137 tempest-VolumesActionsTest-456021455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.472s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:00:04 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-77b03316-494a-4c2f-bc74-56df4f001137 tempest-VolumesActionsTest-456021455 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:00:04 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-77b03316-494a-4c2f-bc74-56df4f001137 tempest-VolumesActionsTest-456021455 None] Deleted volume successfully. Aug 10 16:00:04 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-77b03316-494a-4c2f-bc74-56df4f001137 tempest-VolumesActionsTest-456021455 None] Lock "cinder-112a6b63-e871-4732-9cce-0b308abbe286-delete_volume" released by "delete_volume" :: held 2.284s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:00:04 devstack sudo[96301]: pam_unix(sudo:session): session closed for user root Aug 10 16:00:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d7d9fd38-2953-4ddf-989b-1f088619dd00 tempest-ServerActionsTestOtherA-603942358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94d8702e-9652-4319-94ff-fc0294ea1b4b_kgjs4jx7devstack@QuobyteHD" returned: 0 in 0.609s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:00:04 devstack cinder-volume[88641]: DEBUG cinder.image.image_utils [None req-d7d9fd38-2953-4ddf-989b-1f088619dd00 tempest-ServerActionsTestOtherA-603942358 None] 94d8702e-9652-4319-94ff-fc0294ea1b4b was qcow2, converting to qcow2 {{(pid=88641) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 10 16:00:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d7d9fd38-2953-4ddf-989b-1f088619dd00 tempest-ServerActionsTestOtherA-603942358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_94d8702e-9652-4319-94ff-fc0294ea1b4b_kgjs4jx7devstack@QuobyteHD /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-50d4e265-39fd-46c6-9b38-06971e2c547f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:00:04 devstack sudo[96328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_94d8702e-9652-4319-94ff-fc0294ea1b4b_kgjs4jx7devstack@QuobyteHD /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-50d4e265-39fd-46c6-9b38-06971e2c547f Aug 10 16:00:04 devstack sudo[96328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:00:05 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-82e245a6-3e85-47d3-b434-5f71c9ffd265 tempest-VolumesActionsTest-1607702842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:00:05 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-82e245a6-3e85-47d3-b434-5f71c9ffd265 tempest-VolumesActionsTest-1607702842 None] Flow 'volume_create_manager' (8ffafee4-faee-44e8-8543-eae8171e8fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:00:05 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-82e245a6-3e85-47d3-b434-5f71c9ffd265 tempest-VolumesActionsTest-1607702842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f492cbf-9f62-48c8-9223-3537d7126abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:00:05 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-82e245a6-3e85-47d3-b434-5f71c9ffd265 tempest-VolumesActionsTest-1607702842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f492cbf-9f62-48c8-9223-3537d7126abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:00:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-319089214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8569d20-a39d-44f4-bee9-2f82e5f8aadd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9b0f3e24b1745dfa296d6952a3510ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:00:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:00:06Z,use_quota=True,user_id='b1ab3f855d0845f2bf2219223053d679',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:00:05 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-82e245a6-3e85-47d3-b434-5f71c9ffd265 tempest-VolumesActionsTest-1607702842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bcfffd9-38c4-4481-ab91-5f769caf0b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:00:05 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-82e245a6-3e85-47d3-b434-5f71c9ffd265 tempest-VolumesActionsTest-1607702842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bcfffd9-38c4-4481-ab91-5f769caf0b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:00:05 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-82e245a6-3e85-47d3-b434-5f71c9ffd265 tempest-VolumesActionsTest-1607702842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (405e830b-f2d2-45ed-a365-10fceab3cb89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:00:05 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-82e245a6-3e85-47d3-b434-5f71c9ffd265 tempest-VolumesActionsTest-1607702842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (405e830b-f2d2-45ed-a365-10fceab3cb89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8569d20-a39d-44f4-bee9-2f82e5f8aadd', 'volume_name': 'volume-d8569d20-a39d-44f4-bee9-2f82e5f8aadd', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:00:05 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-82e245a6-3e85-47d3-b434-5f71c9ffd265 tempest-VolumesActionsTest-1607702842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8c8cb2e-c5e2-40fd-bda3-6481b7b16fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:00:05 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-82e245a6-3e85-47d3-b434-5f71c9ffd265 tempest-VolumesActionsTest-1607702842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8c8cb2e-c5e2-40fd-bda3-6481b7b16fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:00:05 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-82e245a6-3e85-47d3-b434-5f71c9ffd265 tempest-VolumesActionsTest-1607702842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9be8c2d-a21e-49ee-924d-760daa5fb44e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:00:05 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-82e245a6-3e85-47d3-b434-5f71c9ffd265 tempest-VolumesActionsTest-1607702842 None] Volume d8569d20-a39d-44f4-bee9-2f82e5f8aadd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8569d20-a39d-44f4-bee9-2f82e5f8aadd', 'volume_size': 1} Aug 10 16:00:05 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-82e245a6-3e85-47d3-b434-5f71c9ffd265 tempest-VolumesActionsTest-1607702842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:00:05 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-82e245a6-3e85-47d3-b434-5f71c9ffd265 tempest-VolumesActionsTest-1607702842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:00:05 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-82e245a6-3e85-47d3-b434-5f71c9ffd265 tempest-VolumesActionsTest-1607702842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:00:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-319089214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8569d20-a39d-44f4-bee9-2f82e5f8aadd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9b0f3e24b1745dfa296d6952a3510ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:00:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:00:06Z,use_quota=True,user_id='b1ab3f855d0845f2bf2219223053d679',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:00:05 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-82e245a6-3e85-47d3-b434-5f71c9ffd265 tempest-VolumesActionsTest-1607702842 None] Creating volume d8569d20-a39d-44f4-bee9-2f82e5f8aadd {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:00:05 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-82e245a6-3e85-47d3-b434-5f71c9ffd265 tempest-VolumesActionsTest-1607702842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:00:05 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-82e245a6-3e85-47d3-b434-5f71c9ffd265 tempest-VolumesActionsTest-1607702842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:00:05 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-82e245a6-3e85-47d3-b434-5f71c9ffd265 tempest-VolumesActionsTest-1607702842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:00:05 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-82e245a6-3e85-47d3-b434-5f71c9ffd265 tempest-VolumesActionsTest-1607702842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:00:05 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-82e245a6-3e85-47d3-b434-5f71c9ffd265 tempest-VolumesActionsTest-1607702842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:00:05 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-82e245a6-3e85-47d3-b434-5f71c9ffd265 tempest-VolumesActionsTest-1607702842 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:00:05 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-82e245a6-3e85-47d3-b434-5f71c9ffd265 tempest-VolumesActionsTest-1607702842 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:00:05 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-82e245a6-3e85-47d3-b434-5f71c9ffd265 tempest-VolumesActionsTest-1607702842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d8569d20-a39d-44f4-bee9-2f82e5f8aadd 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:00:05 devstack sudo[96368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d8569d20-a39d-44f4-bee9-2f82e5f8aadd 1073741824 Aug 10 16:00:05 devstack sudo[96368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:00:06 devstack sudo[96368]: pam_unix(sudo:session): session closed for user root Aug 10 16:00:06 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-82e245a6-3e85-47d3-b434-5f71c9ffd265 tempest-VolumesActionsTest-1607702842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d8569d20-a39d-44f4-bee9-2f82e5f8aadd 1073741824" returned: 0 in 1.080s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:00:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-82e245a6-3e85-47d3-b434-5f71c9ffd265 tempest-VolumesActionsTest-1607702842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d8569d20-a39d-44f4-bee9-2f82e5f8aadd {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:00:07 devstack sudo[96409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d8569d20-a39d-44f4-bee9-2f82e5f8aadd Aug 10 16:00:07 devstack sudo[96409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:00:07 devstack sudo[96409]: pam_unix(sudo:session): session closed for user root Aug 10 16:00:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-82e245a6-3e85-47d3-b434-5f71c9ffd265 tempest-VolumesActionsTest-1607702842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d8569d20-a39d-44f4-bee9-2f82e5f8aadd" returned: 0 in 0.896s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:00:08 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-82e245a6-3e85-47d3-b434-5f71c9ffd265 tempest-VolumesActionsTest-1607702842 None] <== create_volume: return (2093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:00:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-82e245a6-3e85-47d3-b434-5f71c9ffd265 tempest-VolumesActionsTest-1607702842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.103s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:00:08 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-82e245a6-3e85-47d3-b434-5f71c9ffd265 tempest-VolumesActionsTest-1607702842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9be8c2d-a21e-49ee-924d-760daa5fb44e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8569d20-a39d-44f4-bee9-2f82e5f8aadd', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:00:08 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-82e245a6-3e85-47d3-b434-5f71c9ffd265 tempest-VolumesActionsTest-1607702842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e10a46f-1983-4d3a-8c1a-4be44062248f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:00:08 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-82e245a6-3e85-47d3-b434-5f71c9ffd265 tempest-VolumesActionsTest-1607702842 None] Volume volume-d8569d20-a39d-44f4-bee9-2f82e5f8aadd (d8569d20-a39d-44f4-bee9-2f82e5f8aadd): created successfully Aug 10 16:00:08 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-82e245a6-3e85-47d3-b434-5f71c9ffd265 tempest-VolumesActionsTest-1607702842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e10a46f-1983-4d3a-8c1a-4be44062248f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:00:08 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-82e245a6-3e85-47d3-b434-5f71c9ffd265 tempest-VolumesActionsTest-1607702842 None] Flow 'volume_create_manager' (8ffafee4-faee-44e8-8543-eae8171e8fe5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:00:08 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-82e245a6-3e85-47d3-b434-5f71c9ffd265 tempest-VolumesActionsTest-1607702842 None] Created volume successfully. Aug 10 16:00:08 devstack sudo[96328]: pam_unix(sudo:session): session closed for user root Aug 10 16:00:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d7d9fd38-2953-4ddf-989b-1f088619dd00 tempest-ServerActionsTestOtherA-603942358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_94d8702e-9652-4319-94ff-fc0294ea1b4b_kgjs4jx7devstack@QuobyteHD /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-50d4e265-39fd-46c6-9b38-06971e2c547f" returned: 0 in 3.981s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:00:08 devstack cinder-volume[88641]: DEBUG cinder.image.image_utils [None req-d7d9fd38-2953-4ddf-989b-1f088619dd00 tempest-ServerActionsTestOtherA-603942358 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_94d8702e-9652-4319-94ff-fc0294ea1b4b_kgjs4jx7devstack@QuobyteHD, size 112.00 MB, duration 3.98 sec, destination /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-50d4e265-39fd-46c6-9b38-06971e2c547f {{(pid=88641) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 10 16:00:08 devstack cinder-volume[88641]: INFO cinder.image.image_utils [None req-d7d9fd38-2953-4ddf-989b-1f088619dd00 tempest-ServerActionsTestOtherA-603942358 None] Converted 112.00 MB image at 28.12 MB/s Aug 10 16:00:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d7d9fd38-2953-4ddf-989b-1f088619dd00 tempest-ServerActionsTestOtherA-603942358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-50d4e265-39fd-46c6-9b38-06971e2c547f 1G {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:00:08 devstack sudo[96438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-50d4e265-39fd-46c6-9b38-06971e2c547f 1G Aug 10 16:00:08 devstack sudo[96438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:00:09 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-0175c01b-3fd3-429c-9507-78a3dcbc2020 tempest-VolumesActionsTest-456021455 None] Acquiring lock "cinder-d8569d20-a39d-44f4-bee9-2f82e5f8aadd-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:00:09 devstack sudo[96438]: pam_unix(sudo:session): session closed for user root Aug 10 16:00:09 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-0175c01b-3fd3-429c-9507-78a3dcbc2020 tempest-VolumesActionsTest-456021455 None] Lock "cinder-d8569d20-a39d-44f4-bee9-2f82e5f8aadd-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:00:09 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d7d9fd38-2953-4ddf-989b-1f088619dd00 tempest-ServerActionsTestOtherA-603942358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-50d4e265-39fd-46c6-9b38-06971e2c547f 1G" returned: 0 in 0.439s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:00:09 devstack cinder-volume[88641]: DEBUG cinder.volume.volume_utils [None req-d7d9fd38-2953-4ddf-989b-1f088619dd00 tempest-ServerActionsTestOtherA-603942358 None] Downloaded image 94d8702e-9652-4319-94ff-fc0294ea1b4b ((None, [{'url': 'file:///opt/stack/data/glance/images/94d8702e-9652-4319-94ff-fc0294ea1b4b', 'metadata': {}}])) to volume 50d4e265-39fd-46c6-9b38-06971e2c547f successfully. {{(pid=88641) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 10 16:00:09 devstack cinder-volume[88641]: DEBUG cinder.image.image_utils [None req-d7d9fd38-2953-4ddf-989b-1f088619dd00 tempest-ServerActionsTestOtherA-603942358 None] Temporary image 94d8702e-9652-4319-94ff-fc0294ea1b4b for user f91a8a33d77e4544805d3c8ea355f55a is deleted. {{(pid=88641) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 10 16:00:09 devstack cinder-volume[88641]: DEBUG cinder.volume.volume_utils [None req-d7d9fd38-2953-4ddf-989b-1f088619dd00 tempest-ServerActionsTestOtherA-603942358 None] Marking volume 50d4e265-39fd-46c6-9b38-06971e2c547f as bootable. {{(pid=88641) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 10 16:00:09 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7d9fd38-2953-4ddf-989b-1f088619dd00 tempest-ServerActionsTestOtherA-603942358 None] Copying metadata from image 94d8702e-9652-4319-94ff-fc0294ea1b4b to 50d4e265-39fd-46c6-9b38-06971e2c547f. {{(pid=88641) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 10 16:00:09 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7d9fd38-2953-4ddf-989b-1f088619dd00 tempest-ServerActionsTestOtherA-603942358 None] Creating volume glance metadata for volume 50d4e265-39fd-46c6-9b38-06971e2c547f backed by image 94d8702e-9652-4319-94ff-fc0294ea1b4b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '94d8702e-9652-4319-94ff-fc0294ea1b4b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88641) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 10 16:00:09 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-0175c01b-3fd3-429c-9507-78a3dcbc2020 tempest-VolumesActionsTest-456021455 None] Acquiring lock "cinder-quobyte-d8569d20-a39d-44f4-bee9-2f82e5f8aadd" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:00:09 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-0175c01b-3fd3-429c-9507-78a3dcbc2020 tempest-VolumesActionsTest-456021455 None] Lock "cinder-quobyte-d8569d20-a39d-44f4-bee9-2f82e5f8aadd" acquired by "delete_volume" :: waited 0.046s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:00:09 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f2e20fd-fd61-467e-9426-b9e132d42e0f]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:00:09 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0175c01b-3fd3-429c-9507-78a3dcbc2020 tempest-VolumesActionsTest-456021455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d8569d20-a39d-44f4-bee9-2f82e5f8aadd {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:00:09 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d7d9fd38-2953-4ddf-989b-1f088619dd00 tempest-ServerActionsTestOtherA-603942358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bb56d2e-952e-45aa-a05d-380762a50500) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50d4e265-39fd-46c6-9b38-06971e2c547f', 'volume_size': 1, 'image_id': '94d8702e-9652-4319-94ff-fc0294ea1b4b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/94d8702e-9652-4319-94ff-fc0294ea1b4b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9e18d747214f4822be3dc7f3bd0a3775', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '94d8702e-9652-4319-94ff-fc0294ea1b4b', 'created_at': datetime.datetime(2026, 8, 10, 13, 48, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 10, 13, 48, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/94d8702e-9652-4319-94ff-fc0294ea1b4b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:00:09 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d7d9fd38-2953-4ddf-989b-1f088619dd00 tempest-ServerActionsTestOtherA-603942358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9a16173-085c-495b-8ccb-0ff09a6169dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:00:09 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-d7d9fd38-2953-4ddf-989b-1f088619dd00 tempest-ServerActionsTestOtherA-603942358 None] Volume volume-50d4e265-39fd-46c6-9b38-06971e2c547f (50d4e265-39fd-46c6-9b38-06971e2c547f): created successfully Aug 10 16:00:09 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d7d9fd38-2953-4ddf-989b-1f088619dd00 tempest-ServerActionsTestOtherA-603942358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9a16173-085c-495b-8ccb-0ff09a6169dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:00:09 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d7d9fd38-2953-4ddf-989b-1f088619dd00 tempest-ServerActionsTestOtherA-603942358 None] Flow 'volume_create_manager' (8c1d87cc-c1da-4876-ae4b-52d8e96f0ab9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:00:09 devstack sudo[96464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d8569d20-a39d-44f4-bee9-2f82e5f8aadd Aug 10 16:00:09 devstack sudo[96464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:00:09 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-d7d9fd38-2953-4ddf-989b-1f088619dd00 tempest-ServerActionsTestOtherA-603942358 None] Created volume successfully. Aug 10 16:00:10 devstack sudo[96464]: pam_unix(sudo:session): session closed for user root Aug 10 16:00:10 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0175c01b-3fd3-429c-9507-78a3dcbc2020 tempest-VolumesActionsTest-456021455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d8569d20-a39d-44f4-bee9-2f82e5f8aadd" returned: 0 in 0.715s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:00:10 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0175c01b-3fd3-429c-9507-78a3dcbc2020 tempest-VolumesActionsTest-456021455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d8569d20-a39d-44f4-bee9-2f82e5f8aadd {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:00:10 devstack sudo[96477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d8569d20-a39d-44f4-bee9-2f82e5f8aadd Aug 10 16:00:10 devstack sudo[96477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:00:10 devstack sudo[96477]: pam_unix(sudo:session): session closed for user root Aug 10 16:00:10 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0175c01b-3fd3-429c-9507-78a3dcbc2020 tempest-VolumesActionsTest-456021455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d8569d20-a39d-44f4-bee9-2f82e5f8aadd" returned: 0 in 0.517s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:00:10 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-0175c01b-3fd3-429c-9507-78a3dcbc2020 tempest-VolumesActionsTest-456021455 None] Lock "cinder-quobyte-d8569d20-a39d-44f4-bee9-2f82e5f8aadd" released by "delete_volume" :: held 1.334s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:00:10 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-0175c01b-3fd3-429c-9507-78a3dcbc2020 tempest-VolumesActionsTest-456021455 None] Created reservations ['b588e3f3-fb9c-4357-95e9-c761cfce501d', 'bbf6e435-398b-433c-b357-dfb61e458205', 'b2574db0-65f0-481a-a7d0-4b9211206023', '37a6e5bc-10a4-4bab-b5a5-7c604d88dae0'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:00:10 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-0175c01b-3fd3-429c-9507-78a3dcbc2020 tempest-VolumesActionsTest-456021455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:00:10 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-0175c01b-3fd3-429c-9507-78a3dcbc2020 tempest-VolumesActionsTest-456021455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:00:10 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-0175c01b-3fd3-429c-9507-78a3dcbc2020 tempest-VolumesActionsTest-456021455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:00:10 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-0175c01b-3fd3-429c-9507-78a3dcbc2020 tempest-VolumesActionsTest-456021455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:00:10 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-0175c01b-3fd3-429c-9507-78a3dcbc2020 tempest-VolumesActionsTest-456021455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:00:10 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0175c01b-3fd3-429c-9507-78a3dcbc2020 tempest-VolumesActionsTest-456021455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:00:10 devstack sudo[96481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:00:10 devstack sudo[96481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:00:11 devstack sudo[96481]: pam_unix(sudo:session): session closed for user root Aug 10 16:00:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0175c01b-3fd3-429c-9507-78a3dcbc2020 tempest-VolumesActionsTest-456021455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.360s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:00:11 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-0175c01b-3fd3-429c-9507-78a3dcbc2020 tempest-VolumesActionsTest-456021455 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:00:11 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-0175c01b-3fd3-429c-9507-78a3dcbc2020 tempest-VolumesActionsTest-456021455 None] Deleted volume successfully. Aug 10 16:00:11 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-0175c01b-3fd3-429c-9507-78a3dcbc2020 tempest-VolumesActionsTest-456021455 None] Lock "cinder-d8569d20-a39d-44f4-bee9-2f82e5f8aadd-delete_volume" released by "delete_volume" :: held 2.168s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:00:12 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-e65b554c-ed40-4f85-bc80-cea68cee3c57 tempest-VolumesActionsTest-1607702842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:00:12 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-e65b554c-ed40-4f85-bc80-cea68cee3c57 tempest-VolumesActionsTest-1607702842 None] Flow 'volume_create_manager' (6881a689-889b-4a39-b72a-3c8ba61735d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:00:12 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-e65b554c-ed40-4f85-bc80-cea68cee3c57 tempest-VolumesActionsTest-1607702842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc9d4076-1843-4bab-aa6c-5f476d9f7037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:00:12 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-e65b554c-ed40-4f85-bc80-cea68cee3c57 tempest-VolumesActionsTest-1607702842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc9d4076-1843-4bab-aa6c-5f476d9f7037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:00:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-450367726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c626fcbb-3669-49b3-a21a-70d9a31a9a63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9b0f3e24b1745dfa296d6952a3510ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:00:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:00:13Z,use_quota=True,user_id='b1ab3f855d0845f2bf2219223053d679',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:00:12 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-e65b554c-ed40-4f85-bc80-cea68cee3c57 tempest-VolumesActionsTest-1607702842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9591c70e-4246-4219-a65e-5ffe3d6c6b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:00:12 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-e65b554c-ed40-4f85-bc80-cea68cee3c57 tempest-VolumesActionsTest-1607702842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9591c70e-4246-4219-a65e-5ffe3d6c6b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:00:12 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-e65b554c-ed40-4f85-bc80-cea68cee3c57 tempest-VolumesActionsTest-1607702842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d499c9a-4f07-4e18-863a-53f7d749fe10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:00:12 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-e65b554c-ed40-4f85-bc80-cea68cee3c57 tempest-VolumesActionsTest-1607702842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d499c9a-4f07-4e18-863a-53f7d749fe10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c626fcbb-3669-49b3-a21a-70d9a31a9a63', 'volume_name': 'volume-c626fcbb-3669-49b3-a21a-70d9a31a9a63', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:00:12 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-e65b554c-ed40-4f85-bc80-cea68cee3c57 tempest-VolumesActionsTest-1607702842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (088b7f2d-3070-412b-95eb-dfbf4689c3c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:00:12 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-e65b554c-ed40-4f85-bc80-cea68cee3c57 tempest-VolumesActionsTest-1607702842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (088b7f2d-3070-412b-95eb-dfbf4689c3c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:00:12 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-e65b554c-ed40-4f85-bc80-cea68cee3c57 tempest-VolumesActionsTest-1607702842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b29b135-9f8e-4a56-92da-ee3ea097c0d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:00:12 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-e65b554c-ed40-4f85-bc80-cea68cee3c57 tempest-VolumesActionsTest-1607702842 None] Volume c626fcbb-3669-49b3-a21a-70d9a31a9a63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c626fcbb-3669-49b3-a21a-70d9a31a9a63', 'volume_size': 1} Aug 10 16:00:12 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-e65b554c-ed40-4f85-bc80-cea68cee3c57 tempest-VolumesActionsTest-1607702842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:00:12 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-e65b554c-ed40-4f85-bc80-cea68cee3c57 tempest-VolumesActionsTest-1607702842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:00:12 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-e65b554c-ed40-4f85-bc80-cea68cee3c57 tempest-VolumesActionsTest-1607702842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:00:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-450367726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c626fcbb-3669-49b3-a21a-70d9a31a9a63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9b0f3e24b1745dfa296d6952a3510ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:00:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:00:13Z,use_quota=True,user_id='b1ab3f855d0845f2bf2219223053d679',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:00:12 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-e65b554c-ed40-4f85-bc80-cea68cee3c57 tempest-VolumesActionsTest-1607702842 None] Creating volume c626fcbb-3669-49b3-a21a-70d9a31a9a63 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:00:12 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-e65b554c-ed40-4f85-bc80-cea68cee3c57 tempest-VolumesActionsTest-1607702842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:00:12 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-e65b554c-ed40-4f85-bc80-cea68cee3c57 tempest-VolumesActionsTest-1607702842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:00:12 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-e65b554c-ed40-4f85-bc80-cea68cee3c57 tempest-VolumesActionsTest-1607702842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:00:12 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-e65b554c-ed40-4f85-bc80-cea68cee3c57 tempest-VolumesActionsTest-1607702842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:00:12 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-e65b554c-ed40-4f85-bc80-cea68cee3c57 tempest-VolumesActionsTest-1607702842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:00:12 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-e65b554c-ed40-4f85-bc80-cea68cee3c57 tempest-VolumesActionsTest-1607702842 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:00:12 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-e65b554c-ed40-4f85-bc80-cea68cee3c57 tempest-VolumesActionsTest-1607702842 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:00:12 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e65b554c-ed40-4f85-bc80-cea68cee3c57 tempest-VolumesActionsTest-1607702842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c626fcbb-3669-49b3-a21a-70d9a31a9a63 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:00:12 devstack sudo[96489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c626fcbb-3669-49b3-a21a-70d9a31a9a63 1073741824 Aug 10 16:00:12 devstack sudo[96489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:00:13 devstack sudo[96489]: pam_unix(sudo:session): session closed for user root Aug 10 16:00:13 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e65b554c-ed40-4f85-bc80-cea68cee3c57 tempest-VolumesActionsTest-1607702842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c626fcbb-3669-49b3-a21a-70d9a31a9a63 1073741824" returned: 0 in 0.753s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:00:13 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e65b554c-ed40-4f85-bc80-cea68cee3c57 tempest-VolumesActionsTest-1607702842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c626fcbb-3669-49b3-a21a-70d9a31a9a63 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:00:13 devstack sudo[96497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c626fcbb-3669-49b3-a21a-70d9a31a9a63 Aug 10 16:00:13 devstack sudo[96497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:00:14 devstack sudo[96497]: pam_unix(sudo:session): session closed for user root Aug 10 16:00:14 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e65b554c-ed40-4f85-bc80-cea68cee3c57 tempest-VolumesActionsTest-1607702842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c626fcbb-3669-49b3-a21a-70d9a31a9a63" returned: 0 in 0.367s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:00:14 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-e65b554c-ed40-4f85-bc80-cea68cee3c57 tempest-VolumesActionsTest-1607702842 None] <== create_volume: return (1232ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:00:14 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-e65b554c-ed40-4f85-bc80-cea68cee3c57 tempest-VolumesActionsTest-1607702842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.236s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:00:14 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-e65b554c-ed40-4f85-bc80-cea68cee3c57 tempest-VolumesActionsTest-1607702842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b29b135-9f8e-4a56-92da-ee3ea097c0d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c626fcbb-3669-49b3-a21a-70d9a31a9a63', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:00:14 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-e65b554c-ed40-4f85-bc80-cea68cee3c57 tempest-VolumesActionsTest-1607702842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (620fd4a1-ffec-438d-9918-aa5911b27449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:00:14 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-e65b554c-ed40-4f85-bc80-cea68cee3c57 tempest-VolumesActionsTest-1607702842 None] Volume volume-c626fcbb-3669-49b3-a21a-70d9a31a9a63 (c626fcbb-3669-49b3-a21a-70d9a31a9a63): created successfully Aug 10 16:00:14 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-e65b554c-ed40-4f85-bc80-cea68cee3c57 tempest-VolumesActionsTest-1607702842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (620fd4a1-ffec-438d-9918-aa5911b27449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:00:14 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-e65b554c-ed40-4f85-bc80-cea68cee3c57 tempest-VolumesActionsTest-1607702842 None] Flow 'volume_create_manager' (6881a689-889b-4a39-b72a-3c8ba61735d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:00:14 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-e65b554c-ed40-4f85-bc80-cea68cee3c57 tempest-VolumesActionsTest-1607702842 None] Created volume successfully. Aug 10 16:00:15 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-ee08e51d-a7f0-4950-a2b2-6f3fe8d8d3ad tempest-VolumesActionsTest-456021455 None] Acquiring lock "cinder-c626fcbb-3669-49b3-a21a-70d9a31a9a63-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:00:15 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-f24c84a0-872d-4e6e-9a8a-b097dc871906 req-546e080d-a72a-4a15-bd54-ea31339b59f1 tempest-ServerActionsTestOtherA-603942358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:00:15 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-f24c84a0-872d-4e6e-9a8a-b097dc871906 req-546e080d-a72a-4a15-bd54-ea31339b59f1 tempest-ServerActionsTestOtherA-603942358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:00:15 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-f24c84a0-872d-4e6e-9a8a-b097dc871906 req-546e080d-a72a-4a15-bd54-ea31339b59f1 tempest-ServerActionsTestOtherA-603942358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:00:15 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-ee08e51d-a7f0-4950-a2b2-6f3fe8d8d3ad tempest-VolumesActionsTest-456021455 None] Lock "cinder-c626fcbb-3669-49b3-a21a-70d9a31a9a63-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:00:15 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-ee08e51d-a7f0-4950-a2b2-6f3fe8d8d3ad tempest-VolumesActionsTest-456021455 None] Acquiring lock "cinder-quobyte-c626fcbb-3669-49b3-a21a-70d9a31a9a63" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:00:15 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [req-f24c84a0-872d-4e6e-9a8a-b097dc871906 req-546e080d-a72a-4a15-bd54-ea31339b59f1 tempest-ServerActionsTestOtherA-603942358 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc', 'name': 'volume-50d4e265-39fd-46c6-9b38-06971e2c547f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7d1efa14-425d-42a9-bc46-4fdd015443b2', 'enforce_multipath': True} {{(pid=88641) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 10 16:00:15 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-ee08e51d-a7f0-4950-a2b2-6f3fe8d8d3ad tempest-VolumesActionsTest-456021455 None] Lock "cinder-quobyte-c626fcbb-3669-49b3-a21a-70d9a31a9a63" acquired by "delete_volume" :: waited 0.059s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:00:15 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[74695bcf-0c9b-4dee-9344-57256781e0cb]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:00:15 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ee08e51d-a7f0-4950-a2b2-6f3fe8d8d3ad tempest-VolumesActionsTest-456021455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c626fcbb-3669-49b3-a21a-70d9a31a9a63 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:00:15 devstack cinder-volume[88641]: INFO cinder.volume.manager [req-f24c84a0-872d-4e6e-9a8a-b097dc871906 req-546e080d-a72a-4a15-bd54-ea31339b59f1 tempest-ServerActionsTestOtherA-603942358 None] attachment_update completed successfully. Aug 10 16:00:15 devstack sudo[96509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c626fcbb-3669-49b3-a21a-70d9a31a9a63 Aug 10 16:00:15 devstack sudo[96509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:00:16 devstack sudo[96509]: pam_unix(sudo:session): session closed for user root Aug 10 16:00:16 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ee08e51d-a7f0-4950-a2b2-6f3fe8d8d3ad tempest-VolumesActionsTest-456021455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c626fcbb-3669-49b3-a21a-70d9a31a9a63" returned: 0 in 0.964s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:00:16 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ee08e51d-a7f0-4950-a2b2-6f3fe8d8d3ad tempest-VolumesActionsTest-456021455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c626fcbb-3669-49b3-a21a-70d9a31a9a63 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:00:16 devstack sudo[96514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c626fcbb-3669-49b3-a21a-70d9a31a9a63 Aug 10 16:00:16 devstack sudo[96514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:00:16 devstack sudo[96514]: pam_unix(sudo:session): session closed for user root Aug 10 16:00:16 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ee08e51d-a7f0-4950-a2b2-6f3fe8d8d3ad tempest-VolumesActionsTest-456021455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c626fcbb-3669-49b3-a21a-70d9a31a9a63" returned: 0 in 0.675s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:00:16 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-ee08e51d-a7f0-4950-a2b2-6f3fe8d8d3ad tempest-VolumesActionsTest-456021455 None] Lock "cinder-quobyte-c626fcbb-3669-49b3-a21a-70d9a31a9a63" released by "delete_volume" :: held 1.767s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:00:17 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-ee08e51d-a7f0-4950-a2b2-6f3fe8d8d3ad tempest-VolumesActionsTest-456021455 None] Created reservations ['a7c74f7a-4585-46c3-815e-51c17d457b64', '0d845388-ef13-4c74-95ff-e985eb2ba3d9', 'ec92c70d-10f7-427c-b4bd-3e2d396088f4', '64303cf7-6bda-4064-ae82-ce7e8cc6cedd'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:00:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-ee08e51d-a7f0-4950-a2b2-6f3fe8d8d3ad tempest-VolumesActionsTest-456021455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:00:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-ee08e51d-a7f0-4950-a2b2-6f3fe8d8d3ad tempest-VolumesActionsTest-456021455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:00:17 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-ee08e51d-a7f0-4950-a2b2-6f3fe8d8d3ad tempest-VolumesActionsTest-456021455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:00:17 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-ee08e51d-a7f0-4950-a2b2-6f3fe8d8d3ad tempest-VolumesActionsTest-456021455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:00:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-ee08e51d-a7f0-4950-a2b2-6f3fe8d8d3ad tempest-VolumesActionsTest-456021455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:00:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ee08e51d-a7f0-4950-a2b2-6f3fe8d8d3ad tempest-VolumesActionsTest-456021455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:00:17 devstack sudo[96518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:00:17 devstack sudo[96518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:00:17 devstack sudo[96518]: pam_unix(sudo:session): session closed for user root Aug 10 16:00:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ee08e51d-a7f0-4950-a2b2-6f3fe8d8d3ad tempest-VolumesActionsTest-456021455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.482s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:00:17 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-ee08e51d-a7f0-4950-a2b2-6f3fe8d8d3ad tempest-VolumesActionsTest-456021455 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:00:17 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-ee08e51d-a7f0-4950-a2b2-6f3fe8d8d3ad tempest-VolumesActionsTest-456021455 None] Deleted volume successfully. Aug 10 16:00:17 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-ee08e51d-a7f0-4950-a2b2-6f3fe8d8d3ad tempest-VolumesActionsTest-456021455 None] Lock "cinder-c626fcbb-3669-49b3-a21a-70d9a31a9a63-delete_volume" released by "delete_volume" :: held 2.674s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:00:18 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-37059468-50cb-4bc7-84b1-bee9ad8ac394 tempest-VolumesActionsTest-1607702842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:00:18 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-37059468-50cb-4bc7-84b1-bee9ad8ac394 tempest-VolumesActionsTest-1607702842 None] Flow 'volume_create_manager' (b95d0657-b16b-4bd0-8bee-399c15ab3c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:00:18 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-37059468-50cb-4bc7-84b1-bee9ad8ac394 tempest-VolumesActionsTest-1607702842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fc1f9ab-f171-4b43-9956-363c46b61a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:00:18 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-37059468-50cb-4bc7-84b1-bee9ad8ac394 tempest-VolumesActionsTest-1607702842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fc1f9ab-f171-4b43-9956-363c46b61a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:00:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1897284517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c295c0fa-fd77-4693-a1d5-705fc6db6a5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9b0f3e24b1745dfa296d6952a3510ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:00:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:00:18Z,use_quota=True,user_id='b1ab3f855d0845f2bf2219223053d679',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:00:18 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-37059468-50cb-4bc7-84b1-bee9ad8ac394 tempest-VolumesActionsTest-1607702842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b6eff44-4727-4ce1-9575-e38719158e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:00:18 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-37059468-50cb-4bc7-84b1-bee9ad8ac394 tempest-VolumesActionsTest-1607702842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b6eff44-4727-4ce1-9575-e38719158e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:00:18 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-37059468-50cb-4bc7-84b1-bee9ad8ac394 tempest-VolumesActionsTest-1607702842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a8256b9-3dc5-44d6-b2ef-5ae70addc21b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:00:18 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-37059468-50cb-4bc7-84b1-bee9ad8ac394 tempest-VolumesActionsTest-1607702842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a8256b9-3dc5-44d6-b2ef-5ae70addc21b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c295c0fa-fd77-4693-a1d5-705fc6db6a5f', 'volume_name': 'volume-c295c0fa-fd77-4693-a1d5-705fc6db6a5f', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:00:18 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-37059468-50cb-4bc7-84b1-bee9ad8ac394 tempest-VolumesActionsTest-1607702842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b83406cf-ff3e-4efa-bc4e-bd6e60932aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:00:18 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-37059468-50cb-4bc7-84b1-bee9ad8ac394 tempest-VolumesActionsTest-1607702842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b83406cf-ff3e-4efa-bc4e-bd6e60932aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:00:18 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-37059468-50cb-4bc7-84b1-bee9ad8ac394 tempest-VolumesActionsTest-1607702842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ea234a7-f5c5-4bb7-b8c8-518d3d0e1c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:00:18 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-37059468-50cb-4bc7-84b1-bee9ad8ac394 tempest-VolumesActionsTest-1607702842 None] Volume c295c0fa-fd77-4693-a1d5-705fc6db6a5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c295c0fa-fd77-4693-a1d5-705fc6db6a5f', 'volume_size': 1} Aug 10 16:00:18 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-37059468-50cb-4bc7-84b1-bee9ad8ac394 tempest-VolumesActionsTest-1607702842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:00:18 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-37059468-50cb-4bc7-84b1-bee9ad8ac394 tempest-VolumesActionsTest-1607702842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:00:18 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-37059468-50cb-4bc7-84b1-bee9ad8ac394 tempest-VolumesActionsTest-1607702842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:00:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1897284517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c295c0fa-fd77-4693-a1d5-705fc6db6a5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9b0f3e24b1745dfa296d6952a3510ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:00:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:00:18Z,use_quota=True,user_id='b1ab3f855d0845f2bf2219223053d679',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:00:18 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-37059468-50cb-4bc7-84b1-bee9ad8ac394 tempest-VolumesActionsTest-1607702842 None] Creating volume c295c0fa-fd77-4693-a1d5-705fc6db6a5f {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:00:18 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-37059468-50cb-4bc7-84b1-bee9ad8ac394 tempest-VolumesActionsTest-1607702842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:00:18 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-37059468-50cb-4bc7-84b1-bee9ad8ac394 tempest-VolumesActionsTest-1607702842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:00:18 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-37059468-50cb-4bc7-84b1-bee9ad8ac394 tempest-VolumesActionsTest-1607702842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:00:18 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-37059468-50cb-4bc7-84b1-bee9ad8ac394 tempest-VolumesActionsTest-1607702842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:00:18 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-37059468-50cb-4bc7-84b1-bee9ad8ac394 tempest-VolumesActionsTest-1607702842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:00:18 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-37059468-50cb-4bc7-84b1-bee9ad8ac394 tempest-VolumesActionsTest-1607702842 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:00:18 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-37059468-50cb-4bc7-84b1-bee9ad8ac394 tempest-VolumesActionsTest-1607702842 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:00:18 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-37059468-50cb-4bc7-84b1-bee9ad8ac394 tempest-VolumesActionsTest-1607702842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c295c0fa-fd77-4693-a1d5-705fc6db6a5f 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:00:18 devstack sudo[96522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c295c0fa-fd77-4693-a1d5-705fc6db6a5f 1073741824 Aug 10 16:00:18 devstack sudo[96522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:00:18 devstack sudo[96522]: pam_unix(sudo:session): session closed for user root Aug 10 16:00:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-37059468-50cb-4bc7-84b1-bee9ad8ac394 tempest-VolumesActionsTest-1607702842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c295c0fa-fd77-4693-a1d5-705fc6db6a5f 1073741824" returned: 0 in 0.553s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:00:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-37059468-50cb-4bc7-84b1-bee9ad8ac394 tempest-VolumesActionsTest-1607702842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c295c0fa-fd77-4693-a1d5-705fc6db6a5f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:00:19 devstack sudo[96593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c295c0fa-fd77-4693-a1d5-705fc6db6a5f Aug 10 16:00:19 devstack sudo[96593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:00:19 devstack sudo[96593]: pam_unix(sudo:session): session closed for user root Aug 10 16:00:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-37059468-50cb-4bc7-84b1-bee9ad8ac394 tempest-VolumesActionsTest-1607702842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c295c0fa-fd77-4693-a1d5-705fc6db6a5f" returned: 0 in 0.346s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:00:19 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-37059468-50cb-4bc7-84b1-bee9ad8ac394 tempest-VolumesActionsTest-1607702842 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:00:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-37059468-50cb-4bc7-84b1-bee9ad8ac394 tempest-VolumesActionsTest-1607702842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:00:19 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-37059468-50cb-4bc7-84b1-bee9ad8ac394 tempest-VolumesActionsTest-1607702842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ea234a7-f5c5-4bb7-b8c8-518d3d0e1c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c295c0fa-fd77-4693-a1d5-705fc6db6a5f', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:00:19 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-37059468-50cb-4bc7-84b1-bee9ad8ac394 tempest-VolumesActionsTest-1607702842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b384054-2599-4915-bed3-be1c9edc04bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:00:19 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-37059468-50cb-4bc7-84b1-bee9ad8ac394 tempest-VolumesActionsTest-1607702842 None] Volume volume-c295c0fa-fd77-4693-a1d5-705fc6db6a5f (c295c0fa-fd77-4693-a1d5-705fc6db6a5f): created successfully Aug 10 16:00:19 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-37059468-50cb-4bc7-84b1-bee9ad8ac394 tempest-VolumesActionsTest-1607702842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b384054-2599-4915-bed3-be1c9edc04bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:00:19 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-37059468-50cb-4bc7-84b1-bee9ad8ac394 tempest-VolumesActionsTest-1607702842 None] Flow 'volume_create_manager' (b95d0657-b16b-4bd0-8bee-399c15ab3c80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:00:19 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-37059468-50cb-4bc7-84b1-bee9ad8ac394 tempest-VolumesActionsTest-1607702842 None] Created volume successfully. Aug 10 16:00:21 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-1f607715-9d9f-4ce3-8d82-187e3004ba20 tempest-VolumesActionsTest-1607702842 None] Acquiring lock "cinder-c295c0fa-fd77-4693-a1d5-705fc6db6a5f-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:00:21 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-1f607715-9d9f-4ce3-8d82-187e3004ba20 tempest-VolumesActionsTest-1607702842 None] Lock "cinder-c295c0fa-fd77-4693-a1d5-705fc6db6a5f-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:00:21 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-1f607715-9d9f-4ce3-8d82-187e3004ba20 tempest-VolumesActionsTest-1607702842 None] Acquiring lock "cinder-quobyte-c295c0fa-fd77-4693-a1d5-705fc6db6a5f" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:00:21 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-1f607715-9d9f-4ce3-8d82-187e3004ba20 tempest-VolumesActionsTest-1607702842 None] Lock "cinder-quobyte-c295c0fa-fd77-4693-a1d5-705fc6db6a5f" acquired by "delete_volume" :: waited 0.028s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:00:21 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[df51b7db-9d64-4802-9b87-57bff042fc75]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:00:21 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-1f607715-9d9f-4ce3-8d82-187e3004ba20 tempest-VolumesActionsTest-1607702842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c295c0fa-fd77-4693-a1d5-705fc6db6a5f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:00:21 devstack sudo[96961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c295c0fa-fd77-4693-a1d5-705fc6db6a5f Aug 10 16:00:21 devstack sudo[96961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:00:22 devstack sudo[96961]: pam_unix(sudo:session): session closed for user root Aug 10 16:00:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-1f607715-9d9f-4ce3-8d82-187e3004ba20 tempest-VolumesActionsTest-1607702842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c295c0fa-fd77-4693-a1d5-705fc6db6a5f" returned: 0 in 0.468s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:00:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-1f607715-9d9f-4ce3-8d82-187e3004ba20 tempest-VolumesActionsTest-1607702842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c295c0fa-fd77-4693-a1d5-705fc6db6a5f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:00:22 devstack sudo[96975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c295c0fa-fd77-4693-a1d5-705fc6db6a5f Aug 10 16:00:22 devstack sudo[96975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:00:22 devstack sudo[96975]: pam_unix(sudo:session): session closed for user root Aug 10 16:00:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-1f607715-9d9f-4ce3-8d82-187e3004ba20 tempest-VolumesActionsTest-1607702842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c295c0fa-fd77-4693-a1d5-705fc6db6a5f" returned: 0 in 0.385s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:00:22 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-1f607715-9d9f-4ce3-8d82-187e3004ba20 tempest-VolumesActionsTest-1607702842 None] Lock "cinder-quobyte-c295c0fa-fd77-4693-a1d5-705fc6db6a5f" released by "delete_volume" :: held 0.911s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:00:22 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-1f607715-9d9f-4ce3-8d82-187e3004ba20 tempest-VolumesActionsTest-1607702842 None] Created reservations ['20ef720a-e812-495b-b213-cf7a1914cea1', '22b73770-3ceb-4d01-9de1-64921b3edbef', 'dbb0f594-a91d-4f55-aad1-84ca5d749397', '82396515-a3de-4db9-9816-ee55852be13b'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:00:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-1f607715-9d9f-4ce3-8d82-187e3004ba20 tempest-VolumesActionsTest-1607702842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:00:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-1f607715-9d9f-4ce3-8d82-187e3004ba20 tempest-VolumesActionsTest-1607702842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:00:22 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-1f607715-9d9f-4ce3-8d82-187e3004ba20 tempest-VolumesActionsTest-1607702842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:00:22 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-1f607715-9d9f-4ce3-8d82-187e3004ba20 tempest-VolumesActionsTest-1607702842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:00:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-1f607715-9d9f-4ce3-8d82-187e3004ba20 tempest-VolumesActionsTest-1607702842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:00:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-1f607715-9d9f-4ce3-8d82-187e3004ba20 tempest-VolumesActionsTest-1607702842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:00:22 devstack sudo[96995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:00:22 devstack sudo[96995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:00:23 devstack sudo[96995]: pam_unix(sudo:session): session closed for user root Aug 10 16:00:23 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-1f607715-9d9f-4ce3-8d82-187e3004ba20 tempest-VolumesActionsTest-1607702842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.435s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:00:23 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-1f607715-9d9f-4ce3-8d82-187e3004ba20 tempest-VolumesActionsTest-1607702842 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:00:23 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-1f607715-9d9f-4ce3-8d82-187e3004ba20 tempest-VolumesActionsTest-1607702842 None] Deleted volume successfully. Aug 10 16:00:23 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-1f607715-9d9f-4ce3-8d82-187e3004ba20 tempest-VolumesActionsTest-1607702842 None] Lock "cinder-c295c0fa-fd77-4693-a1d5-705fc6db6a5f-delete_volume" released by "delete_volume" :: held 1.793s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:00:24 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-4a90a653-d05c-4bb8-a7ab-f6eb55f67607 tempest-VolumesNegativeTest-2005735804 None] Acquiring lock "cinder-4020d04f-ad08-4ad5-b5e0-5d36c47b64ba-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:00:24 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-4a90a653-d05c-4bb8-a7ab-f6eb55f67607 tempest-VolumesNegativeTest-2005735804 None] Lock "cinder-4020d04f-ad08-4ad5-b5e0-5d36c47b64ba-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:00:24 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-4a90a653-d05c-4bb8-a7ab-f6eb55f67607 tempest-VolumesNegativeTest-2005735804 None] Acquiring lock "cinder-quobyte-4020d04f-ad08-4ad5-b5e0-5d36c47b64ba" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:00:24 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-4a90a653-d05c-4bb8-a7ab-f6eb55f67607 tempest-VolumesNegativeTest-2005735804 None] Lock "cinder-quobyte-4020d04f-ad08-4ad5-b5e0-5d36c47b64ba" acquired by "delete_volume" :: waited 0.026s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:00:24 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[c170f46d-d969-40ba-a59c-847cb5dbf9c8]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:00:24 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4a90a653-d05c-4bb8-a7ab-f6eb55f67607 tempest-VolumesNegativeTest-2005735804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4020d04f-ad08-4ad5-b5e0-5d36c47b64ba {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:00:24 devstack sudo[97007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4020d04f-ad08-4ad5-b5e0-5d36c47b64ba Aug 10 16:00:24 devstack sudo[97007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:00:24 devstack sudo[97007]: pam_unix(sudo:session): session closed for user root Aug 10 16:00:24 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4a90a653-d05c-4bb8-a7ab-f6eb55f67607 tempest-VolumesNegativeTest-2005735804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4020d04f-ad08-4ad5-b5e0-5d36c47b64ba" returned: 0 in 0.550s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:00:24 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4a90a653-d05c-4bb8-a7ab-f6eb55f67607 tempest-VolumesNegativeTest-2005735804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4020d04f-ad08-4ad5-b5e0-5d36c47b64ba {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:00:24 devstack sudo[97012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4020d04f-ad08-4ad5-b5e0-5d36c47b64ba Aug 10 16:00:24 devstack sudo[97012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:00:25 devstack sudo[97012]: pam_unix(sudo:session): session closed for user root Aug 10 16:00:25 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4a90a653-d05c-4bb8-a7ab-f6eb55f67607 tempest-VolumesNegativeTest-2005735804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4020d04f-ad08-4ad5-b5e0-5d36c47b64ba" returned: 0 in 0.404s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:00:25 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-4a90a653-d05c-4bb8-a7ab-f6eb55f67607 tempest-VolumesNegativeTest-2005735804 None] Lock "cinder-quobyte-4020d04f-ad08-4ad5-b5e0-5d36c47b64ba" released by "delete_volume" :: held 1.042s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:00:25 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-4a90a653-d05c-4bb8-a7ab-f6eb55f67607 tempest-VolumesNegativeTest-2005735804 None] Created reservations ['e8c2abb2-a3a3-4692-bf72-d7fc01c2727c', 'd5756e99-9367-493c-af00-932d43a785c3', 'f72f4539-4129-4448-8ec3-e98954fda774', '962c6fc8-ee7b-476e-9ad8-57d72ca471f6'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:00:25 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-4a90a653-d05c-4bb8-a7ab-f6eb55f67607 tempest-VolumesNegativeTest-2005735804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:00:25 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-4a90a653-d05c-4bb8-a7ab-f6eb55f67607 tempest-VolumesNegativeTest-2005735804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:00:25 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-4a90a653-d05c-4bb8-a7ab-f6eb55f67607 tempest-VolumesNegativeTest-2005735804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:00:25 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-4a90a653-d05c-4bb8-a7ab-f6eb55f67607 tempest-VolumesNegativeTest-2005735804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:00:25 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-4a90a653-d05c-4bb8-a7ab-f6eb55f67607 tempest-VolumesNegativeTest-2005735804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:00:25 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4a90a653-d05c-4bb8-a7ab-f6eb55f67607 tempest-VolumesNegativeTest-2005735804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:00:25 devstack sudo[97015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:00:25 devstack sudo[97015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:00:25 devstack sudo[97015]: pam_unix(sudo:session): session closed for user root Aug 10 16:00:25 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4a90a653-d05c-4bb8-a7ab-f6eb55f67607 tempest-VolumesNegativeTest-2005735804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.298s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:00:25 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-4a90a653-d05c-4bb8-a7ab-f6eb55f67607 tempest-VolumesNegativeTest-2005735804 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:00:25 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-4a90a653-d05c-4bb8-a7ab-f6eb55f67607 tempest-VolumesNegativeTest-2005735804 None] Deleted volume successfully. Aug 10 16:00:25 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-4a90a653-d05c-4bb8-a7ab-f6eb55f67607 tempest-VolumesNegativeTest-2005735804 None] Lock "cinder-4020d04f-ad08-4ad5-b5e0-5d36c47b64ba-delete_volume" released by "delete_volume" :: held 1.707s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:00:31 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b3f304c-f4dd-48e4-8dc2-83562fa6a5c0 tempest-VolumesSnapshotListTestJSON-1522118082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:00:31 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-3b3f304c-f4dd-48e4-8dc2-83562fa6a5c0 tempest-VolumesSnapshotListTestJSON-1522118082 None] Flow 'volume_create_manager' (3fd12f41-1f39-4d46-8275-9d6e5cb3cb65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:00:31 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-3b3f304c-f4dd-48e4-8dc2-83562fa6a5c0 tempest-VolumesSnapshotListTestJSON-1522118082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4976167-b9c8-4436-a80f-2f2f2f18ce10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:00:31 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-3b3f304c-f4dd-48e4-8dc2-83562fa6a5c0 tempest-VolumesSnapshotListTestJSON-1522118082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4976167-b9c8-4436-a80f-2f2f2f18ce10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:00:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2065736484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9f99146-94cf-4727-9b71-9e6db47d92fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff744ffa6efe45cb97439facb15bf390',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:00:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:00:32Z,use_quota=True,user_id='99df7eaa3c89443886fb99cdbf83f3ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:00:31 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-3b3f304c-f4dd-48e4-8dc2-83562fa6a5c0 tempest-VolumesSnapshotListTestJSON-1522118082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d882ccf-4ae7-496f-9184-65c9a2628ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:00:31 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-3b3f304c-f4dd-48e4-8dc2-83562fa6a5c0 tempest-VolumesSnapshotListTestJSON-1522118082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d882ccf-4ae7-496f-9184-65c9a2628ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:00:31 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-3b3f304c-f4dd-48e4-8dc2-83562fa6a5c0 tempest-VolumesSnapshotListTestJSON-1522118082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91e0b339-387f-4400-a6f9-452a8a697da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:00:31 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-3b3f304c-f4dd-48e4-8dc2-83562fa6a5c0 tempest-VolumesSnapshotListTestJSON-1522118082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91e0b339-387f-4400-a6f9-452a8a697da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9f99146-94cf-4727-9b71-9e6db47d92fb', 'volume_name': 'volume-d9f99146-94cf-4727-9b71-9e6db47d92fb', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:00:31 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-3b3f304c-f4dd-48e4-8dc2-83562fa6a5c0 tempest-VolumesSnapshotListTestJSON-1522118082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40ecb2f6-7fb2-4f47-b78e-c7649b2ae62f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:00:31 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-3b3f304c-f4dd-48e4-8dc2-83562fa6a5c0 tempest-VolumesSnapshotListTestJSON-1522118082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40ecb2f6-7fb2-4f47-b78e-c7649b2ae62f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:00:31 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-3b3f304c-f4dd-48e4-8dc2-83562fa6a5c0 tempest-VolumesSnapshotListTestJSON-1522118082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (926781e7-2a01-44d2-91ee-45a526ffbe0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:00:31 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-3b3f304c-f4dd-48e4-8dc2-83562fa6a5c0 tempest-VolumesSnapshotListTestJSON-1522118082 None] Volume d9f99146-94cf-4727-9b71-9e6db47d92fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9f99146-94cf-4727-9b71-9e6db47d92fb', 'volume_size': 1} Aug 10 16:00:31 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-3b3f304c-f4dd-48e4-8dc2-83562fa6a5c0 tempest-VolumesSnapshotListTestJSON-1522118082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:00:31 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-3b3f304c-f4dd-48e4-8dc2-83562fa6a5c0 tempest-VolumesSnapshotListTestJSON-1522118082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:00:31 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-3b3f304c-f4dd-48e4-8dc2-83562fa6a5c0 tempest-VolumesSnapshotListTestJSON-1522118082 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:00:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2065736484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9f99146-94cf-4727-9b71-9e6db47d92fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff744ffa6efe45cb97439facb15bf390',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:00:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:00:32Z,use_quota=True,user_id='99df7eaa3c89443886fb99cdbf83f3ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:00:31 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-3b3f304c-f4dd-48e4-8dc2-83562fa6a5c0 tempest-VolumesSnapshotListTestJSON-1522118082 None] Creating volume d9f99146-94cf-4727-9b71-9e6db47d92fb {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:00:31 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-3b3f304c-f4dd-48e4-8dc2-83562fa6a5c0 tempest-VolumesSnapshotListTestJSON-1522118082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:00:31 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-3b3f304c-f4dd-48e4-8dc2-83562fa6a5c0 tempest-VolumesSnapshotListTestJSON-1522118082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:00:31 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-3b3f304c-f4dd-48e4-8dc2-83562fa6a5c0 tempest-VolumesSnapshotListTestJSON-1522118082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:00:31 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-3b3f304c-f4dd-48e4-8dc2-83562fa6a5c0 tempest-VolumesSnapshotListTestJSON-1522118082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:00:31 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-3b3f304c-f4dd-48e4-8dc2-83562fa6a5c0 tempest-VolumesSnapshotListTestJSON-1522118082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:00:31 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-3b3f304c-f4dd-48e4-8dc2-83562fa6a5c0 tempest-VolumesSnapshotListTestJSON-1522118082 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:00:31 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-3b3f304c-f4dd-48e4-8dc2-83562fa6a5c0 tempest-VolumesSnapshotListTestJSON-1522118082 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:00:31 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-3b3f304c-f4dd-48e4-8dc2-83562fa6a5c0 tempest-VolumesSnapshotListTestJSON-1522118082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:00:31 devstack sudo[97045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb 1073741824 Aug 10 16:00:31 devstack sudo[97045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:00:32 devstack sudo[97045]: pam_unix(sudo:session): session closed for user root Aug 10 16:00:32 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-3b3f304c-f4dd-48e4-8dc2-83562fa6a5c0 tempest-VolumesSnapshotListTestJSON-1522118082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb 1073741824" returned: 0 in 0.958s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:00:32 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-3b3f304c-f4dd-48e4-8dc2-83562fa6a5c0 tempest-VolumesSnapshotListTestJSON-1522118082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:00:32 devstack sudo[97051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb Aug 10 16:00:32 devstack sudo[97051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:00:33 devstack sudo[97051]: pam_unix(sudo:session): session closed for user root Aug 10 16:00:33 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-3b3f304c-f4dd-48e4-8dc2-83562fa6a5c0 tempest-VolumesSnapshotListTestJSON-1522118082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb" returned: 0 in 0.569s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:00:33 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-3b3f304c-f4dd-48e4-8dc2-83562fa6a5c0 tempest-VolumesSnapshotListTestJSON-1522118082 None] <== create_volume: return (1602ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:00:33 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-3b3f304c-f4dd-48e4-8dc2-83562fa6a5c0 tempest-VolumesSnapshotListTestJSON-1522118082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.606s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:00:33 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-3b3f304c-f4dd-48e4-8dc2-83562fa6a5c0 tempest-VolumesSnapshotListTestJSON-1522118082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (926781e7-2a01-44d2-91ee-45a526ffbe0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9f99146-94cf-4727-9b71-9e6db47d92fb', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:00:33 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-3b3f304c-f4dd-48e4-8dc2-83562fa6a5c0 tempest-VolumesSnapshotListTestJSON-1522118082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54f84525-8a0b-4817-bc81-84ae995bdcb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:00:33 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-3b3f304c-f4dd-48e4-8dc2-83562fa6a5c0 tempest-VolumesSnapshotListTestJSON-1522118082 None] Volume volume-d9f99146-94cf-4727-9b71-9e6db47d92fb (d9f99146-94cf-4727-9b71-9e6db47d92fb): created successfully Aug 10 16:00:33 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-3b3f304c-f4dd-48e4-8dc2-83562fa6a5c0 tempest-VolumesSnapshotListTestJSON-1522118082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54f84525-8a0b-4817-bc81-84ae995bdcb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:00:33 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-3b3f304c-f4dd-48e4-8dc2-83562fa6a5c0 tempest-VolumesSnapshotListTestJSON-1522118082 None] Flow 'volume_create_manager' (3fd12f41-1f39-4d46-8275-9d6e5cb3cb65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:00:33 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-3b3f304c-f4dd-48e4-8dc2-83562fa6a5c0 tempest-VolumesSnapshotListTestJSON-1522118082 None] Created volume successfully. Aug 10 16:00:35 devstack cinder-volume[88641]: INFO cinder.volume.manager [req-a6913c36-9f67-48b4-810a-5c74af6bc1a3 req-16edd246-ce49-45fa-9e31-713958745a39 tempest-ServerActionsTestOtherA-603942358 None] Terminate volume connection completed successfully. Aug 10 16:00:35 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [req-a6913c36-9f67-48b4-810a-5c74af6bc1a3 req-16edd246-ce49-45fa-9e31-713958745a39 tempest-ServerActionsTestOtherA-603942358 None] Deleting attachment 7d1efa14-425d-42a9-bc46-4fdd015443b2. {{(pid=88641) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 10 16:00:35 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-4f5539df-8bee-4de7-8674-d1ea8439c97a tempest-VolumesSnapshotListTestJSON-1522118082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:00:35 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-4f5539df-8bee-4de7-8674-d1ea8439c97a tempest-VolumesSnapshotListTestJSON-1522118082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:00:35 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-4f5539df-8bee-4de7-8674-d1ea8439c97a tempest-VolumesSnapshotListTestJSON-1522118082 None] Creating offline snapshot 5c4aa558-a3ae-43aa-89ca-ae996b683a3a of volume d9f99146-94cf-4727-9b71-9e6db47d92fb {{(pid=88641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 16:00:35 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c8ac71-fff9-4a93-9bf6-e96241b23998]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:00:35 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4f5539df-8bee-4de7-8674-d1ea8439c97a tempest-VolumesSnapshotListTestJSON-1522118082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:00:35 devstack sudo[97107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb Aug 10 16:00:35 devstack sudo[97107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:00:35 devstack sudo[97107]: pam_unix(sudo:session): session closed for user root Aug 10 16:00:35 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4f5539df-8bee-4de7-8674-d1ea8439c97a tempest-VolumesSnapshotListTestJSON-1522118082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb" returned: 0 in 0.527s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:00:35 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4f5539df-8bee-4de7-8674-d1ea8439c97a tempest-VolumesSnapshotListTestJSON-1522118082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.5c4aa558-a3ae-43aa-89ca-ae996b683a3a 1G {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:00:35 devstack sudo[97112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.5c4aa558-a3ae-43aa-89ca-ae996b683a3a 1G Aug 10 16:00:35 devstack sudo[97112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:00:36 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-98e64a3d-7e01-4ec2-897f-00fdb0343585 tempest-AttachVolumeNegativeTest-115562770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:00:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-98e64a3d-7e01-4ec2-897f-00fdb0343585 tempest-AttachVolumeNegativeTest-115562770 None] Flow 'volume_create_manager' (9f1a64bc-eda1-4dee-94bb-fd9343b2288b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:00:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-98e64a3d-7e01-4ec2-897f-00fdb0343585 tempest-AttachVolumeNegativeTest-115562770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acd53ced-d28f-4113-9a49-1d75b732211b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:00:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-98e64a3d-7e01-4ec2-897f-00fdb0343585 tempest-AttachVolumeNegativeTest-115562770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acd53ced-d28f-4113-9a49-1d75b732211b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:00:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1654306430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80b3be8b-73d7-4357-8a16-672b4daa4907,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1ea2d0922df4e428db877fa475d5545',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:00:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:00:36Z,use_quota=True,user_id='96c1046256454dda9eac6d8c860ab370',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:00:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-98e64a3d-7e01-4ec2-897f-00fdb0343585 tempest-AttachVolumeNegativeTest-115562770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (059a3770-9631-4917-8e05-29e1265cb564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:00:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-98e64a3d-7e01-4ec2-897f-00fdb0343585 tempest-AttachVolumeNegativeTest-115562770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (059a3770-9631-4917-8e05-29e1265cb564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:00:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-98e64a3d-7e01-4ec2-897f-00fdb0343585 tempest-AttachVolumeNegativeTest-115562770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6b1ebdb-9609-420a-9466-fc730053d76d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:00:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-98e64a3d-7e01-4ec2-897f-00fdb0343585 tempest-AttachVolumeNegativeTest-115562770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6b1ebdb-9609-420a-9466-fc730053d76d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80b3be8b-73d7-4357-8a16-672b4daa4907', 'volume_name': 'volume-80b3be8b-73d7-4357-8a16-672b4daa4907', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:00:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-98e64a3d-7e01-4ec2-897f-00fdb0343585 tempest-AttachVolumeNegativeTest-115562770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1af13a7-096e-451e-8768-adc8044c8a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:00:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-98e64a3d-7e01-4ec2-897f-00fdb0343585 tempest-AttachVolumeNegativeTest-115562770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1af13a7-096e-451e-8768-adc8044c8a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:00:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-98e64a3d-7e01-4ec2-897f-00fdb0343585 tempest-AttachVolumeNegativeTest-115562770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22874e4e-e48c-485d-9025-d109c38dfe58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:00:36 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-98e64a3d-7e01-4ec2-897f-00fdb0343585 tempest-AttachVolumeNegativeTest-115562770 None] Volume 80b3be8b-73d7-4357-8a16-672b4daa4907: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80b3be8b-73d7-4357-8a16-672b4daa4907', 'volume_size': 1} Aug 10 16:00:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-98e64a3d-7e01-4ec2-897f-00fdb0343585 tempest-AttachVolumeNegativeTest-115562770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:00:36 devstack cinder-volume[88641]: DEBUG oslo_service.periodic_task [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88641) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 16:00:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:00:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:00:36 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:00:36 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:00:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:00:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:00:36 devstack sudo[97118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:00:36 devstack sudo[97118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:00:36 devstack sudo[97112]: pam_unix(sudo:session): session closed for user root Aug 10 16:00:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4f5539df-8bee-4de7-8674-d1ea8439c97a tempest-VolumesSnapshotListTestJSON-1522118082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.5c4aa558-a3ae-43aa-89ca-ae996b683a3a 1G" returned: 0 in 0.633s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:00:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4f5539df-8bee-4de7-8674-d1ea8439c97a tempest-VolumesSnapshotListTestJSON-1522118082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9f99146-94cf-4727-9b71-9e6db47d92fb -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.5c4aa558-a3ae-43aa-89ca-ae996b683a3a {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:00:36 devstack sudo[97120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9f99146-94cf-4727-9b71-9e6db47d92fb -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.5c4aa558-a3ae-43aa-89ca-ae996b683a3a Aug 10 16:00:36 devstack sudo[97120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:00:36 devstack sudo[97118]: pam_unix(sudo:session): session closed for user root Aug 10 16:00:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.361s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:00:36 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:00:36 devstack cinder-volume[88641]: DEBUG oslo_service.periodic_task [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Running periodic task VolumeManager._thread_info {{(pid=88641) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 16:00:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] thread count: 28 {{(pid=88641) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 10 16:00:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] thread info: [<_MainThread(MainThread, started 127361545748608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88641) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 10 16:00:36 devstack sudo[97120]: pam_unix(sudo:session): session closed for user root Aug 10 16:00:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4f5539df-8bee-4de7-8674-d1ea8439c97a tempest-VolumesSnapshotListTestJSON-1522118082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9f99146-94cf-4727-9b71-9e6db47d92fb -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.5c4aa558-a3ae-43aa-89ca-ae996b683a3a" returned: 0 in 0.374s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:00:36 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-4f5539df-8bee-4de7-8674-d1ea8439c97a tempest-VolumesSnapshotListTestJSON-1522118082 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.5c4aa558-a3ae-43aa-89ca-ae996b683a3a is being set with open permissions: ugo+rw Aug 10 16:00:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4f5539df-8bee-4de7-8674-d1ea8439c97a tempest-VolumesSnapshotListTestJSON-1522118082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.5c4aa558-a3ae-43aa-89ca-ae996b683a3a {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:00:36 devstack sudo[97127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.5c4aa558-a3ae-43aa-89ca-ae996b683a3a Aug 10 16:00:36 devstack sudo[97127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:00:37 devstack sudo[97127]: pam_unix(sudo:session): session closed for user root Aug 10 16:00:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4f5539df-8bee-4de7-8674-d1ea8439c97a tempest-VolumesSnapshotListTestJSON-1522118082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.5c4aa558-a3ae-43aa-89ca-ae996b683a3a" returned: 0 in 0.279s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:00:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4f5539df-8bee-4de7-8674-d1ea8439c97a tempest-VolumesSnapshotListTestJSON-1522118082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.info {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:00:37 devstack sudo[97138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.info Aug 10 16:00:37 devstack sudo[97138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:00:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-a6913c36-9f67-48b4-810a-5c74af6bc1a3 req-75519558-c4b1-409d-b4ef-9b94754060d6 tempest-ServerActionsTestOtherA-603942358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:00:37 devstack sudo[97138]: pam_unix(sudo:session): session closed for user root Aug 10 16:00:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4f5539df-8bee-4de7-8674-d1ea8439c97a tempest-VolumesSnapshotListTestJSON-1522118082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.info" returned: 0 in 0.365s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:00:37 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-4f5539df-8bee-4de7-8674-d1ea8439c97a tempest-VolumesSnapshotListTestJSON-1522118082 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.info is being set with open permissions: ugo+rw Aug 10 16:00:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4f5539df-8bee-4de7-8674-d1ea8439c97a tempest-VolumesSnapshotListTestJSON-1522118082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.info {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:00:37 devstack sudo[97142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.info Aug 10 16:00:37 devstack sudo[97142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:00:37 devstack sudo[97142]: pam_unix(sudo:session): session closed for user root Aug 10 16:00:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4f5539df-8bee-4de7-8674-d1ea8439c97a tempest-VolumesSnapshotListTestJSON-1522118082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.info" returned: 0 in 0.241s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:00:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-4f5539df-8bee-4de7-8674-d1ea8439c97a tempest-VolumesSnapshotListTestJSON-1522118082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.549s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:00:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-98e64a3d-7e01-4ec2-897f-00fdb0343585 tempest-AttachVolumeNegativeTest-115562770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.763s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:00:37 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-98e64a3d-7e01-4ec2-897f-00fdb0343585 tempest-AttachVolumeNegativeTest-115562770 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:00:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1654306430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80b3be8b-73d7-4357-8a16-672b4daa4907,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1ea2d0922df4e428db877fa475d5545',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:00:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:00:36Z,use_quota=True,user_id='96c1046256454dda9eac6d8c860ab370',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:00:37 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-98e64a3d-7e01-4ec2-897f-00fdb0343585 tempest-AttachVolumeNegativeTest-115562770 None] Creating volume 80b3be8b-73d7-4357-8a16-672b4daa4907 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:00:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-98e64a3d-7e01-4ec2-897f-00fdb0343585 tempest-AttachVolumeNegativeTest-115562770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:00:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-98e64a3d-7e01-4ec2-897f-00fdb0343585 tempest-AttachVolumeNegativeTest-115562770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:00:37 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-98e64a3d-7e01-4ec2-897f-00fdb0343585 tempest-AttachVolumeNegativeTest-115562770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:00:37 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-98e64a3d-7e01-4ec2-897f-00fdb0343585 tempest-AttachVolumeNegativeTest-115562770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:00:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-98e64a3d-7e01-4ec2-897f-00fdb0343585 tempest-AttachVolumeNegativeTest-115562770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:00:37 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-98e64a3d-7e01-4ec2-897f-00fdb0343585 tempest-AttachVolumeNegativeTest-115562770 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:00:37 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-98e64a3d-7e01-4ec2-897f-00fdb0343585 tempest-AttachVolumeNegativeTest-115562770 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:00:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-98e64a3d-7e01-4ec2-897f-00fdb0343585 tempest-AttachVolumeNegativeTest-115562770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-80b3be8b-73d7-4357-8a16-672b4daa4907 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:00:37 devstack sudo[97145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-80b3be8b-73d7-4357-8a16-672b4daa4907 1073741824 Aug 10 16:00:37 devstack sudo[97145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:00:37 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-4f5539df-8bee-4de7-8674-d1ea8439c97a tempest-VolumesSnapshotListTestJSON-1522118082 None] Create snapshot completed successfully Aug 10 16:00:38 devstack sudo[97145]: pam_unix(sudo:session): session closed for user root Aug 10 16:00:38 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-98e64a3d-7e01-4ec2-897f-00fdb0343585 tempest-AttachVolumeNegativeTest-115562770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-80b3be8b-73d7-4357-8a16-672b4daa4907 1073741824" returned: 0 in 0.506s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:00:38 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-98e64a3d-7e01-4ec2-897f-00fdb0343585 tempest-AttachVolumeNegativeTest-115562770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-80b3be8b-73d7-4357-8a16-672b4daa4907 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:00:38 devstack sudo[97151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-80b3be8b-73d7-4357-8a16-672b4daa4907 Aug 10 16:00:38 devstack sudo[97151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:00:38 devstack sudo[97151]: pam_unix(sudo:session): session closed for user root Aug 10 16:00:38 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-98e64a3d-7e01-4ec2-897f-00fdb0343585 tempest-AttachVolumeNegativeTest-115562770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-80b3be8b-73d7-4357-8a16-672b4daa4907" returned: 0 in 0.261s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:00:38 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-98e64a3d-7e01-4ec2-897f-00fdb0343585 tempest-AttachVolumeNegativeTest-115562770 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:00:38 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-98e64a3d-7e01-4ec2-897f-00fdb0343585 tempest-AttachVolumeNegativeTest-115562770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:00:38 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-a6913c36-9f67-48b4-810a-5c74af6bc1a3 req-75519558-c4b1-409d-b4ef-9b94754060d6 tempest-ServerActionsTestOtherA-603942358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.274s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:00:38 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-a6913c36-9f67-48b4-810a-5c74af6bc1a3 req-75519558-c4b1-409d-b4ef-9b94754060d6 tempest-ServerActionsTestOtherA-603942358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:00:38 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-98e64a3d-7e01-4ec2-897f-00fdb0343585 tempest-AttachVolumeNegativeTest-115562770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22874e4e-e48c-485d-9025-d109c38dfe58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80b3be8b-73d7-4357-8a16-672b4daa4907', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:00:38 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-98e64a3d-7e01-4ec2-897f-00fdb0343585 tempest-AttachVolumeNegativeTest-115562770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ba88857-2af0-4d2f-8a5a-782f15bc9f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:00:38 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-98e64a3d-7e01-4ec2-897f-00fdb0343585 tempest-AttachVolumeNegativeTest-115562770 None] Volume volume-80b3be8b-73d7-4357-8a16-672b4daa4907 (80b3be8b-73d7-4357-8a16-672b4daa4907): created successfully Aug 10 16:00:38 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-98e64a3d-7e01-4ec2-897f-00fdb0343585 tempest-AttachVolumeNegativeTest-115562770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ba88857-2af0-4d2f-8a5a-782f15bc9f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:00:38 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-98e64a3d-7e01-4ec2-897f-00fdb0343585 tempest-AttachVolumeNegativeTest-115562770 None] Flow 'volume_create_manager' (9f1a64bc-eda1-4dee-94bb-fd9343b2288b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:00:38 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [req-a6913c36-9f67-48b4-810a-5c74af6bc1a3 req-75519558-c4b1-409d-b4ef-9b94754060d6 tempest-ServerActionsTestOtherA-603942358 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc', 'name': 'volume-50d4e265-39fd-46c6-9b38-06971e2c547f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f5d1ea10-964c-412d-860c-4a184fee3cb4', 'enforce_multipath': True} {{(pid=88641) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 10 16:00:38 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-98e64a3d-7e01-4ec2-897f-00fdb0343585 tempest-AttachVolumeNegativeTest-115562770 None] Created volume successfully. Aug 10 16:00:38 devstack cinder-volume[88641]: INFO cinder.volume.manager [req-a6913c36-9f67-48b4-810a-5c74af6bc1a3 req-75519558-c4b1-409d-b4ef-9b94754060d6 tempest-ServerActionsTestOtherA-603942358 None] attachment_update completed successfully. Aug 10 16:00:38 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-4c12b35f-1b81-46c2-9acb-03776f916b25 tempest-VolumesSnapshotListTestJSON-1522118082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:00:38 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-4c12b35f-1b81-46c2-9acb-03776f916b25 tempest-VolumesSnapshotListTestJSON-1522118082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:00:38 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-4c12b35f-1b81-46c2-9acb-03776f916b25 tempest-VolumesSnapshotListTestJSON-1522118082 None] Creating offline snapshot 635675f2-4fdc-4b27-9f7a-f2661b9403eb of volume d9f99146-94cf-4727-9b71-9e6db47d92fb {{(pid=88641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 16:00:38 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[0131ced4-b44b-43a7-99cd-a81639841ec5]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:00:38 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4c12b35f-1b81-46c2-9acb-03776f916b25 tempest-VolumesSnapshotListTestJSON-1522118082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.5c4aa558-a3ae-43aa-89ca-ae996b683a3a {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:00:39 devstack sudo[97154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.5c4aa558-a3ae-43aa-89ca-ae996b683a3a Aug 10 16:00:39 devstack sudo[97154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:00:39 devstack sudo[97154]: pam_unix(sudo:session): session closed for user root Aug 10 16:00:39 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4c12b35f-1b81-46c2-9acb-03776f916b25 tempest-VolumesSnapshotListTestJSON-1522118082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.5c4aa558-a3ae-43aa-89ca-ae996b683a3a" returned: 0 in 0.665s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:00:39 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-4c12b35f-1b81-46c2-9acb-03776f916b25 tempest-VolumesSnapshotListTestJSON-1522118082 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9f99146-94cf-4727-9b71-9e6db47d92fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 16:00:39 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4c12b35f-1b81-46c2-9acb-03776f916b25 tempest-VolumesSnapshotListTestJSON-1522118082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.5c4aa558-a3ae-43aa-89ca-ae996b683a3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.635675f2-4fdc-4b27-9f7a-f2661b9403eb 1G {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:00:39 devstack sudo[97241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.5c4aa558-a3ae-43aa-89ca-ae996b683a3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.635675f2-4fdc-4b27-9f7a-f2661b9403eb 1G Aug 10 16:00:39 devstack sudo[97241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:00:40 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-522f436e-0401-44b3-bfa7-afcb91cc04ea req-f1eb881a-5f75-40db-b73f-1cff840bb3e2 tempest-AttachVolumeNegativeTest-115562770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:00:40 devstack sudo[97241]: pam_unix(sudo:session): session closed for user root Aug 10 16:00:40 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4c12b35f-1b81-46c2-9acb-03776f916b25 tempest-VolumesSnapshotListTestJSON-1522118082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.5c4aa558-a3ae-43aa-89ca-ae996b683a3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.635675f2-4fdc-4b27-9f7a-f2661b9403eb 1G" returned: 0 in 0.918s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:00:40 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4c12b35f-1b81-46c2-9acb-03776f916b25 tempest-VolumesSnapshotListTestJSON-1522118082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.5c4aa558-a3ae-43aa-89ca-ae996b683a3a -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.635675f2-4fdc-4b27-9f7a-f2661b9403eb {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:00:40 devstack sudo[97588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.5c4aa558-a3ae-43aa-89ca-ae996b683a3a -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.635675f2-4fdc-4b27-9f7a-f2661b9403eb Aug 10 16:00:40 devstack sudo[97588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:00:40 devstack sudo[97588]: pam_unix(sudo:session): session closed for user root Aug 10 16:00:40 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4c12b35f-1b81-46c2-9acb-03776f916b25 tempest-VolumesSnapshotListTestJSON-1522118082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.5c4aa558-a3ae-43aa-89ca-ae996b683a3a -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.635675f2-4fdc-4b27-9f7a-f2661b9403eb" returned: 0 in 0.349s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:00:40 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-4c12b35f-1b81-46c2-9acb-03776f916b25 tempest-VolumesSnapshotListTestJSON-1522118082 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.635675f2-4fdc-4b27-9f7a-f2661b9403eb is being set with open permissions: ugo+rw Aug 10 16:00:40 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4c12b35f-1b81-46c2-9acb-03776f916b25 tempest-VolumesSnapshotListTestJSON-1522118082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.635675f2-4fdc-4b27-9f7a-f2661b9403eb {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:00:40 devstack sudo[97599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.635675f2-4fdc-4b27-9f7a-f2661b9403eb Aug 10 16:00:40 devstack sudo[97599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:00:41 devstack sudo[97599]: pam_unix(sudo:session): session closed for user root Aug 10 16:00:41 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4c12b35f-1b81-46c2-9acb-03776f916b25 tempest-VolumesSnapshotListTestJSON-1522118082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.635675f2-4fdc-4b27-9f7a-f2661b9403eb" returned: 0 in 0.284s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:00:41 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-4c12b35f-1b81-46c2-9acb-03776f916b25 tempest-VolumesSnapshotListTestJSON-1522118082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.343s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:00:41 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-522f436e-0401-44b3-bfa7-afcb91cc04ea req-f1eb881a-5f75-40db-b73f-1cff840bb3e2 tempest-AttachVolumeNegativeTest-115562770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.770s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:00:41 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-522f436e-0401-44b3-bfa7-afcb91cc04ea req-f1eb881a-5f75-40db-b73f-1cff840bb3e2 tempest-AttachVolumeNegativeTest-115562770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:00:41 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-4c12b35f-1b81-46c2-9acb-03776f916b25 tempest-VolumesSnapshotListTestJSON-1522118082 None] Create snapshot completed successfully Aug 10 16:00:41 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [req-522f436e-0401-44b3-bfa7-afcb91cc04ea req-f1eb881a-5f75-40db-b73f-1cff840bb3e2 tempest-AttachVolumeNegativeTest-115562770 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc', 'name': 'volume-80b3be8b-73d7-4357-8a16-672b4daa4907', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '08851e98-ab8a-4eb8-834e-627976891e1d', 'enforce_multipath': True} {{(pid=88641) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 10 16:00:41 devstack cinder-volume[88641]: INFO cinder.volume.manager [req-522f436e-0401-44b3-bfa7-afcb91cc04ea req-f1eb881a-5f75-40db-b73f-1cff840bb3e2 tempest-AttachVolumeNegativeTest-115562770 None] attachment_update completed successfully. Aug 10 16:00:42 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-729410e0-c9de-4e77-b3c3-27b148523edb tempest-VolumesSnapshotListTestJSON-1522118082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:00:42 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-729410e0-c9de-4e77-b3c3-27b148523edb tempest-VolumesSnapshotListTestJSON-1522118082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:00:42 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-729410e0-c9de-4e77-b3c3-27b148523edb tempest-VolumesSnapshotListTestJSON-1522118082 None] Creating offline snapshot 0092ea0f-96d1-4bb3-a1ab-e5992e0874f4 of volume d9f99146-94cf-4727-9b71-9e6db47d92fb {{(pid=88641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 16:00:42 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9460683-1717-49f8-ae70-36b828b6fe84]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:00:42 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-729410e0-c9de-4e77-b3c3-27b148523edb tempest-VolumesSnapshotListTestJSON-1522118082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.635675f2-4fdc-4b27-9f7a-f2661b9403eb {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:00:43 devstack sudo[97628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.635675f2-4fdc-4b27-9f7a-f2661b9403eb Aug 10 16:00:43 devstack sudo[97628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:00:43 devstack sudo[97628]: pam_unix(sudo:session): session closed for user root Aug 10 16:00:43 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-729410e0-c9de-4e77-b3c3-27b148523edb tempest-VolumesSnapshotListTestJSON-1522118082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.635675f2-4fdc-4b27-9f7a-f2661b9403eb" returned: 0 in 0.686s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:00:43 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-729410e0-c9de-4e77-b3c3-27b148523edb tempest-VolumesSnapshotListTestJSON-1522118082 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9f99146-94cf-4727-9b71-9e6db47d92fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 16:00:43 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-729410e0-c9de-4e77-b3c3-27b148523edb tempest-VolumesSnapshotListTestJSON-1522118082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.635675f2-4fdc-4b27-9f7a-f2661b9403eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.0092ea0f-96d1-4bb3-a1ab-e5992e0874f4 1G {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:00:43 devstack sudo[97635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.635675f2-4fdc-4b27-9f7a-f2661b9403eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.0092ea0f-96d1-4bb3-a1ab-e5992e0874f4 1G Aug 10 16:00:43 devstack sudo[97635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:00:44 devstack cinder-volume[88641]: INFO cinder.volume.manager [req-f55e43e2-8909-4d02-bb1d-407ac2d19682 req-276cfa5b-5547-47ce-b082-aa5d8d20984e tempest-AttachVolumeNegativeTest-115562770 None] Terminate volume connection completed successfully. Aug 10 16:00:44 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [req-f55e43e2-8909-4d02-bb1d-407ac2d19682 req-276cfa5b-5547-47ce-b082-aa5d8d20984e tempest-AttachVolumeNegativeTest-115562770 None] Deleting attachment 08851e98-ab8a-4eb8-834e-627976891e1d. {{(pid=88641) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 10 16:00:44 devstack sudo[97635]: pam_unix(sudo:session): session closed for user root Aug 10 16:00:44 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-729410e0-c9de-4e77-b3c3-27b148523edb tempest-VolumesSnapshotListTestJSON-1522118082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.635675f2-4fdc-4b27-9f7a-f2661b9403eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.0092ea0f-96d1-4bb3-a1ab-e5992e0874f4 1G" returned: 0 in 0.960s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:00:44 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-729410e0-c9de-4e77-b3c3-27b148523edb tempest-VolumesSnapshotListTestJSON-1522118082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.635675f2-4fdc-4b27-9f7a-f2661b9403eb -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.0092ea0f-96d1-4bb3-a1ab-e5992e0874f4 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:00:44 devstack sudo[97647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.635675f2-4fdc-4b27-9f7a-f2661b9403eb -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.0092ea0f-96d1-4bb3-a1ab-e5992e0874f4 Aug 10 16:00:44 devstack sudo[97647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:00:44 devstack sudo[97647]: pam_unix(sudo:session): session closed for user root Aug 10 16:00:44 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-729410e0-c9de-4e77-b3c3-27b148523edb tempest-VolumesSnapshotListTestJSON-1522118082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.635675f2-4fdc-4b27-9f7a-f2661b9403eb -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.0092ea0f-96d1-4bb3-a1ab-e5992e0874f4" returned: 0 in 0.499s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:00:44 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-729410e0-c9de-4e77-b3c3-27b148523edb tempest-VolumesSnapshotListTestJSON-1522118082 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.0092ea0f-96d1-4bb3-a1ab-e5992e0874f4 is being set with open permissions: ugo+rw Aug 10 16:00:44 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-729410e0-c9de-4e77-b3c3-27b148523edb tempest-VolumesSnapshotListTestJSON-1522118082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.0092ea0f-96d1-4bb3-a1ab-e5992e0874f4 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:00:44 devstack sudo[97652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.0092ea0f-96d1-4bb3-a1ab-e5992e0874f4 Aug 10 16:00:44 devstack sudo[97652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:00:45 devstack sudo[97652]: pam_unix(sudo:session): session closed for user root Aug 10 16:00:45 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-729410e0-c9de-4e77-b3c3-27b148523edb tempest-VolumesSnapshotListTestJSON-1522118082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.0092ea0f-96d1-4bb3-a1ab-e5992e0874f4" returned: 0 in 0.321s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:00:45 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-729410e0-c9de-4e77-b3c3-27b148523edb tempest-VolumesSnapshotListTestJSON-1522118082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.677s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:00:45 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-729410e0-c9de-4e77-b3c3-27b148523edb tempest-VolumesSnapshotListTestJSON-1522118082 None] Create snapshot completed successfully Aug 10 16:00:47 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-7fd391d9-028f-4a02-ba78-b2981736a940 tempest-VolumesSnapshotListTestJSON-1522118082 None] Acquiring lock "cinder-0092ea0f-96d1-4bb3-a1ab-e5992e0874f4-delete_snapshot" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:00:47 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-7fd391d9-028f-4a02-ba78-b2981736a940 tempest-VolumesSnapshotListTestJSON-1522118082 None] Lock "cinder-0092ea0f-96d1-4bb3-a1ab-e5992e0874f4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:00:47 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-7fd391d9-028f-4a02-ba78-b2981736a940 tempest-VolumesSnapshotListTestJSON-1522118082 None] Acquiring lock "cinder-quobyte-d9f99146-94cf-4727-9b71-9e6db47d92fb" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:00:47 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-7fd391d9-028f-4a02-ba78-b2981736a940 tempest-VolumesSnapshotListTestJSON-1522118082 None] Lock "cinder-quobyte-d9f99146-94cf-4727-9b71-9e6db47d92fb" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:00:47 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-7fd391d9-028f-4a02-ba78-b2981736a940 tempest-VolumesSnapshotListTestJSON-1522118082 None] Acquiring lock "cinder-quobyte-0092ea0f-96d1-4bb3-a1ab-e5992e0874f4" by "_delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:00:47 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-7fd391d9-028f-4a02-ba78-b2981736a940 tempest-VolumesSnapshotListTestJSON-1522118082 None] Lock "cinder-quobyte-0092ea0f-96d1-4bb3-a1ab-e5992e0874f4" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:00:47 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-7fd391d9-028f-4a02-ba78-b2981736a940 tempest-VolumesSnapshotListTestJSON-1522118082 None] Deleting offline snapshot 0092ea0f-96d1-4bb3-a1ab-e5992e0874f4 of volume d9f99146-94cf-4727-9b71-9e6db47d92fb {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 16:00:47 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-7fd391d9-028f-4a02-ba78-b2981736a940 tempest-VolumesSnapshotListTestJSON-1522118082 None] snapshot_file for this snap is: volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.0092ea0f-96d1-4bb3-a1ab-e5992e0874f4 {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 16:00:47 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[605985b0-e0ed-47a3-b73b-4af7e8e53c86]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:00:47 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7fd391d9-028f-4a02-ba78-b2981736a940 tempest-VolumesSnapshotListTestJSON-1522118082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.0092ea0f-96d1-4bb3-a1ab-e5992e0874f4 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:00:47 devstack sudo[97680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.0092ea0f-96d1-4bb3-a1ab-e5992e0874f4 Aug 10 16:00:47 devstack sudo[97680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:00:48 devstack cinder-volume[88641]: DEBUG dbcounter [-] [88641] Writing DB stats cinder:SELECT=97,cinder:UPDATE=91,cinder:INSERT=25,cinder:DELETE=8 {{(pid=88641) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 16:00:48 devstack cinder-volume[88641]: DEBUG dbcounter [-] [88641] Writing DB stats cinder:SELECT=94,cinder:UPDATE=99,cinder:INSERT=26,cinder:DELETE=11 {{(pid=88641) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 16:00:48 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a8d15f9-445c-48dc-ae60-71c7661c6193 tempest-AbsoluteLimitsTests-623696339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:00:48 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9a8d15f9-445c-48dc-ae60-71c7661c6193 tempest-AbsoluteLimitsTests-623696339 None] Flow 'volume_create_manager' (1d78cfb2-88ba-458f-9b6f-368d2320a202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:00:48 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9a8d15f9-445c-48dc-ae60-71c7661c6193 tempest-AbsoluteLimitsTests-623696339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1139c26a-058b-42e2-ad01-26135e9cf1fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:00:48 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9a8d15f9-445c-48dc-ae60-71c7661c6193 tempest-AbsoluteLimitsTests-623696339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1139c26a-058b-42e2-ad01-26135e9cf1fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:00:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-429286005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=114986b1-4bcc-4347-85c0-cf98b5a395c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aed24aa99b84476d8bae8386805c2d8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:00:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:00:48Z,use_quota=True,user_id='dc06d632445748008c88574accd0f4a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:00:48 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9a8d15f9-445c-48dc-ae60-71c7661c6193 tempest-AbsoluteLimitsTests-623696339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a330e08-3327-47bf-8f72-5270667e8046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:00:48 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9a8d15f9-445c-48dc-ae60-71c7661c6193 tempest-AbsoluteLimitsTests-623696339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a330e08-3327-47bf-8f72-5270667e8046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:00:48 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9a8d15f9-445c-48dc-ae60-71c7661c6193 tempest-AbsoluteLimitsTests-623696339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a376fa5a-ca14-41ba-bec0-50d5977afa54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:00:48 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9a8d15f9-445c-48dc-ae60-71c7661c6193 tempest-AbsoluteLimitsTests-623696339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a376fa5a-ca14-41ba-bec0-50d5977afa54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '114986b1-4bcc-4347-85c0-cf98b5a395c2', 'volume_name': 'volume-114986b1-4bcc-4347-85c0-cf98b5a395c2', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:00:48 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9a8d15f9-445c-48dc-ae60-71c7661c6193 tempest-AbsoluteLimitsTests-623696339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8cada60-325c-4df1-a88b-3ae8098aab4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:00:48 devstack sudo[97680]: pam_unix(sudo:session): session closed for user root Aug 10 16:00:48 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9a8d15f9-445c-48dc-ae60-71c7661c6193 tempest-AbsoluteLimitsTests-623696339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8cada60-325c-4df1-a88b-3ae8098aab4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:00:48 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9a8d15f9-445c-48dc-ae60-71c7661c6193 tempest-AbsoluteLimitsTests-623696339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (145c0561-6f25-4773-abfc-722cb7dc913e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:00:48 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-9a8d15f9-445c-48dc-ae60-71c7661c6193 tempest-AbsoluteLimitsTests-623696339 None] Volume 114986b1-4bcc-4347-85c0-cf98b5a395c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-114986b1-4bcc-4347-85c0-cf98b5a395c2', 'volume_size': 1} Aug 10 16:00:48 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-9a8d15f9-445c-48dc-ae60-71c7661c6193 tempest-AbsoluteLimitsTests-623696339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:00:48 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-9a8d15f9-445c-48dc-ae60-71c7661c6193 tempest-AbsoluteLimitsTests-623696339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:00:48 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-9a8d15f9-445c-48dc-ae60-71c7661c6193 tempest-AbsoluteLimitsTests-623696339 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:00:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-429286005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=114986b1-4bcc-4347-85c0-cf98b5a395c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aed24aa99b84476d8bae8386805c2d8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:00:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:00:48Z,use_quota=True,user_id='dc06d632445748008c88574accd0f4a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:00:48 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-9a8d15f9-445c-48dc-ae60-71c7661c6193 tempest-AbsoluteLimitsTests-623696339 None] Creating volume 114986b1-4bcc-4347-85c0-cf98b5a395c2 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:00:48 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-9a8d15f9-445c-48dc-ae60-71c7661c6193 tempest-AbsoluteLimitsTests-623696339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:00:48 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-9a8d15f9-445c-48dc-ae60-71c7661c6193 tempest-AbsoluteLimitsTests-623696339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:00:48 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-9a8d15f9-445c-48dc-ae60-71c7661c6193 tempest-AbsoluteLimitsTests-623696339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:00:48 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-9a8d15f9-445c-48dc-ae60-71c7661c6193 tempest-AbsoluteLimitsTests-623696339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:00:48 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-9a8d15f9-445c-48dc-ae60-71c7661c6193 tempest-AbsoluteLimitsTests-623696339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:00:48 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-9a8d15f9-445c-48dc-ae60-71c7661c6193 tempest-AbsoluteLimitsTests-623696339 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:00:48 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-9a8d15f9-445c-48dc-ae60-71c7661c6193 tempest-AbsoluteLimitsTests-623696339 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:00:48 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9a8d15f9-445c-48dc-ae60-71c7661c6193 tempest-AbsoluteLimitsTests-623696339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-114986b1-4bcc-4347-85c0-cf98b5a395c2 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:00:48 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7fd391d9-028f-4a02-ba78-b2981736a940 tempest-VolumesSnapshotListTestJSON-1522118082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.0092ea0f-96d1-4bb3-a1ab-e5992e0874f4" returned: 0 in 0.996s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:00:48 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-7fd391d9-028f-4a02-ba78-b2981736a940 tempest-VolumesSnapshotListTestJSON-1522118082 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9f99146-94cf-4727-9b71-9e6db47d92fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 16:00:48 devstack sudo[97687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-114986b1-4bcc-4347-85c0-cf98b5a395c2 1073741824 Aug 10 16:00:48 devstack sudo[97687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:00:48 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6616cd1-85f1-4576-80e5-eeda77df7ebc]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:00:48 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7fd391d9-028f-4a02-ba78-b2981736a940 tempest-VolumesSnapshotListTestJSON-1522118082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.635675f2-4fdc-4b27-9f7a-f2661b9403eb {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:00:48 devstack sudo[97689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.635675f2-4fdc-4b27-9f7a-f2661b9403eb Aug 10 16:00:48 devstack sudo[97689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:00:49 devstack sudo[97689]: pam_unix(sudo:session): session closed for user root Aug 10 16:00:49 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7fd391d9-028f-4a02-ba78-b2981736a940 tempest-VolumesSnapshotListTestJSON-1522118082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.635675f2-4fdc-4b27-9f7a-f2661b9403eb" returned: 0 in 0.736s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:00:49 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-7fd391d9-028f-4a02-ba78-b2981736a940 tempest-VolumesSnapshotListTestJSON-1522118082 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9f99146-94cf-4727-9b71-9e6db47d92fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 16:00:49 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7fd391d9-028f-4a02-ba78-b2981736a940 tempest-VolumesSnapshotListTestJSON-1522118082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.0092ea0f-96d1-4bb3-a1ab-e5992e0874f4 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:00:49 devstack sudo[97734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.0092ea0f-96d1-4bb3-a1ab-e5992e0874f4 Aug 10 16:00:49 devstack sudo[97734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:00:49 devstack sudo[97687]: pam_unix(sudo:session): session closed for user root Aug 10 16:00:49 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9a8d15f9-445c-48dc-ae60-71c7661c6193 tempest-AbsoluteLimitsTests-623696339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-114986b1-4bcc-4347-85c0-cf98b5a395c2 1073741824" returned: 0 in 0.952s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:00:49 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9a8d15f9-445c-48dc-ae60-71c7661c6193 tempest-AbsoluteLimitsTests-623696339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-114986b1-4bcc-4347-85c0-cf98b5a395c2 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:00:49 devstack sudo[97736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-114986b1-4bcc-4347-85c0-cf98b5a395c2 Aug 10 16:00:49 devstack sudo[97736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:00:49 devstack sudo[97736]: pam_unix(sudo:session): session closed for user root Aug 10 16:00:49 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9a8d15f9-445c-48dc-ae60-71c7661c6193 tempest-AbsoluteLimitsTests-623696339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-114986b1-4bcc-4347-85c0-cf98b5a395c2" returned: 0 in 0.450s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:00:49 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-9a8d15f9-445c-48dc-ae60-71c7661c6193 tempest-AbsoluteLimitsTests-623696339 None] <== create_volume: return (1498ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:00:49 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-9a8d15f9-445c-48dc-ae60-71c7661c6193 tempest-AbsoluteLimitsTests-623696339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.502s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:00:49 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9a8d15f9-445c-48dc-ae60-71c7661c6193 tempest-AbsoluteLimitsTests-623696339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (145c0561-6f25-4773-abfc-722cb7dc913e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-114986b1-4bcc-4347-85c0-cf98b5a395c2', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:00:49 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9a8d15f9-445c-48dc-ae60-71c7661c6193 tempest-AbsoluteLimitsTests-623696339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9461fc2c-f9b6-459c-847d-8bb317ec7eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:00:49 devstack sudo[97734]: pam_unix(sudo:session): session closed for user root Aug 10 16:00:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7fd391d9-028f-4a02-ba78-b2981736a940 tempest-VolumesSnapshotListTestJSON-1522118082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.0092ea0f-96d1-4bb3-a1ab-e5992e0874f4" returned: 0 in 0.701s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:00:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7fd391d9-028f-4a02-ba78-b2981736a940 tempest-VolumesSnapshotListTestJSON-1522118082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.0092ea0f-96d1-4bb3-a1ab-e5992e0874f4 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:00:50 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-9a8d15f9-445c-48dc-ae60-71c7661c6193 tempest-AbsoluteLimitsTests-623696339 None] Volume volume-114986b1-4bcc-4347-85c0-cf98b5a395c2 (114986b1-4bcc-4347-85c0-cf98b5a395c2): created successfully Aug 10 16:00:50 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9a8d15f9-445c-48dc-ae60-71c7661c6193 tempest-AbsoluteLimitsTests-623696339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9461fc2c-f9b6-459c-847d-8bb317ec7eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:00:50 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9a8d15f9-445c-48dc-ae60-71c7661c6193 tempest-AbsoluteLimitsTests-623696339 None] Flow 'volume_create_manager' (1d78cfb2-88ba-458f-9b6f-368d2320a202) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:00:50 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-9a8d15f9-445c-48dc-ae60-71c7661c6193 tempest-AbsoluteLimitsTests-623696339 None] Created volume successfully. Aug 10 16:00:50 devstack sudo[97742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.0092ea0f-96d1-4bb3-a1ab-e5992e0874f4 Aug 10 16:00:50 devstack sudo[97742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:00:50 devstack sudo[97742]: pam_unix(sudo:session): session closed for user root Aug 10 16:00:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7fd391d9-028f-4a02-ba78-b2981736a940 tempest-VolumesSnapshotListTestJSON-1522118082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.0092ea0f-96d1-4bb3-a1ab-e5992e0874f4" returned: 0 in 0.433s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:00:50 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-7fd391d9-028f-4a02-ba78-b2981736a940 tempest-VolumesSnapshotListTestJSON-1522118082 None] Lock "cinder-quobyte-0092ea0f-96d1-4bb3-a1ab-e5992e0874f4" released by "_delete_snapshot" :: held 3.055s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:00:50 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-7fd391d9-028f-4a02-ba78-b2981736a940 tempest-VolumesSnapshotListTestJSON-1522118082 None] Lock "cinder-quobyte-d9f99146-94cf-4727-9b71-9e6db47d92fb" released by "delete_snapshot" :: held 3.089s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:00:50 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-a166fe6c-8dc3-4491-9667-3a36e22bb6bc tempest-AbsoluteLimitsTests-623696339 None] Acquiring lock "cinder-114986b1-4bcc-4347-85c0-cf98b5a395c2-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:00:50 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-a166fe6c-8dc3-4491-9667-3a36e22bb6bc tempest-AbsoluteLimitsTests-623696339 None] Lock "cinder-114986b1-4bcc-4347-85c0-cf98b5a395c2-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:00:50 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-7fd391d9-028f-4a02-ba78-b2981736a940 tempest-VolumesSnapshotListTestJSON-1522118082 None] Created reservations ['c799ed5d-dfee-4bbf-99ad-b7f9d82065b5', '0cd3025a-a375-46e9-b3fb-8f9df321771b', '84e50392-3edb-4cc8-8153-af22530d8923', '07c12cd2-4eb2-442a-8259-3dd720ab533f'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:00:50 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-a166fe6c-8dc3-4491-9667-3a36e22bb6bc tempest-AbsoluteLimitsTests-623696339 None] Acquiring lock "cinder-quobyte-114986b1-4bcc-4347-85c0-cf98b5a395c2" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:00:50 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-a166fe6c-8dc3-4491-9667-3a36e22bb6bc tempest-AbsoluteLimitsTests-623696339 None] Lock "cinder-quobyte-114986b1-4bcc-4347-85c0-cf98b5a395c2" acquired by "delete_volume" :: waited 0.027s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:00:50 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[f28203cb-9496-4c4f-bebf-5a6c047a369c]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:00:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a166fe6c-8dc3-4491-9667-3a36e22bb6bc tempest-AbsoluteLimitsTests-623696339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-114986b1-4bcc-4347-85c0-cf98b5a395c2 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:00:50 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-7fd391d9-028f-4a02-ba78-b2981736a940 tempest-VolumesSnapshotListTestJSON-1522118082 None] Delete snapshot completed successfully. Aug 10 16:00:50 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-7fd391d9-028f-4a02-ba78-b2981736a940 tempest-VolumesSnapshotListTestJSON-1522118082 None] Lock "cinder-0092ea0f-96d1-4bb3-a1ab-e5992e0874f4-delete_snapshot" released by "delete_snapshot" :: held 3.379s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:00:50 devstack sudo[97748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-114986b1-4bcc-4347-85c0-cf98b5a395c2 Aug 10 16:00:50 devstack sudo[97748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:00:51 devstack sudo[97748]: pam_unix(sudo:session): session closed for user root Aug 10 16:00:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a166fe6c-8dc3-4491-9667-3a36e22bb6bc tempest-AbsoluteLimitsTests-623696339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-114986b1-4bcc-4347-85c0-cf98b5a395c2" returned: 0 in 0.399s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:00:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a166fe6c-8dc3-4491-9667-3a36e22bb6bc tempest-AbsoluteLimitsTests-623696339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-114986b1-4bcc-4347-85c0-cf98b5a395c2 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:00:51 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-ba4e514d-01fe-4dd5-a095-2688f6c32719 tempest-AttachVolumeNegativeTest-115562770 None] Acquiring lock "cinder-80b3be8b-73d7-4357-8a16-672b4daa4907-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:00:51 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-ba4e514d-01fe-4dd5-a095-2688f6c32719 tempest-AttachVolumeNegativeTest-115562770 None] Lock "cinder-80b3be8b-73d7-4357-8a16-672b4daa4907-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:00:51 devstack sudo[97753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-114986b1-4bcc-4347-85c0-cf98b5a395c2 Aug 10 16:00:51 devstack sudo[97753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:00:51 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-ba4e514d-01fe-4dd5-a095-2688f6c32719 tempest-AttachVolumeNegativeTest-115562770 None] Acquiring lock "cinder-quobyte-80b3be8b-73d7-4357-8a16-672b4daa4907" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:00:51 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-ba4e514d-01fe-4dd5-a095-2688f6c32719 tempest-AttachVolumeNegativeTest-115562770 None] Lock "cinder-quobyte-80b3be8b-73d7-4357-8a16-672b4daa4907" acquired by "delete_volume" :: waited 0.017s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:00:51 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd5de4f4-3a29-4614-9f2d-3b3709cf1370]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:00:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ba4e514d-01fe-4dd5-a095-2688f6c32719 tempest-AttachVolumeNegativeTest-115562770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-80b3be8b-73d7-4357-8a16-672b4daa4907 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:00:51 devstack sudo[97755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-80b3be8b-73d7-4357-8a16-672b4daa4907 Aug 10 16:00:51 devstack sudo[97755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:00:51 devstack sudo[97753]: pam_unix(sudo:session): session closed for user root Aug 10 16:00:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a166fe6c-8dc3-4491-9667-3a36e22bb6bc tempest-AbsoluteLimitsTests-623696339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-114986b1-4bcc-4347-85c0-cf98b5a395c2" returned: 0 in 0.308s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:00:51 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-a166fe6c-8dc3-4491-9667-3a36e22bb6bc tempest-AbsoluteLimitsTests-623696339 None] Lock "cinder-quobyte-114986b1-4bcc-4347-85c0-cf98b5a395c2" released by "delete_volume" :: held 0.750s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:00:51 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-a166fe6c-8dc3-4491-9667-3a36e22bb6bc tempest-AbsoluteLimitsTests-623696339 None] Created reservations ['d31ebbe6-34a7-46a0-8ee8-33a82474c19e', '5c3c5bc1-d472-43ba-aabd-df10770b2116', '8eb3cfd3-135f-4238-98ee-e7791cf479ab', 'dc0b0682-6a48-465a-95a0-163c270b6b8a'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:00:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-a166fe6c-8dc3-4491-9667-3a36e22bb6bc tempest-AbsoluteLimitsTests-623696339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:00:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-a166fe6c-8dc3-4491-9667-3a36e22bb6bc tempest-AbsoluteLimitsTests-623696339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:00:51 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-a166fe6c-8dc3-4491-9667-3a36e22bb6bc tempest-AbsoluteLimitsTests-623696339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:00:51 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-a166fe6c-8dc3-4491-9667-3a36e22bb6bc tempest-AbsoluteLimitsTests-623696339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:00:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-a166fe6c-8dc3-4491-9667-3a36e22bb6bc tempest-AbsoluteLimitsTests-623696339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:00:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a166fe6c-8dc3-4491-9667-3a36e22bb6bc tempest-AbsoluteLimitsTests-623696339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:00:51 devstack sudo[97761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:00:51 devstack sudo[97761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:00:51 devstack sudo[97755]: pam_unix(sudo:session): session closed for user root Aug 10 16:00:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ba4e514d-01fe-4dd5-a095-2688f6c32719 tempest-AttachVolumeNegativeTest-115562770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-80b3be8b-73d7-4357-8a16-672b4daa4907" returned: 0 in 0.423s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:00:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ba4e514d-01fe-4dd5-a095-2688f6c32719 tempest-AttachVolumeNegativeTest-115562770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-80b3be8b-73d7-4357-8a16-672b4daa4907 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:00:51 devstack sudo[97765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-80b3be8b-73d7-4357-8a16-672b4daa4907 Aug 10 16:00:51 devstack sudo[97765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:00:51 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-cbf41fbd-979c-44d4-85d5-b80c1f5d28c3 tempest-VolumesSnapshotListTestJSON-1522118082 None] Acquiring lock "cinder-635675f2-4fdc-4b27-9f7a-f2661b9403eb-delete_snapshot" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:00:51 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-cbf41fbd-979c-44d4-85d5-b80c1f5d28c3 tempest-VolumesSnapshotListTestJSON-1522118082 None] Lock "cinder-635675f2-4fdc-4b27-9f7a-f2661b9403eb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:00:51 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-cbf41fbd-979c-44d4-85d5-b80c1f5d28c3 tempest-VolumesSnapshotListTestJSON-1522118082 None] Acquiring lock "cinder-quobyte-d9f99146-94cf-4727-9b71-9e6db47d92fb" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:00:51 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-cbf41fbd-979c-44d4-85d5-b80c1f5d28c3 tempest-VolumesSnapshotListTestJSON-1522118082 None] Lock "cinder-quobyte-d9f99146-94cf-4727-9b71-9e6db47d92fb" acquired by "delete_snapshot" :: waited 0.042s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:00:51 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-cbf41fbd-979c-44d4-85d5-b80c1f5d28c3 tempest-VolumesSnapshotListTestJSON-1522118082 None] Acquiring lock "cinder-quobyte-635675f2-4fdc-4b27-9f7a-f2661b9403eb" by "_delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:00:51 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-cbf41fbd-979c-44d4-85d5-b80c1f5d28c3 tempest-VolumesSnapshotListTestJSON-1522118082 None] Lock "cinder-quobyte-635675f2-4fdc-4b27-9f7a-f2661b9403eb" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:00:51 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-cbf41fbd-979c-44d4-85d5-b80c1f5d28c3 tempest-VolumesSnapshotListTestJSON-1522118082 None] Deleting offline snapshot 635675f2-4fdc-4b27-9f7a-f2661b9403eb of volume d9f99146-94cf-4727-9b71-9e6db47d92fb {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 16:00:51 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-cbf41fbd-979c-44d4-85d5-b80c1f5d28c3 tempest-VolumesSnapshotListTestJSON-1522118082 None] snapshot_file for this snap is: volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.635675f2-4fdc-4b27-9f7a-f2661b9403eb {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 16:00:51 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c79f7f-9044-4487-bc15-250ee812855d]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:00:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-cbf41fbd-979c-44d4-85d5-b80c1f5d28c3 tempest-VolumesSnapshotListTestJSON-1522118082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.635675f2-4fdc-4b27-9f7a-f2661b9403eb {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:00:51 devstack sudo[97761]: pam_unix(sudo:session): session closed for user root Aug 10 16:00:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a166fe6c-8dc3-4491-9667-3a36e22bb6bc tempest-AbsoluteLimitsTests-623696339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.429s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:00:51 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-a166fe6c-8dc3-4491-9667-3a36e22bb6bc tempest-AbsoluteLimitsTests-623696339 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:00:52 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-a166fe6c-8dc3-4491-9667-3a36e22bb6bc tempest-AbsoluteLimitsTests-623696339 None] Deleted volume successfully. Aug 10 16:00:52 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-a166fe6c-8dc3-4491-9667-3a36e22bb6bc tempest-AbsoluteLimitsTests-623696339 None] Lock "cinder-114986b1-4bcc-4347-85c0-cf98b5a395c2-delete_volume" released by "delete_volume" :: held 1.447s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:00:52 devstack sudo[97765]: pam_unix(sudo:session): session closed for user root Aug 10 16:00:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ba4e514d-01fe-4dd5-a095-2688f6c32719 tempest-AttachVolumeNegativeTest-115562770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-80b3be8b-73d7-4357-8a16-672b4daa4907" returned: 0 in 0.399s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:00:52 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-ba4e514d-01fe-4dd5-a095-2688f6c32719 tempest-AttachVolumeNegativeTest-115562770 None] Lock "cinder-quobyte-80b3be8b-73d7-4357-8a16-672b4daa4907" released by "delete_volume" :: held 0.876s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:00:52 devstack sudo[97768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.635675f2-4fdc-4b27-9f7a-f2661b9403eb Aug 10 16:00:52 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-ba4e514d-01fe-4dd5-a095-2688f6c32719 tempest-AttachVolumeNegativeTest-115562770 None] Created reservations ['4bfd2ca6-2777-49ba-851d-6f789a5bd466', '21213a49-34ea-4b6a-86f1-1cd1124a5221', 'ef722972-6a17-4660-b1e4-4e10fb1a2730', 'de468c5a-775c-4e55-a929-aec54cd062b9'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:00:52 devstack sudo[97768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:00:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-ba4e514d-01fe-4dd5-a095-2688f6c32719 tempest-AttachVolumeNegativeTest-115562770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:00:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-ba4e514d-01fe-4dd5-a095-2688f6c32719 tempest-AttachVolumeNegativeTest-115562770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:00:52 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-ba4e514d-01fe-4dd5-a095-2688f6c32719 tempest-AttachVolumeNegativeTest-115562770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:00:52 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-ba4e514d-01fe-4dd5-a095-2688f6c32719 tempest-AttachVolumeNegativeTest-115562770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:00:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-ba4e514d-01fe-4dd5-a095-2688f6c32719 tempest-AttachVolumeNegativeTest-115562770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:00:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ba4e514d-01fe-4dd5-a095-2688f6c32719 tempest-AttachVolumeNegativeTest-115562770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:00:52 devstack sudo[97771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:00:52 devstack sudo[97771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:00:52 devstack sudo[97768]: pam_unix(sudo:session): session closed for user root Aug 10 16:00:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-cbf41fbd-979c-44d4-85d5-b80c1f5d28c3 tempest-VolumesSnapshotListTestJSON-1522118082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.635675f2-4fdc-4b27-9f7a-f2661b9403eb" returned: 0 in 0.616s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:00:52 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-cbf41fbd-979c-44d4-85d5-b80c1f5d28c3 tempest-VolumesSnapshotListTestJSON-1522118082 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9f99146-94cf-4727-9b71-9e6db47d92fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 16:00:52 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-0fd7bfd7-fd3e-4c9a-ab95-26d126b09662 tempest-AttachVolumeNegativeTest-115562770 None] Acquiring lock "cinder-e65b158e-64ec-4b88-9bca-2eba16b3bb5e-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:00:52 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca0f2da-3734-48a7-a5a3-663392ef6970]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:00:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-cbf41fbd-979c-44d4-85d5-b80c1f5d28c3 tempest-VolumesSnapshotListTestJSON-1522118082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.5c4aa558-a3ae-43aa-89ca-ae996b683a3a {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:00:52 devstack sudo[97771]: pam_unix(sudo:session): session closed for user root Aug 10 16:00:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ba4e514d-01fe-4dd5-a095-2688f6c32719 tempest-AttachVolumeNegativeTest-115562770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.379s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:00:52 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-ba4e514d-01fe-4dd5-a095-2688f6c32719 tempest-AttachVolumeNegativeTest-115562770 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:00:52 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-0fd7bfd7-fd3e-4c9a-ab95-26d126b09662 tempest-AttachVolumeNegativeTest-115562770 None] Lock "cinder-e65b158e-64ec-4b88-9bca-2eba16b3bb5e-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:00:52 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-ba4e514d-01fe-4dd5-a095-2688f6c32719 tempest-AttachVolumeNegativeTest-115562770 None] Deleted volume successfully. Aug 10 16:00:52 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-ba4e514d-01fe-4dd5-a095-2688f6c32719 tempest-AttachVolumeNegativeTest-115562770 None] Lock "cinder-80b3be8b-73d7-4357-8a16-672b4daa4907-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:00:52 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-0fd7bfd7-fd3e-4c9a-ab95-26d126b09662 tempest-AttachVolumeNegativeTest-115562770 None] Acquiring lock "cinder-quobyte-e65b158e-64ec-4b88-9bca-2eba16b3bb5e" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:00:52 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-0fd7bfd7-fd3e-4c9a-ab95-26d126b09662 tempest-AttachVolumeNegativeTest-115562770 None] Lock "cinder-quobyte-e65b158e-64ec-4b88-9bca-2eba16b3bb5e" acquired by "delete_volume" :: waited 0.015s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:00:52 devstack sudo[97777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.5c4aa558-a3ae-43aa-89ca-ae996b683a3a Aug 10 16:00:52 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1109ddb-b248-43a8-8d53-55204aba0016]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:00:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0fd7bfd7-fd3e-4c9a-ab95-26d126b09662 tempest-AttachVolumeNegativeTest-115562770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-e65b158e-64ec-4b88-9bca-2eba16b3bb5e {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:00:52 devstack sudo[97777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:00:52 devstack sudo[97779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-e65b158e-64ec-4b88-9bca-2eba16b3bb5e Aug 10 16:00:52 devstack sudo[97779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:00:53 devstack sudo[97777]: pam_unix(sudo:session): session closed for user root Aug 10 16:00:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-cbf41fbd-979c-44d4-85d5-b80c1f5d28c3 tempest-VolumesSnapshotListTestJSON-1522118082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.5c4aa558-a3ae-43aa-89ca-ae996b683a3a" returned: 0 in 0.450s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:00:53 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-cbf41fbd-979c-44d4-85d5-b80c1f5d28c3 tempest-VolumesSnapshotListTestJSON-1522118082 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9f99146-94cf-4727-9b71-9e6db47d92fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 16:00:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-cbf41fbd-979c-44d4-85d5-b80c1f5d28c3 tempest-VolumesSnapshotListTestJSON-1522118082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.635675f2-4fdc-4b27-9f7a-f2661b9403eb {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:00:53 devstack sudo[97785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.635675f2-4fdc-4b27-9f7a-f2661b9403eb Aug 10 16:00:53 devstack sudo[97785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:00:53 devstack sudo[97779]: pam_unix(sudo:session): session closed for user root Aug 10 16:00:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0fd7bfd7-fd3e-4c9a-ab95-26d126b09662 tempest-AttachVolumeNegativeTest-115562770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-e65b158e-64ec-4b88-9bca-2eba16b3bb5e" returned: 0 in 0.493s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:00:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0fd7bfd7-fd3e-4c9a-ab95-26d126b09662 tempest-AttachVolumeNegativeTest-115562770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-e65b158e-64ec-4b88-9bca-2eba16b3bb5e {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:00:53 devstack sudo[97791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-e65b158e-64ec-4b88-9bca-2eba16b3bb5e Aug 10 16:00:53 devstack sudo[97791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:00:53 devstack sudo[97791]: pam_unix(sudo:session): session closed for user root Aug 10 16:00:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0fd7bfd7-fd3e-4c9a-ab95-26d126b09662 tempest-AttachVolumeNegativeTest-115562770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-e65b158e-64ec-4b88-9bca-2eba16b3bb5e" returned: 0 in 0.312s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:00:53 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-0fd7bfd7-fd3e-4c9a-ab95-26d126b09662 tempest-AttachVolumeNegativeTest-115562770 None] Lock "cinder-quobyte-e65b158e-64ec-4b88-9bca-2eba16b3bb5e" released by "delete_volume" :: held 0.862s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:00:53 devstack sudo[97785]: pam_unix(sudo:session): session closed for user root Aug 10 16:00:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-cbf41fbd-979c-44d4-85d5-b80c1f5d28c3 tempest-VolumesSnapshotListTestJSON-1522118082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.635675f2-4fdc-4b27-9f7a-f2661b9403eb" returned: 0 in 0.568s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:00:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-cbf41fbd-979c-44d4-85d5-b80c1f5d28c3 tempest-VolumesSnapshotListTestJSON-1522118082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.635675f2-4fdc-4b27-9f7a-f2661b9403eb {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:00:53 devstack sudo[97798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.635675f2-4fdc-4b27-9f7a-f2661b9403eb Aug 10 16:00:53 devstack sudo[97798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:00:53 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-0fd7bfd7-fd3e-4c9a-ab95-26d126b09662 tempest-AttachVolumeNegativeTest-115562770 None] Created reservations ['c9509d8f-ce9b-49c0-b2d1-d99c4fe077ac', 'e21c7626-61bd-448a-886f-f8244c8a8490', 'fd9c6538-a323-4193-9cbf-0f678fd65518', '96e63ce9-d15c-4a9f-b0f2-705edf83fb64'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:00:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-0fd7bfd7-fd3e-4c9a-ab95-26d126b09662 tempest-AttachVolumeNegativeTest-115562770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:00:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-0fd7bfd7-fd3e-4c9a-ab95-26d126b09662 tempest-AttachVolumeNegativeTest-115562770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:00:53 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-0fd7bfd7-fd3e-4c9a-ab95-26d126b09662 tempest-AttachVolumeNegativeTest-115562770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:00:53 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-0fd7bfd7-fd3e-4c9a-ab95-26d126b09662 tempest-AttachVolumeNegativeTest-115562770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:00:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-0fd7bfd7-fd3e-4c9a-ab95-26d126b09662 tempest-AttachVolumeNegativeTest-115562770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:00:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0fd7bfd7-fd3e-4c9a-ab95-26d126b09662 tempest-AttachVolumeNegativeTest-115562770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:00:53 devstack sudo[97800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:00:53 devstack sudo[97800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:00:54 devstack sudo[97798]: pam_unix(sudo:session): session closed for user root Aug 10 16:00:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-cbf41fbd-979c-44d4-85d5-b80c1f5d28c3 tempest-VolumesSnapshotListTestJSON-1522118082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.635675f2-4fdc-4b27-9f7a-f2661b9403eb" returned: 0 in 0.470s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:00:54 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-cbf41fbd-979c-44d4-85d5-b80c1f5d28c3 tempest-VolumesSnapshotListTestJSON-1522118082 None] Lock "cinder-quobyte-635675f2-4fdc-4b27-9f7a-f2661b9403eb" released by "_delete_snapshot" :: held 2.238s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:00:54 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-cbf41fbd-979c-44d4-85d5-b80c1f5d28c3 tempest-VolumesSnapshotListTestJSON-1522118082 None] Lock "cinder-quobyte-d9f99146-94cf-4727-9b71-9e6db47d92fb" released by "delete_snapshot" :: held 2.267s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:00:54 devstack sudo[97800]: pam_unix(sudo:session): session closed for user root Aug 10 16:00:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0fd7bfd7-fd3e-4c9a-ab95-26d126b09662 tempest-AttachVolumeNegativeTest-115562770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.329s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:00:54 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-0fd7bfd7-fd3e-4c9a-ab95-26d126b09662 tempest-AttachVolumeNegativeTest-115562770 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:00:54 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-0fd7bfd7-fd3e-4c9a-ab95-26d126b09662 tempest-AttachVolumeNegativeTest-115562770 None] Deleted volume successfully. Aug 10 16:00:54 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-0fd7bfd7-fd3e-4c9a-ab95-26d126b09662 tempest-AttachVolumeNegativeTest-115562770 None] Lock "cinder-e65b158e-64ec-4b88-9bca-2eba16b3bb5e-delete_volume" released by "delete_volume" :: held 1.579s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:00:54 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-cbf41fbd-979c-44d4-85d5-b80c1f5d28c3 tempest-VolumesSnapshotListTestJSON-1522118082 None] Created reservations ['d2bf84ce-90f5-468e-b43d-c664ba7548c2', '335e9daa-e79b-40a0-9b06-df410ccb8abf', '04bd6bec-5dba-4d70-a85e-2dc84a9e8d86', 'e38615e5-7a4a-4524-a707-2864daf205a3'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:00:54 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-cbf41fbd-979c-44d4-85d5-b80c1f5d28c3 tempest-VolumesSnapshotListTestJSON-1522118082 None] Delete snapshot completed successfully. Aug 10 16:00:54 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-cbf41fbd-979c-44d4-85d5-b80c1f5d28c3 tempest-VolumesSnapshotListTestJSON-1522118082 None] Lock "cinder-635675f2-4fdc-4b27-9f7a-f2661b9403eb-delete_snapshot" released by "delete_snapshot" :: held 2.556s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:00:55 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-9248a993-717d-4a46-9fab-46bc0bca7e98 tempest-VolumesSnapshotListTestJSON-1522118082 None] Acquiring lock "cinder-5c4aa558-a3ae-43aa-89ca-ae996b683a3a-delete_snapshot" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:00:55 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-d99c6f93-a1c3-45de-af86-be5d320eeece tempest-AttachVolumeNegativeTest-115562770 None] Acquiring lock "cinder-06496020-bee6-4dfe-995e-27769de85343-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:00:55 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-9248a993-717d-4a46-9fab-46bc0bca7e98 tempest-VolumesSnapshotListTestJSON-1522118082 None] Lock "cinder-5c4aa558-a3ae-43aa-89ca-ae996b683a3a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.068s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:00:55 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-9248a993-717d-4a46-9fab-46bc0bca7e98 tempest-VolumesSnapshotListTestJSON-1522118082 None] Acquiring lock "cinder-quobyte-d9f99146-94cf-4727-9b71-9e6db47d92fb" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:00:55 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-d99c6f93-a1c3-45de-af86-be5d320eeece tempest-AttachVolumeNegativeTest-115562770 None] Lock "cinder-06496020-bee6-4dfe-995e-27769de85343-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:00:55 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-9248a993-717d-4a46-9fab-46bc0bca7e98 tempest-VolumesSnapshotListTestJSON-1522118082 None] Lock "cinder-quobyte-d9f99146-94cf-4727-9b71-9e6db47d92fb" acquired by "delete_snapshot" :: waited 0.034s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:00:55 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-9248a993-717d-4a46-9fab-46bc0bca7e98 tempest-VolumesSnapshotListTestJSON-1522118082 None] Acquiring lock "cinder-quobyte-5c4aa558-a3ae-43aa-89ca-ae996b683a3a" by "_delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:00:55 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-9248a993-717d-4a46-9fab-46bc0bca7e98 tempest-VolumesSnapshotListTestJSON-1522118082 None] Lock "cinder-quobyte-5c4aa558-a3ae-43aa-89ca-ae996b683a3a" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:00:55 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-9248a993-717d-4a46-9fab-46bc0bca7e98 tempest-VolumesSnapshotListTestJSON-1522118082 None] Deleting offline snapshot 5c4aa558-a3ae-43aa-89ca-ae996b683a3a of volume d9f99146-94cf-4727-9b71-9e6db47d92fb {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 16:00:55 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-9248a993-717d-4a46-9fab-46bc0bca7e98 tempest-VolumesSnapshotListTestJSON-1522118082 None] snapshot_file for this snap is: volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.5c4aa558-a3ae-43aa-89ca-ae996b683a3a {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 16:00:55 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[39bbbce1-f17c-404b-992a-26fa280527e9]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:00:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9248a993-717d-4a46-9fab-46bc0bca7e98 tempest-VolumesSnapshotListTestJSON-1522118082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.5c4aa558-a3ae-43aa-89ca-ae996b683a3a {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:00:55 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-d99c6f93-a1c3-45de-af86-be5d320eeece tempest-AttachVolumeNegativeTest-115562770 None] Acquiring lock "cinder-quobyte-06496020-bee6-4dfe-995e-27769de85343" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:00:55 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-d99c6f93-a1c3-45de-af86-be5d320eeece tempest-AttachVolumeNegativeTest-115562770 None] Lock "cinder-quobyte-06496020-bee6-4dfe-995e-27769de85343" acquired by "delete_volume" :: waited 0.021s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:00:55 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[6834b268-fb3d-4af1-a0df-886d7f2b98dc]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:00:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d99c6f93-a1c3-45de-af86-be5d320eeece tempest-AttachVolumeNegativeTest-115562770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-06496020-bee6-4dfe-995e-27769de85343 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:00:55 devstack sudo[97804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.5c4aa558-a3ae-43aa-89ca-ae996b683a3a Aug 10 16:00:55 devstack sudo[97804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:00:55 devstack sudo[97805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-06496020-bee6-4dfe-995e-27769de85343 Aug 10 16:00:55 devstack sudo[97805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:00:55 devstack sudo[97804]: pam_unix(sudo:session): session closed for user root Aug 10 16:00:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9248a993-717d-4a46-9fab-46bc0bca7e98 tempest-VolumesSnapshotListTestJSON-1522118082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.5c4aa558-a3ae-43aa-89ca-ae996b683a3a" returned: 0 in 0.484s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:00:55 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-9248a993-717d-4a46-9fab-46bc0bca7e98 tempest-VolumesSnapshotListTestJSON-1522118082 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9f99146-94cf-4727-9b71-9e6db47d92fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 16:00:55 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[881cbb62-9ced-4391-bd79-b3eb48152c00]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:00:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9248a993-717d-4a46-9fab-46bc0bca7e98 tempest-VolumesSnapshotListTestJSON-1522118082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:00:55 devstack sudo[97805]: pam_unix(sudo:session): session closed for user root Aug 10 16:00:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d99c6f93-a1c3-45de-af86-be5d320eeece tempest-AttachVolumeNegativeTest-115562770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-06496020-bee6-4dfe-995e-27769de85343" returned: 0 in 0.466s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:00:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d99c6f93-a1c3-45de-af86-be5d320eeece tempest-AttachVolumeNegativeTest-115562770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-06496020-bee6-4dfe-995e-27769de85343 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:00:55 devstack sudo[97815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-06496020-bee6-4dfe-995e-27769de85343 Aug 10 16:00:55 devstack sudo[97815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:00:55 devstack sudo[97814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb Aug 10 16:00:55 devstack sudo[97814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:00:56 devstack sudo[97815]: pam_unix(sudo:session): session closed for user root Aug 10 16:00:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d99c6f93-a1c3-45de-af86-be5d320eeece tempest-AttachVolumeNegativeTest-115562770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-06496020-bee6-4dfe-995e-27769de85343" returned: 0 in 0.278s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:00:56 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-d99c6f93-a1c3-45de-af86-be5d320eeece tempest-AttachVolumeNegativeTest-115562770 None] Lock "cinder-quobyte-06496020-bee6-4dfe-995e-27769de85343" released by "delete_volume" :: held 0.796s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:00:56 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-d99c6f93-a1c3-45de-af86-be5d320eeece tempest-AttachVolumeNegativeTest-115562770 None] Created reservations ['36433b70-8924-4084-b790-6aa1248323f6', '256df69f-d6d3-4ec5-b114-57f13b414705', 'a626c494-f408-44eb-a32c-66f45f5b6ce1', '4b5b15d9-fd65-4507-9188-bbc8f5b67a95'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:00:56 devstack sudo[97814]: pam_unix(sudo:session): session closed for user root Aug 10 16:00:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9248a993-717d-4a46-9fab-46bc0bca7e98 tempest-VolumesSnapshotListTestJSON-1522118082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb" returned: 0 in 0.473s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:00:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9248a993-717d-4a46-9fab-46bc0bca7e98 tempest-VolumesSnapshotListTestJSON-1522118082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.5c4aa558-a3ae-43aa-89ca-ae996b683a3a {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:00:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-d99c6f93-a1c3-45de-af86-be5d320eeece tempest-AttachVolumeNegativeTest-115562770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:00:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-d99c6f93-a1c3-45de-af86-be5d320eeece tempest-AttachVolumeNegativeTest-115562770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:00:56 devstack sudo[97822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.5c4aa558-a3ae-43aa-89ca-ae996b683a3a Aug 10 16:00:56 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-d99c6f93-a1c3-45de-af86-be5d320eeece tempest-AttachVolumeNegativeTest-115562770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:00:56 devstack sudo[97822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:00:56 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-d99c6f93-a1c3-45de-af86-be5d320eeece tempest-AttachVolumeNegativeTest-115562770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:00:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-d99c6f93-a1c3-45de-af86-be5d320eeece tempest-AttachVolumeNegativeTest-115562770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:00:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d99c6f93-a1c3-45de-af86-be5d320eeece tempest-AttachVolumeNegativeTest-115562770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:00:56 devstack sudo[97824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:00:56 devstack sudo[97824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:00:56 devstack sudo[97824]: pam_unix(sudo:session): session closed for user root Aug 10 16:00:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d99c6f93-a1c3-45de-af86-be5d320eeece tempest-AttachVolumeNegativeTest-115562770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.442s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:00:56 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-d99c6f93-a1c3-45de-af86-be5d320eeece tempest-AttachVolumeNegativeTest-115562770 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:00:56 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-d99c6f93-a1c3-45de-af86-be5d320eeece tempest-AttachVolumeNegativeTest-115562770 None] Deleted volume successfully. Aug 10 16:00:56 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-d99c6f93-a1c3-45de-af86-be5d320eeece tempest-AttachVolumeNegativeTest-115562770 None] Lock "cinder-06496020-bee6-4dfe-995e-27769de85343-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:00:56 devstack sudo[97822]: pam_unix(sudo:session): session closed for user root Aug 10 16:00:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9248a993-717d-4a46-9fab-46bc0bca7e98 tempest-VolumesSnapshotListTestJSON-1522118082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.5c4aa558-a3ae-43aa-89ca-ae996b683a3a" returned: 0 in 0.610s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:00:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9248a993-717d-4a46-9fab-46bc0bca7e98 tempest-VolumesSnapshotListTestJSON-1522118082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.5c4aa558-a3ae-43aa-89ca-ae996b683a3a {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:00:56 devstack sudo[97831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.5c4aa558-a3ae-43aa-89ca-ae996b683a3a Aug 10 16:00:56 devstack sudo[97831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:00:57 devstack sudo[97831]: pam_unix(sudo:session): session closed for user root Aug 10 16:00:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9248a993-717d-4a46-9fab-46bc0bca7e98 tempest-VolumesSnapshotListTestJSON-1522118082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb.5c4aa558-a3ae-43aa-89ca-ae996b683a3a" returned: 0 in 0.391s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:00:57 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-9248a993-717d-4a46-9fab-46bc0bca7e98 tempest-VolumesSnapshotListTestJSON-1522118082 None] Lock "cinder-quobyte-5c4aa558-a3ae-43aa-89ca-ae996b683a3a" released by "_delete_snapshot" :: held 2.160s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:00:57 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-9248a993-717d-4a46-9fab-46bc0bca7e98 tempest-VolumesSnapshotListTestJSON-1522118082 None] Lock "cinder-quobyte-d9f99146-94cf-4727-9b71-9e6db47d92fb" released by "delete_snapshot" :: held 2.204s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:00:57 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-9248a993-717d-4a46-9fab-46bc0bca7e98 tempest-VolumesSnapshotListTestJSON-1522118082 None] Created reservations ['9e0bb49f-3a82-4086-a4eb-78e5b19bb668', 'cd1b6fa8-6ca6-4865-839e-dbea31221ac6', '364d0ceb-4e60-4d55-bbdd-bf47eb3d2536', 'c06b1603-2f31-4dd3-86d4-c25528ae2b97'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:00:57 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-5446a730-fe4b-4a2e-9e5c-42afe7edb530 tempest-VolumesMetadataTest-869796022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:00:57 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-5446a730-fe4b-4a2e-9e5c-42afe7edb530 tempest-VolumesMetadataTest-869796022 None] Flow 'volume_create_manager' (878da342-82eb-4de5-a9f4-349a2077c3ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:00:57 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-5446a730-fe4b-4a2e-9e5c-42afe7edb530 tempest-VolumesMetadataTest-869796022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3736bff3-8b7d-40ae-bf63-b6a63dedb587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:00:57 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-5446a730-fe4b-4a2e-9e5c-42afe7edb530 tempest-VolumesMetadataTest-869796022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3736bff3-8b7d-40ae-bf63-b6a63dedb587) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:00:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1088858200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=416ae416-f662-4432-8c3e-31c259aad9b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fc451a755ae4b3abbf28c7ad3b0351a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:00:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:00:58Z,use_quota=True,user_id='19fac12e83e2402e82d446fbc669f3e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:00:57 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-5446a730-fe4b-4a2e-9e5c-42afe7edb530 tempest-VolumesMetadataTest-869796022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (babcfcc7-9344-4e18-a279-edee0b782c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:00:57 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-5446a730-fe4b-4a2e-9e5c-42afe7edb530 tempest-VolumesMetadataTest-869796022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (babcfcc7-9344-4e18-a279-edee0b782c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:00:57 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-5446a730-fe4b-4a2e-9e5c-42afe7edb530 tempest-VolumesMetadataTest-869796022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (380ac20b-ba1c-4131-b04c-dbdd0fe742d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:00:57 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-5446a730-fe4b-4a2e-9e5c-42afe7edb530 tempest-VolumesMetadataTest-869796022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (380ac20b-ba1c-4131-b04c-dbdd0fe742d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '416ae416-f662-4432-8c3e-31c259aad9b1', 'volume_name': 'volume-416ae416-f662-4432-8c3e-31c259aad9b1', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:00:57 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-5446a730-fe4b-4a2e-9e5c-42afe7edb530 tempest-VolumesMetadataTest-869796022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (844c4683-b214-42d0-b93d-ea3da160d10e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:00:57 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-5446a730-fe4b-4a2e-9e5c-42afe7edb530 tempest-VolumesMetadataTest-869796022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (844c4683-b214-42d0-b93d-ea3da160d10e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:00:57 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-5446a730-fe4b-4a2e-9e5c-42afe7edb530 tempest-VolumesMetadataTest-869796022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8265eab1-1755-47f2-9f07-024f30aaa56b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:00:57 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-5446a730-fe4b-4a2e-9e5c-42afe7edb530 tempest-VolumesMetadataTest-869796022 None] Volume 416ae416-f662-4432-8c3e-31c259aad9b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-416ae416-f662-4432-8c3e-31c259aad9b1', 'volume_size': 1} Aug 10 16:00:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-5446a730-fe4b-4a2e-9e5c-42afe7edb530 tempest-VolumesMetadataTest-869796022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:00:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-5446a730-fe4b-4a2e-9e5c-42afe7edb530 tempest-VolumesMetadataTest-869796022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:00:57 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-5446a730-fe4b-4a2e-9e5c-42afe7edb530 tempest-VolumesMetadataTest-869796022 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:00:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1088858200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=416ae416-f662-4432-8c3e-31c259aad9b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fc451a755ae4b3abbf28c7ad3b0351a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:00:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:00:58Z,use_quota=True,user_id='19fac12e83e2402e82d446fbc669f3e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:00:57 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-5446a730-fe4b-4a2e-9e5c-42afe7edb530 tempest-VolumesMetadataTest-869796022 None] Creating volume 416ae416-f662-4432-8c3e-31c259aad9b1 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:00:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-5446a730-fe4b-4a2e-9e5c-42afe7edb530 tempest-VolumesMetadataTest-869796022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:00:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-5446a730-fe4b-4a2e-9e5c-42afe7edb530 tempest-VolumesMetadataTest-869796022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:00:57 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-5446a730-fe4b-4a2e-9e5c-42afe7edb530 tempest-VolumesMetadataTest-869796022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:00:57 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-5446a730-fe4b-4a2e-9e5c-42afe7edb530 tempest-VolumesMetadataTest-869796022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:00:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-5446a730-fe4b-4a2e-9e5c-42afe7edb530 tempest-VolumesMetadataTest-869796022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:00:57 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-5446a730-fe4b-4a2e-9e5c-42afe7edb530 tempest-VolumesMetadataTest-869796022 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:00:57 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-5446a730-fe4b-4a2e-9e5c-42afe7edb530 tempest-VolumesMetadataTest-869796022 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:00:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5446a730-fe4b-4a2e-9e5c-42afe7edb530 tempest-VolumesMetadataTest-869796022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-416ae416-f662-4432-8c3e-31c259aad9b1 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:00:57 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-9248a993-717d-4a46-9fab-46bc0bca7e98 tempest-VolumesSnapshotListTestJSON-1522118082 None] Delete snapshot completed successfully. Aug 10 16:00:57 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-9248a993-717d-4a46-9fab-46bc0bca7e98 tempest-VolumesSnapshotListTestJSON-1522118082 None] Lock "cinder-5c4aa558-a3ae-43aa-89ca-ae996b683a3a-delete_snapshot" released by "delete_snapshot" :: held 2.560s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:00:57 devstack sudo[97834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-416ae416-f662-4432-8c3e-31c259aad9b1 1073741824 Aug 10 16:00:57 devstack sudo[97834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:00:58 devstack sudo[97834]: pam_unix(sudo:session): session closed for user root Aug 10 16:00:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5446a730-fe4b-4a2e-9e5c-42afe7edb530 tempest-VolumesMetadataTest-869796022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-416ae416-f662-4432-8c3e-31c259aad9b1 1073741824" returned: 0 in 0.486s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:00:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5446a730-fe4b-4a2e-9e5c-42afe7edb530 tempest-VolumesMetadataTest-869796022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-416ae416-f662-4432-8c3e-31c259aad9b1 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:00:58 devstack sudo[97840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-416ae416-f662-4432-8c3e-31c259aad9b1 Aug 10 16:00:58 devstack sudo[97840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:00:58 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-65895043-515b-4de0-806c-fad97a0f4016 tempest-VolumesSnapshotListTestJSON-1522118082 None] Acquiring lock "cinder-d9f99146-94cf-4727-9b71-9e6db47d92fb-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:00:58 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-65895043-515b-4de0-806c-fad97a0f4016 tempest-VolumesSnapshotListTestJSON-1522118082 None] Lock "cinder-d9f99146-94cf-4727-9b71-9e6db47d92fb-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:00:58 devstack sudo[97840]: pam_unix(sudo:session): session closed for user root Aug 10 16:00:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5446a730-fe4b-4a2e-9e5c-42afe7edb530 tempest-VolumesMetadataTest-869796022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-416ae416-f662-4432-8c3e-31c259aad9b1" returned: 0 in 0.318s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:00:58 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-5446a730-fe4b-4a2e-9e5c-42afe7edb530 tempest-VolumesMetadataTest-869796022 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:00:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-5446a730-fe4b-4a2e-9e5c-42afe7edb530 tempest-VolumesMetadataTest-869796022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:00:58 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-65895043-515b-4de0-806c-fad97a0f4016 tempest-VolumesSnapshotListTestJSON-1522118082 None] Acquiring lock "cinder-quobyte-d9f99146-94cf-4727-9b71-9e6db47d92fb" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:00:58 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-65895043-515b-4de0-806c-fad97a0f4016 tempest-VolumesSnapshotListTestJSON-1522118082 None] Lock "cinder-quobyte-d9f99146-94cf-4727-9b71-9e6db47d92fb" acquired by "delete_volume" :: waited 0.024s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:00:58 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-5446a730-fe4b-4a2e-9e5c-42afe7edb530 tempest-VolumesMetadataTest-869796022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8265eab1-1755-47f2-9f07-024f30aaa56b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-416ae416-f662-4432-8c3e-31c259aad9b1', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:00:58 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-5446a730-fe4b-4a2e-9e5c-42afe7edb530 tempest-VolumesMetadataTest-869796022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae0e1ab3-d700-4b58-bdbe-15d48307bf71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:00:58 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[1db75678-74c5-4294-a706-394c02c6e62d]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:00:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-65895043-515b-4de0-806c-fad97a0f4016 tempest-VolumesSnapshotListTestJSON-1522118082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:00:58 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-5446a730-fe4b-4a2e-9e5c-42afe7edb530 tempest-VolumesMetadataTest-869796022 None] Volume volume-416ae416-f662-4432-8c3e-31c259aad9b1 (416ae416-f662-4432-8c3e-31c259aad9b1): created successfully Aug 10 16:00:58 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-5446a730-fe4b-4a2e-9e5c-42afe7edb530 tempest-VolumesMetadataTest-869796022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae0e1ab3-d700-4b58-bdbe-15d48307bf71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:00:58 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-5446a730-fe4b-4a2e-9e5c-42afe7edb530 tempest-VolumesMetadataTest-869796022 None] Flow 'volume_create_manager' (878da342-82eb-4de5-a9f4-349a2077c3ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:00:58 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-5446a730-fe4b-4a2e-9e5c-42afe7edb530 tempest-VolumesMetadataTest-869796022 None] Created volume successfully. Aug 10 16:00:58 devstack sudo[97843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb Aug 10 16:00:58 devstack sudo[97843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:00:59 devstack sudo[97843]: pam_unix(sudo:session): session closed for user root Aug 10 16:00:59 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-65895043-515b-4de0-806c-fad97a0f4016 tempest-VolumesSnapshotListTestJSON-1522118082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb" returned: 0 in 0.544s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:00:59 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-65895043-515b-4de0-806c-fad97a0f4016 tempest-VolumesSnapshotListTestJSON-1522118082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:00:59 devstack sudo[97853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb Aug 10 16:00:59 devstack sudo[97853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:00:59 devstack sudo[97853]: pam_unix(sudo:session): session closed for user root Aug 10 16:00:59 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-65895043-515b-4de0-806c-fad97a0f4016 tempest-VolumesSnapshotListTestJSON-1522118082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d9f99146-94cf-4727-9b71-9e6db47d92fb" returned: 0 in 0.360s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:00:59 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-65895043-515b-4de0-806c-fad97a0f4016 tempest-VolumesSnapshotListTestJSON-1522118082 None] Lock "cinder-quobyte-d9f99146-94cf-4727-9b71-9e6db47d92fb" released by "delete_volume" :: held 1.010s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:00:59 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-65895043-515b-4de0-806c-fad97a0f4016 tempest-VolumesSnapshotListTestJSON-1522118082 None] Created reservations ['46a3ee28-923b-45c1-a591-f265df061808', '0abee393-27c4-4ea1-ae50-e1ba70ade1f2', 'e396603b-3510-40d1-9c21-392cd261c298', '422a1c92-8230-40f6-9d44-adfddbe7a3d8'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:00:59 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-65895043-515b-4de0-806c-fad97a0f4016 tempest-VolumesSnapshotListTestJSON-1522118082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:00:59 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-65895043-515b-4de0-806c-fad97a0f4016 tempest-VolumesSnapshotListTestJSON-1522118082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:00:59 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-65895043-515b-4de0-806c-fad97a0f4016 tempest-VolumesSnapshotListTestJSON-1522118082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:00:59 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-65895043-515b-4de0-806c-fad97a0f4016 tempest-VolumesSnapshotListTestJSON-1522118082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:00:59 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-65895043-515b-4de0-806c-fad97a0f4016 tempest-VolumesSnapshotListTestJSON-1522118082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:00:59 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-65895043-515b-4de0-806c-fad97a0f4016 tempest-VolumesSnapshotListTestJSON-1522118082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:00:59 devstack sudo[97880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:00:59 devstack sudo[97880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:01:00 devstack sudo[97880]: pam_unix(sudo:session): session closed for user root Aug 10 16:01:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-65895043-515b-4de0-806c-fad97a0f4016 tempest-VolumesSnapshotListTestJSON-1522118082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.352s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:01:00 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-65895043-515b-4de0-806c-fad97a0f4016 tempest-VolumesSnapshotListTestJSON-1522118082 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:01:00 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-65895043-515b-4de0-806c-fad97a0f4016 tempest-VolumesSnapshotListTestJSON-1522118082 None] Deleted volume successfully. Aug 10 16:01:00 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-65895043-515b-4de0-806c-fad97a0f4016 tempest-VolumesSnapshotListTestJSON-1522118082 None] Lock "cinder-d9f99146-94cf-4727-9b71-9e6db47d92fb-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:01:00 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-1dc925a2-8faa-4a5e-8517-0786d7988672 tempest-VolumesMetadataTest-869796022 None] Acquiring lock "cinder-416ae416-f662-4432-8c3e-31c259aad9b1-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:01:00 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-1dc925a2-8faa-4a5e-8517-0786d7988672 tempest-VolumesMetadataTest-869796022 None] Lock "cinder-416ae416-f662-4432-8c3e-31c259aad9b1-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:01:00 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-1dc925a2-8faa-4a5e-8517-0786d7988672 tempest-VolumesMetadataTest-869796022 None] Acquiring lock "cinder-quobyte-416ae416-f662-4432-8c3e-31c259aad9b1" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:01:00 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-1dc925a2-8faa-4a5e-8517-0786d7988672 tempest-VolumesMetadataTest-869796022 None] Lock "cinder-quobyte-416ae416-f662-4432-8c3e-31c259aad9b1" acquired by "delete_volume" :: waited 0.030s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:01:00 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f58155-af23-451c-bd6a-3560450adc90]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:01:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-1dc925a2-8faa-4a5e-8517-0786d7988672 tempest-VolumesMetadataTest-869796022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-416ae416-f662-4432-8c3e-31c259aad9b1 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:01:01 devstack sudo[97887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-416ae416-f662-4432-8c3e-31c259aad9b1 Aug 10 16:01:01 devstack sudo[97887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:01:01 devstack sudo[97887]: pam_unix(sudo:session): session closed for user root Aug 10 16:01:01 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-1dc925a2-8faa-4a5e-8517-0786d7988672 tempest-VolumesMetadataTest-869796022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-416ae416-f662-4432-8c3e-31c259aad9b1" returned: 0 in 0.542s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:01:01 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-1dc925a2-8faa-4a5e-8517-0786d7988672 tempest-VolumesMetadataTest-869796022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-416ae416-f662-4432-8c3e-31c259aad9b1 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:01:01 devstack sudo[97892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-416ae416-f662-4432-8c3e-31c259aad9b1 Aug 10 16:01:01 devstack sudo[97892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:01:01 devstack sudo[97892]: pam_unix(sudo:session): session closed for user root Aug 10 16:01:01 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-1dc925a2-8faa-4a5e-8517-0786d7988672 tempest-VolumesMetadataTest-869796022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-416ae416-f662-4432-8c3e-31c259aad9b1" returned: 0 in 0.317s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:01:01 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-1dc925a2-8faa-4a5e-8517-0786d7988672 tempest-VolumesMetadataTest-869796022 None] Lock "cinder-quobyte-416ae416-f662-4432-8c3e-31c259aad9b1" released by "delete_volume" :: held 0.923s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:01:01 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-1dc925a2-8faa-4a5e-8517-0786d7988672 tempest-VolumesMetadataTest-869796022 None] Created reservations ['3362338f-e9fa-4a3b-9ac8-aaeac3235cae', '099b0414-b08a-48c1-9b5c-2d87c9e1864f', 'd654dd09-879d-4f26-a2d5-098e3b9d7433', 'd428bd2c-2996-430b-94e6-881cdd2e0eef'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:01:01 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-1dc925a2-8faa-4a5e-8517-0786d7988672 tempest-VolumesMetadataTest-869796022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:01:01 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-1dc925a2-8faa-4a5e-8517-0786d7988672 tempest-VolumesMetadataTest-869796022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:01:01 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-1dc925a2-8faa-4a5e-8517-0786d7988672 tempest-VolumesMetadataTest-869796022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:01:01 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-1dc925a2-8faa-4a5e-8517-0786d7988672 tempest-VolumesMetadataTest-869796022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:01:01 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-1dc925a2-8faa-4a5e-8517-0786d7988672 tempest-VolumesMetadataTest-869796022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:01:01 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-1dc925a2-8faa-4a5e-8517-0786d7988672 tempest-VolumesMetadataTest-869796022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:01:02 devstack sudo[97897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:01:02 devstack sudo[97897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:01:02 devstack sudo[97897]: pam_unix(sudo:session): session closed for user root Aug 10 16:01:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-1dc925a2-8faa-4a5e-8517-0786d7988672 tempest-VolumesMetadataTest-869796022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.276s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:01:02 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-1dc925a2-8faa-4a5e-8517-0786d7988672 tempest-VolumesMetadataTest-869796022 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:01:02 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-1dc925a2-8faa-4a5e-8517-0786d7988672 tempest-VolumesMetadataTest-869796022 None] Deleted volume successfully. Aug 10 16:01:02 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-1dc925a2-8faa-4a5e-8517-0786d7988672 tempest-VolumesMetadataTest-869796022 None] Lock "cinder-416ae416-f662-4432-8c3e-31c259aad9b1-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:01:11 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-51364a9a-81fb-4030-947a-0e297c32a4ea tempest-GroupSnapshotsV319Test-659835532 None] Group tempest-GroupSnapshotsV319Test-Group-284579509: creating Aug 10 16:01:11 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-51364a9a-81fb-4030-947a-0e297c32a4ea tempest-GroupSnapshotsV319Test-659835532 None] Group tempest-GroupSnapshotsV319Test-Group-284579509: created successfully Aug 10 16:01:11 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-51364a9a-81fb-4030-947a-0e297c32a4ea tempest-GroupSnapshotsV319Test-659835532 None] Create group completed successfully. Aug 10 16:01:13 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-88dfa7a6-a53a-4b19-aa5c-275a0546cec3 tempest-GroupSnapshotsV319Test-659835532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:01:13 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-88dfa7a6-a53a-4b19-aa5c-275a0546cec3 tempest-GroupSnapshotsV319Test-659835532 None] Flow 'volume_create_manager' (0d44cefc-4cda-4b53-aecd-ad305ff01a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:01:13 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-88dfa7a6-a53a-4b19-aa5c-275a0546cec3 tempest-GroupSnapshotsV319Test-659835532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27ec216a-d6a4-4d6f-8034-3e3b71649bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:01:13 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-88dfa7a6-a53a-4b19-aa5c-275a0546cec3 tempest-GroupSnapshotsV319Test-659835532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27ec216a-d6a4-4d6f-8034-3e3b71649bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:01:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1452903426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0b0223c3-466e-4bfb-9ace-a8c037b26e52,host='devstack@QuobyteHD#QuobyteHD',id=b64d6405-7a17-41fa-b0e1-ccb57414989a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83f78ef84ecb4d9fa9103167dd3ade99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:01:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:01:13Z,use_quota=True,user_id='bac8f3366dd34aa0bd17369a7c150215',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(875a122b-2d43-440b-831e-bc69eae9382c),volume_type_id=875a122b-2d43-440b-831e-bc69eae9382c)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:01:13 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-88dfa7a6-a53a-4b19-aa5c-275a0546cec3 tempest-GroupSnapshotsV319Test-659835532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (778ec5d6-e23a-4030-8064-f0b8c82aea71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:01:13 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-88dfa7a6-a53a-4b19-aa5c-275a0546cec3 tempest-GroupSnapshotsV319Test-659835532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (778ec5d6-e23a-4030-8064-f0b8c82aea71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:01:13 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-88dfa7a6-a53a-4b19-aa5c-275a0546cec3 tempest-GroupSnapshotsV319Test-659835532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb4ad10e-e2e8-4a7a-87a7-b7afb58358ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:01:13 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-88dfa7a6-a53a-4b19-aa5c-275a0546cec3 tempest-GroupSnapshotsV319Test-659835532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb4ad10e-e2e8-4a7a-87a7-b7afb58358ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b64d6405-7a17-41fa-b0e1-ccb57414989a', 'volume_name': 'volume-b64d6405-7a17-41fa-b0e1-ccb57414989a', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:01:13 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-88dfa7a6-a53a-4b19-aa5c-275a0546cec3 tempest-GroupSnapshotsV319Test-659835532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b6f2d41-1ce5-496e-9840-5402fb68305c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:01:13 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-88dfa7a6-a53a-4b19-aa5c-275a0546cec3 tempest-GroupSnapshotsV319Test-659835532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b6f2d41-1ce5-496e-9840-5402fb68305c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:01:13 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-88dfa7a6-a53a-4b19-aa5c-275a0546cec3 tempest-GroupSnapshotsV319Test-659835532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0fe6eaa-ec6a-4844-b4ca-e138a5ecaf45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:01:13 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-88dfa7a6-a53a-4b19-aa5c-275a0546cec3 tempest-GroupSnapshotsV319Test-659835532 None] Volume b64d6405-7a17-41fa-b0e1-ccb57414989a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b64d6405-7a17-41fa-b0e1-ccb57414989a', 'volume_size': 1} Aug 10 16:01:13 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-88dfa7a6-a53a-4b19-aa5c-275a0546cec3 tempest-GroupSnapshotsV319Test-659835532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:01:13 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-88dfa7a6-a53a-4b19-aa5c-275a0546cec3 tempest-GroupSnapshotsV319Test-659835532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:01:13 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-88dfa7a6-a53a-4b19-aa5c-275a0546cec3 tempest-GroupSnapshotsV319Test-659835532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0b0223c3-466e-4bfb-9ace-a8c037b26e52,created_at=2026-08-10T14:01:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1452903426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0b0223c3-466e-4bfb-9ace-a8c037b26e52,host='devstack@QuobyteHD#QuobyteHD',id=b64d6405-7a17-41fa-b0e1-ccb57414989a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83f78ef84ecb4d9fa9103167dd3ade99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:01:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:01:13Z,use_quota=True,user_id='bac8f3366dd34aa0bd17369a7c150215',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(875a122b-2d43-440b-831e-bc69eae9382c),volume_type_id=875a122b-2d43-440b-831e-bc69eae9382c)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:01:13 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-88dfa7a6-a53a-4b19-aa5c-275a0546cec3 tempest-GroupSnapshotsV319Test-659835532 None] Creating volume b64d6405-7a17-41fa-b0e1-ccb57414989a {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:01:13 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-88dfa7a6-a53a-4b19-aa5c-275a0546cec3 tempest-GroupSnapshotsV319Test-659835532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:01:13 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-88dfa7a6-a53a-4b19-aa5c-275a0546cec3 tempest-GroupSnapshotsV319Test-659835532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:01:13 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-88dfa7a6-a53a-4b19-aa5c-275a0546cec3 tempest-GroupSnapshotsV319Test-659835532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:01:13 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-88dfa7a6-a53a-4b19-aa5c-275a0546cec3 tempest-GroupSnapshotsV319Test-659835532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:01:13 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-88dfa7a6-a53a-4b19-aa5c-275a0546cec3 tempest-GroupSnapshotsV319Test-659835532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:01:13 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-88dfa7a6-a53a-4b19-aa5c-275a0546cec3 tempest-GroupSnapshotsV319Test-659835532 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:01:13 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-88dfa7a6-a53a-4b19-aa5c-275a0546cec3 tempest-GroupSnapshotsV319Test-659835532 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:01:13 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-88dfa7a6-a53a-4b19-aa5c-275a0546cec3 tempest-GroupSnapshotsV319Test-659835532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b64d6405-7a17-41fa-b0e1-ccb57414989a 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:01:13 devstack sudo[97920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b64d6405-7a17-41fa-b0e1-ccb57414989a 1073741824 Aug 10 16:01:13 devstack sudo[97920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:01:14 devstack sudo[97920]: pam_unix(sudo:session): session closed for user root Aug 10 16:01:14 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-88dfa7a6-a53a-4b19-aa5c-275a0546cec3 tempest-GroupSnapshotsV319Test-659835532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b64d6405-7a17-41fa-b0e1-ccb57414989a 1073741824" returned: 0 in 0.516s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:01:14 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-88dfa7a6-a53a-4b19-aa5c-275a0546cec3 tempest-GroupSnapshotsV319Test-659835532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b64d6405-7a17-41fa-b0e1-ccb57414989a {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:01:14 devstack sudo[97926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b64d6405-7a17-41fa-b0e1-ccb57414989a Aug 10 16:01:14 devstack sudo[97926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:01:14 devstack sudo[97926]: pam_unix(sudo:session): session closed for user root Aug 10 16:01:14 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-88dfa7a6-a53a-4b19-aa5c-275a0546cec3 tempest-GroupSnapshotsV319Test-659835532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b64d6405-7a17-41fa-b0e1-ccb57414989a" returned: 0 in 0.296s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:01:14 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-88dfa7a6-a53a-4b19-aa5c-275a0546cec3 tempest-GroupSnapshotsV319Test-659835532 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:01:14 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-88dfa7a6-a53a-4b19-aa5c-275a0546cec3 tempest-GroupSnapshotsV319Test-659835532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:01:14 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-88dfa7a6-a53a-4b19-aa5c-275a0546cec3 tempest-GroupSnapshotsV319Test-659835532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0fe6eaa-ec6a-4844-b4ca-e138a5ecaf45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b64d6405-7a17-41fa-b0e1-ccb57414989a', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:01:14 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-88dfa7a6-a53a-4b19-aa5c-275a0546cec3 tempest-GroupSnapshotsV319Test-659835532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fb536a7-6615-4b85-b48f-3312fe022050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:01:14 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-88dfa7a6-a53a-4b19-aa5c-275a0546cec3 tempest-GroupSnapshotsV319Test-659835532 None] Volume volume-b64d6405-7a17-41fa-b0e1-ccb57414989a (b64d6405-7a17-41fa-b0e1-ccb57414989a): created successfully Aug 10 16:01:14 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-88dfa7a6-a53a-4b19-aa5c-275a0546cec3 tempest-GroupSnapshotsV319Test-659835532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fb536a7-6615-4b85-b48f-3312fe022050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:01:14 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-88dfa7a6-a53a-4b19-aa5c-275a0546cec3 tempest-GroupSnapshotsV319Test-659835532 None] Flow 'volume_create_manager' (0d44cefc-4cda-4b53-aecd-ad305ff01a00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:01:14 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-88dfa7a6-a53a-4b19-aa5c-275a0546cec3 tempest-GroupSnapshotsV319Test-659835532 None] Created volume successfully. Aug 10 16:01:15 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-bc699405-f0e1-4eea-8348-3aa47bc1dc3a tempest-GroupSnapshotsV319Test-659835532 None] GroupSnapshot 9e15a52f-ee5f-4f11-aa06-224c44602b75: creating. Aug 10 16:01:15 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bc699405-f0e1-4eea-8348-3aa47bc1dc3a tempest-GroupSnapshotsV319Test-659835532 None] Group snapshot 9e15a52f-ee5f-4f11-aa06-224c44602b75: creating. {{(pid=88641) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 10 16:01:15 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bc699405-f0e1-4eea-8348-3aa47bc1dc3a tempest-GroupSnapshotsV319Test-659835532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:01:15 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bc699405-f0e1-4eea-8348-3aa47bc1dc3a tempest-GroupSnapshotsV319Test-659835532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:01:15 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-bc699405-f0e1-4eea-8348-3aa47bc1dc3a tempest-GroupSnapshotsV319Test-659835532 None] Creating offline snapshot a7ef747e-843b-48a2-aea5-2407b94edf6c of volume b64d6405-7a17-41fa-b0e1-ccb57414989a {{(pid=88641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 16:01:15 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[acad0e4d-c431-4589-a282-436e07c0bfc6]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:01:15 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bc699405-f0e1-4eea-8348-3aa47bc1dc3a tempest-GroupSnapshotsV319Test-659835532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b64d6405-7a17-41fa-b0e1-ccb57414989a {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:01:15 devstack sudo[97929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b64d6405-7a17-41fa-b0e1-ccb57414989a Aug 10 16:01:15 devstack sudo[97929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:01:15 devstack sudo[97929]: pam_unix(sudo:session): session closed for user root Aug 10 16:01:15 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bc699405-f0e1-4eea-8348-3aa47bc1dc3a tempest-GroupSnapshotsV319Test-659835532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b64d6405-7a17-41fa-b0e1-ccb57414989a" returned: 0 in 0.416s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:01:15 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bc699405-f0e1-4eea-8348-3aa47bc1dc3a tempest-GroupSnapshotsV319Test-659835532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b64d6405-7a17-41fa-b0e1-ccb57414989a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b64d6405-7a17-41fa-b0e1-ccb57414989a.a7ef747e-843b-48a2-aea5-2407b94edf6c 1G {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:01:15 devstack sudo[97935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b64d6405-7a17-41fa-b0e1-ccb57414989a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b64d6405-7a17-41fa-b0e1-ccb57414989a.a7ef747e-843b-48a2-aea5-2407b94edf6c 1G Aug 10 16:01:15 devstack sudo[97935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:01:16 devstack sudo[97935]: pam_unix(sudo:session): session closed for user root Aug 10 16:01:16 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bc699405-f0e1-4eea-8348-3aa47bc1dc3a tempest-GroupSnapshotsV319Test-659835532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b64d6405-7a17-41fa-b0e1-ccb57414989a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b64d6405-7a17-41fa-b0e1-ccb57414989a.a7ef747e-843b-48a2-aea5-2407b94edf6c 1G" returned: 0 in 0.578s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:01:16 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bc699405-f0e1-4eea-8348-3aa47bc1dc3a tempest-GroupSnapshotsV319Test-659835532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b64d6405-7a17-41fa-b0e1-ccb57414989a -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b64d6405-7a17-41fa-b0e1-ccb57414989a.a7ef747e-843b-48a2-aea5-2407b94edf6c {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:01:16 devstack sudo[97941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b64d6405-7a17-41fa-b0e1-ccb57414989a -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b64d6405-7a17-41fa-b0e1-ccb57414989a.a7ef747e-843b-48a2-aea5-2407b94edf6c Aug 10 16:01:16 devstack sudo[97941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:01:16 devstack sudo[97941]: pam_unix(sudo:session): session closed for user root Aug 10 16:01:16 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bc699405-f0e1-4eea-8348-3aa47bc1dc3a tempest-GroupSnapshotsV319Test-659835532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b64d6405-7a17-41fa-b0e1-ccb57414989a -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b64d6405-7a17-41fa-b0e1-ccb57414989a.a7ef747e-843b-48a2-aea5-2407b94edf6c" returned: 0 in 0.505s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:01:16 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-bc699405-f0e1-4eea-8348-3aa47bc1dc3a tempest-GroupSnapshotsV319Test-659835532 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b64d6405-7a17-41fa-b0e1-ccb57414989a.a7ef747e-843b-48a2-aea5-2407b94edf6c is being set with open permissions: ugo+rw: NotImplementedError Aug 10 16:01:16 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bc699405-f0e1-4eea-8348-3aa47bc1dc3a tempest-GroupSnapshotsV319Test-659835532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b64d6405-7a17-41fa-b0e1-ccb57414989a.a7ef747e-843b-48a2-aea5-2407b94edf6c {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:01:16 devstack sudo[97951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b64d6405-7a17-41fa-b0e1-ccb57414989a.a7ef747e-843b-48a2-aea5-2407b94edf6c Aug 10 16:01:16 devstack sudo[97951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:01:17 devstack sudo[97951]: pam_unix(sudo:session): session closed for user root Aug 10 16:01:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bc699405-f0e1-4eea-8348-3aa47bc1dc3a tempest-GroupSnapshotsV319Test-659835532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b64d6405-7a17-41fa-b0e1-ccb57414989a.a7ef747e-843b-48a2-aea5-2407b94edf6c" returned: 0 in 0.469s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:01:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bc699405-f0e1-4eea-8348-3aa47bc1dc3a tempest-GroupSnapshotsV319Test-659835532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b64d6405-7a17-41fa-b0e1-ccb57414989a.info {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:01:17 devstack sudo[97972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b64d6405-7a17-41fa-b0e1-ccb57414989a.info Aug 10 16:01:17 devstack sudo[97972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:01:17 devstack sudo[97972]: pam_unix(sudo:session): session closed for user root Aug 10 16:01:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bc699405-f0e1-4eea-8348-3aa47bc1dc3a tempest-GroupSnapshotsV319Test-659835532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b64d6405-7a17-41fa-b0e1-ccb57414989a.info" returned: 0 in 0.426s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:01:17 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-bc699405-f0e1-4eea-8348-3aa47bc1dc3a tempest-GroupSnapshotsV319Test-659835532 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b64d6405-7a17-41fa-b0e1-ccb57414989a.info is being set with open permissions: ugo+rw: NotImplementedError Aug 10 16:01:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bc699405-f0e1-4eea-8348-3aa47bc1dc3a tempest-GroupSnapshotsV319Test-659835532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b64d6405-7a17-41fa-b0e1-ccb57414989a.info {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:01:17 devstack sudo[97980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b64d6405-7a17-41fa-b0e1-ccb57414989a.info Aug 10 16:01:17 devstack sudo[97980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:01:17 devstack sudo[97980]: pam_unix(sudo:session): session closed for user root Aug 10 16:01:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bc699405-f0e1-4eea-8348-3aa47bc1dc3a tempest-GroupSnapshotsV319Test-659835532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b64d6405-7a17-41fa-b0e1-ccb57414989a.info" returned: 0 in 0.356s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:01:18 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bc699405-f0e1-4eea-8348-3aa47bc1dc3a tempest-GroupSnapshotsV319Test-659835532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.916s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:01:18 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-bc699405-f0e1-4eea-8348-3aa47bc1dc3a tempest-GroupSnapshotsV319Test-659835532 None] group_snapshot 9e15a52f-ee5f-4f11-aa06-224c44602b75: created successfully Aug 10 16:01:18 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-ba210eac-465c-4013-8db8-2e02ff06772d tempest-GroupSnapshotsV319Test-659835532 None] group_snapshot 9e15a52f-ee5f-4f11-aa06-224c44602b75: deleting Aug 10 16:01:18 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-ba210eac-465c-4013-8db8-2e02ff06772d tempest-GroupSnapshotsV319Test-659835532 None] group_snapshot 9e15a52f-ee5f-4f11-aa06-224c44602b75: deleting {{(pid=88641) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 10 16:01:18 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-ba210eac-465c-4013-8db8-2e02ff06772d tempest-GroupSnapshotsV319Test-659835532 None] Acquiring lock "cinder-quobyte-b64d6405-7a17-41fa-b0e1-ccb57414989a" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:01:18 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-ba210eac-465c-4013-8db8-2e02ff06772d tempest-GroupSnapshotsV319Test-659835532 None] Lock "cinder-quobyte-b64d6405-7a17-41fa-b0e1-ccb57414989a" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:01:18 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-ba210eac-465c-4013-8db8-2e02ff06772d tempest-GroupSnapshotsV319Test-659835532 None] Acquiring lock "cinder-quobyte-a7ef747e-843b-48a2-aea5-2407b94edf6c" by "_delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:01:18 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-ba210eac-465c-4013-8db8-2e02ff06772d tempest-GroupSnapshotsV319Test-659835532 None] Lock "cinder-quobyte-a7ef747e-843b-48a2-aea5-2407b94edf6c" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:01:18 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-ba210eac-465c-4013-8db8-2e02ff06772d tempest-GroupSnapshotsV319Test-659835532 None] Deleting offline snapshot a7ef747e-843b-48a2-aea5-2407b94edf6c of volume b64d6405-7a17-41fa-b0e1-ccb57414989a {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 16:01:18 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-ba210eac-465c-4013-8db8-2e02ff06772d tempest-GroupSnapshotsV319Test-659835532 None] snapshot_file for this snap is: volume-b64d6405-7a17-41fa-b0e1-ccb57414989a.a7ef747e-843b-48a2-aea5-2407b94edf6c {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 16:01:18 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed7f6aae-7f60-46d7-bc56-961561a181b5]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:01:18 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ba210eac-465c-4013-8db8-2e02ff06772d tempest-GroupSnapshotsV319Test-659835532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b64d6405-7a17-41fa-b0e1-ccb57414989a.a7ef747e-843b-48a2-aea5-2407b94edf6c {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:01:19 devstack sudo[97985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b64d6405-7a17-41fa-b0e1-ccb57414989a.a7ef747e-843b-48a2-aea5-2407b94edf6c Aug 10 16:01:19 devstack sudo[97985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:01:19 devstack sudo[97985]: pam_unix(sudo:session): session closed for user root Aug 10 16:01:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ba210eac-465c-4013-8db8-2e02ff06772d tempest-GroupSnapshotsV319Test-659835532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b64d6405-7a17-41fa-b0e1-ccb57414989a.a7ef747e-843b-48a2-aea5-2407b94edf6c" returned: 0 in 0.432s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:01:19 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-ba210eac-465c-4013-8db8-2e02ff06772d tempest-GroupSnapshotsV319Test-659835532 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b64d6405-7a17-41fa-b0e1-ccb57414989a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 16:01:19 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5fefec0-98ea-4f34-9bb8-d27fd6fd18a3]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:01:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ba210eac-465c-4013-8db8-2e02ff06772d tempest-GroupSnapshotsV319Test-659835532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b64d6405-7a17-41fa-b0e1-ccb57414989a {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:01:19 devstack sudo[97990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b64d6405-7a17-41fa-b0e1-ccb57414989a Aug 10 16:01:19 devstack sudo[97990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:01:19 devstack sudo[97990]: pam_unix(sudo:session): session closed for user root Aug 10 16:01:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ba210eac-465c-4013-8db8-2e02ff06772d tempest-GroupSnapshotsV319Test-659835532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b64d6405-7a17-41fa-b0e1-ccb57414989a" returned: 0 in 0.477s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:01:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ba210eac-465c-4013-8db8-2e02ff06772d tempest-GroupSnapshotsV319Test-659835532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b64d6405-7a17-41fa-b0e1-ccb57414989a.a7ef747e-843b-48a2-aea5-2407b94edf6c {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:01:19 devstack sudo[97995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b64d6405-7a17-41fa-b0e1-ccb57414989a.a7ef747e-843b-48a2-aea5-2407b94edf6c Aug 10 16:01:19 devstack sudo[97995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:01:20 devstack sudo[97995]: pam_unix(sudo:session): session closed for user root Aug 10 16:01:20 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ba210eac-465c-4013-8db8-2e02ff06772d tempest-GroupSnapshotsV319Test-659835532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b64d6405-7a17-41fa-b0e1-ccb57414989a.a7ef747e-843b-48a2-aea5-2407b94edf6c" returned: 0 in 0.417s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:01:20 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ba210eac-465c-4013-8db8-2e02ff06772d tempest-GroupSnapshotsV319Test-659835532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b64d6405-7a17-41fa-b0e1-ccb57414989a.a7ef747e-843b-48a2-aea5-2407b94edf6c {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:01:20 devstack sudo[98000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b64d6405-7a17-41fa-b0e1-ccb57414989a.a7ef747e-843b-48a2-aea5-2407b94edf6c Aug 10 16:01:20 devstack sudo[98000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:01:20 devstack sudo[98000]: pam_unix(sudo:session): session closed for user root Aug 10 16:01:20 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ba210eac-465c-4013-8db8-2e02ff06772d tempest-GroupSnapshotsV319Test-659835532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b64d6405-7a17-41fa-b0e1-ccb57414989a.a7ef747e-843b-48a2-aea5-2407b94edf6c" returned: 0 in 0.292s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:01:20 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-ba210eac-465c-4013-8db8-2e02ff06772d tempest-GroupSnapshotsV319Test-659835532 None] Lock "cinder-quobyte-a7ef747e-843b-48a2-aea5-2407b94edf6c" released by "_delete_snapshot" :: held 1.786s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:01:20 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-ba210eac-465c-4013-8db8-2e02ff06772d tempest-GroupSnapshotsV319Test-659835532 None] Lock "cinder-quobyte-b64d6405-7a17-41fa-b0e1-ccb57414989a" released by "delete_snapshot" :: held 1.821s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:01:20 devstack cinder-volume[88641]: WARNING cinder.quota [None req-ba210eac-465c-4013-8db8-2e02ff06772d tempest-GroupSnapshotsV319Test-659835532 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2133675190 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2133675190, it is now deprecated. Please use the default quota class for default quota. Aug 10 16:01:20 devstack cinder-volume[88641]: WARNING cinder.quota [None req-ba210eac-465c-4013-8db8-2e02ff06772d tempest-GroupSnapshotsV319Test-659835532 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-2133675190 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-2133675190, it is now deprecated. Please use the default quota class for default quota. Aug 10 16:01:20 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-ba210eac-465c-4013-8db8-2e02ff06772d tempest-GroupSnapshotsV319Test-659835532 None] Created reservations ['462ffcb0-2664-4035-82c4-89a0a6fce9ef', 'e5ce2409-8f65-4bfa-b44b-7cd75fa88674', '30060d04-b1db-4196-b115-4d2429dcab00', '4018d06e-2fe4-4d65-958b-d89eb97e5c99'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:01:20 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-ba210eac-465c-4013-8db8-2e02ff06772d tempest-GroupSnapshotsV319Test-659835532 None] group_snapshot 9e15a52f-ee5f-4f11-aa06-224c44602b75: deleted successfully Aug 10 16:01:21 devstack cinder-volume[88641]: INFO cinder.volume.manager [req-db6f60cc-32ef-43ca-9adb-b60f8bc885e3 req-0f0849bf-d500-4a90-b0d5-bb521d0bb464 tempest-ServerActionsTestOtherA-603942358 None] Terminate volume connection completed successfully. Aug 10 16:01:21 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [req-db6f60cc-32ef-43ca-9adb-b60f8bc885e3 req-0f0849bf-d500-4a90-b0d5-bb521d0bb464 tempest-ServerActionsTestOtherA-603942358 None] Deleting attachment f5d1ea10-964c-412d-860c-4a184fee3cb4. {{(pid=88641) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 10 16:01:21 devstack cinder-volume[88641]: DEBUG cinder.coordination [req-db6f60cc-32ef-43ca-9adb-b60f8bc885e3 req-283ddcc7-0991-4806-9dde-851bea5a103c tempest-ServerActionsTestOtherA-603942358 None] Acquiring lock "cinder-50d4e265-39fd-46c6-9b38-06971e2c547f-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:01:21 devstack cinder-volume[88641]: DEBUG cinder.coordination [req-db6f60cc-32ef-43ca-9adb-b60f8bc885e3 req-283ddcc7-0991-4806-9dde-851bea5a103c tempest-ServerActionsTestOtherA-603942358 None] Lock "cinder-50d4e265-39fd-46c6-9b38-06971e2c547f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:01:21 devstack cinder-volume[88641]: DEBUG cinder.coordination [req-db6f60cc-32ef-43ca-9adb-b60f8bc885e3 req-283ddcc7-0991-4806-9dde-851bea5a103c tempest-ServerActionsTestOtherA-603942358 None] Acquiring lock "cinder-quobyte-50d4e265-39fd-46c6-9b38-06971e2c547f" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:01:21 devstack cinder-volume[88641]: DEBUG cinder.coordination [req-db6f60cc-32ef-43ca-9adb-b60f8bc885e3 req-283ddcc7-0991-4806-9dde-851bea5a103c tempest-ServerActionsTestOtherA-603942358 None] Lock "cinder-quobyte-50d4e265-39fd-46c6-9b38-06971e2c547f" acquired by "delete_volume" :: waited 0.019s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:01:21 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e3f652-1b73-4b9c-8fa3-2f14c0354047]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:01:21 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [req-db6f60cc-32ef-43ca-9adb-b60f8bc885e3 req-283ddcc7-0991-4806-9dde-851bea5a103c tempest-ServerActionsTestOtherA-603942358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-50d4e265-39fd-46c6-9b38-06971e2c547f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:01:21 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-7c01b9cc-278e-424a-bf8e-05ac1b7962e3 tempest-GroupSnapshotsV319Test-659835532 None] Acquiring lock "cinder-quobyte-b64d6405-7a17-41fa-b0e1-ccb57414989a" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:01:21 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-7c01b9cc-278e-424a-bf8e-05ac1b7962e3 tempest-GroupSnapshotsV319Test-659835532 None] Lock "cinder-quobyte-b64d6405-7a17-41fa-b0e1-ccb57414989a" acquired by "delete_volume" :: waited 0.038s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:01:21 devstack sudo[98007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-50d4e265-39fd-46c6-9b38-06971e2c547f Aug 10 16:01:21 devstack sudo[98007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:01:21 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[6915f4d4-e341-4407-a4fd-ad273891ccb0]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:01:21 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7c01b9cc-278e-424a-bf8e-05ac1b7962e3 tempest-GroupSnapshotsV319Test-659835532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b64d6405-7a17-41fa-b0e1-ccb57414989a {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:01:22 devstack sudo[98009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b64d6405-7a17-41fa-b0e1-ccb57414989a Aug 10 16:01:22 devstack sudo[98009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:01:22 devstack sudo[98007]: pam_unix(sudo:session): session closed for user root Aug 10 16:01:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [req-db6f60cc-32ef-43ca-9adb-b60f8bc885e3 req-283ddcc7-0991-4806-9dde-851bea5a103c tempest-ServerActionsTestOtherA-603942358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-50d4e265-39fd-46c6-9b38-06971e2c547f" returned: 0 in 0.624s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:01:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [req-db6f60cc-32ef-43ca-9adb-b60f8bc885e3 req-283ddcc7-0991-4806-9dde-851bea5a103c tempest-ServerActionsTestOtherA-603942358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-50d4e265-39fd-46c6-9b38-06971e2c547f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:01:22 devstack sudo[98014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-50d4e265-39fd-46c6-9b38-06971e2c547f Aug 10 16:01:22 devstack sudo[98014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:01:22 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-995a91ca-5fc5-49a7-9c61-8ae7edf872e2 tempest-ServerActionsTestOtherA-603942358 None] Acquiring lock "cinder-93d9738d-5344-4405-b96b-e31d4c227d5f-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:01:22 devstack sudo[98009]: pam_unix(sudo:session): session closed for user root Aug 10 16:01:22 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-995a91ca-5fc5-49a7-9c61-8ae7edf872e2 tempest-ServerActionsTestOtherA-603942358 None] Lock "cinder-93d9738d-5344-4405-b96b-e31d4c227d5f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:01:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7c01b9cc-278e-424a-bf8e-05ac1b7962e3 tempest-GroupSnapshotsV319Test-659835532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b64d6405-7a17-41fa-b0e1-ccb57414989a" returned: 0 in 0.675s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:01:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7c01b9cc-278e-424a-bf8e-05ac1b7962e3 tempest-GroupSnapshotsV319Test-659835532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b64d6405-7a17-41fa-b0e1-ccb57414989a {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:01:22 devstack sudo[98014]: pam_unix(sudo:session): session closed for user root Aug 10 16:01:22 devstack sudo[98020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b64d6405-7a17-41fa-b0e1-ccb57414989a Aug 10 16:01:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [req-db6f60cc-32ef-43ca-9adb-b60f8bc885e3 req-283ddcc7-0991-4806-9dde-851bea5a103c tempest-ServerActionsTestOtherA-603942358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-50d4e265-39fd-46c6-9b38-06971e2c547f" returned: 0 in 0.402s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:01:22 devstack sudo[98020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:01:22 devstack cinder-volume[88641]: DEBUG cinder.coordination [req-db6f60cc-32ef-43ca-9adb-b60f8bc885e3 req-283ddcc7-0991-4806-9dde-851bea5a103c tempest-ServerActionsTestOtherA-603942358 None] Lock "cinder-quobyte-50d4e265-39fd-46c6-9b38-06971e2c547f" released by "delete_volume" :: held 1.106s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:01:22 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-995a91ca-5fc5-49a7-9c61-8ae7edf872e2 tempest-ServerActionsTestOtherA-603942358 None] Acquiring lock "cinder-quobyte-93d9738d-5344-4405-b96b-e31d4c227d5f" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:01:22 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-995a91ca-5fc5-49a7-9c61-8ae7edf872e2 tempest-ServerActionsTestOtherA-603942358 None] Lock "cinder-quobyte-93d9738d-5344-4405-b96b-e31d4c227d5f" acquired by "delete_volume" :: waited 0.030s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:01:22 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[174ebf4e-a227-4af0-bb9b-d713bd20a774]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:01:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-995a91ca-5fc5-49a7-9c61-8ae7edf872e2 tempest-ServerActionsTestOtherA-603942358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-93d9738d-5344-4405-b96b-e31d4c227d5f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:01:22 devstack cinder-volume[88641]: DEBUG cinder.quota [req-db6f60cc-32ef-43ca-9adb-b60f8bc885e3 req-283ddcc7-0991-4806-9dde-851bea5a103c tempest-ServerActionsTestOtherA-603942358 None] Created reservations ['80e31103-0fc2-42e8-9033-a06281d8149a', '5f6a0b6a-63e9-46b5-a3b3-abd4feda0616', '99e88664-013b-410a-968a-b65f36143603', 'f2bed683-7616-4373-8129-641b6f0716db'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:01:23 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-db6f60cc-32ef-43ca-9adb-b60f8bc885e3 req-283ddcc7-0991-4806-9dde-851bea5a103c tempest-ServerActionsTestOtherA-603942358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:01:23 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-db6f60cc-32ef-43ca-9adb-b60f8bc885e3 req-283ddcc7-0991-4806-9dde-851bea5a103c tempest-ServerActionsTestOtherA-603942358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:01:23 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [req-db6f60cc-32ef-43ca-9adb-b60f8bc885e3 req-283ddcc7-0991-4806-9dde-851bea5a103c tempest-ServerActionsTestOtherA-603942358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:01:23 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [req-db6f60cc-32ef-43ca-9adb-b60f8bc885e3 req-283ddcc7-0991-4806-9dde-851bea5a103c tempest-ServerActionsTestOtherA-603942358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:01:23 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-db6f60cc-32ef-43ca-9adb-b60f8bc885e3 req-283ddcc7-0991-4806-9dde-851bea5a103c tempest-ServerActionsTestOtherA-603942358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:01:23 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [req-db6f60cc-32ef-43ca-9adb-b60f8bc885e3 req-283ddcc7-0991-4806-9dde-851bea5a103c tempest-ServerActionsTestOtherA-603942358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:01:23 devstack sudo[98022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-93d9738d-5344-4405-b96b-e31d4c227d5f Aug 10 16:01:23 devstack sudo[98022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:01:23 devstack sudo[98025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:01:23 devstack sudo[98025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:01:23 devstack sudo[98020]: pam_unix(sudo:session): session closed for user root Aug 10 16:01:23 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7c01b9cc-278e-424a-bf8e-05ac1b7962e3 tempest-GroupSnapshotsV319Test-659835532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b64d6405-7a17-41fa-b0e1-ccb57414989a" returned: 0 in 0.548s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:01:23 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-7c01b9cc-278e-424a-bf8e-05ac1b7962e3 tempest-GroupSnapshotsV319Test-659835532 None] Lock "cinder-quobyte-b64d6405-7a17-41fa-b0e1-ccb57414989a" released by "delete_volume" :: held 1.376s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:01:23 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-7c01b9cc-278e-424a-bf8e-05ac1b7962e3 tempest-GroupSnapshotsV319Test-659835532 None] Created reservations ['cff1c047-3681-4e7e-90d1-69123f782ba9'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:01:23 devstack cinder-volume[88641]: WARNING cinder.quota [None req-7c01b9cc-278e-424a-bf8e-05ac1b7962e3 tempest-GroupSnapshotsV319Test-659835532 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-2133675190 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-2133675190, it is now deprecated. Please use the default quota class for default quota. Aug 10 16:01:23 devstack sudo[98025]: pam_unix(sudo:session): session closed for user root Aug 10 16:01:23 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [req-db6f60cc-32ef-43ca-9adb-b60f8bc885e3 req-283ddcc7-0991-4806-9dde-851bea5a103c tempest-ServerActionsTestOtherA-603942358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.468s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:01:23 devstack cinder-volume[88641]: DEBUG cinder.manager [req-db6f60cc-32ef-43ca-9adb-b60f8bc885e3 req-283ddcc7-0991-4806-9dde-851bea5a103c tempest-ServerActionsTestOtherA-603942358 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:01:23 devstack cinder-volume[88641]: INFO cinder.volume.manager [req-db6f60cc-32ef-43ca-9adb-b60f8bc885e3 req-283ddcc7-0991-4806-9dde-851bea5a103c tempest-ServerActionsTestOtherA-603942358 None] Deleted volume successfully. Aug 10 16:01:23 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-7c01b9cc-278e-424a-bf8e-05ac1b7962e3 tempest-GroupSnapshotsV319Test-659835532 None] Created reservations ['4d204758-1ad1-44d8-ada2-65ddeea1712e', '5510bb3f-8b6b-4220-965f-e27869ab8ebc', 'ca2294b8-3ada-49ec-8557-2a2ed4e9ae4b', 'b665e03c-a2de-466d-aae6-48f4a0bd66cf'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:01:23 devstack cinder-volume[88641]: DEBUG cinder.coordination [req-db6f60cc-32ef-43ca-9adb-b60f8bc885e3 req-283ddcc7-0991-4806-9dde-851bea5a103c tempest-ServerActionsTestOtherA-603942358 None] Lock "cinder-50d4e265-39fd-46c6-9b38-06971e2c547f-delete_volume" released by "delete_volume" :: held 2.008s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:01:23 devstack sudo[98022]: pam_unix(sudo:session): session closed for user root Aug 10 16:01:23 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-995a91ca-5fc5-49a7-9c61-8ae7edf872e2 tempest-ServerActionsTestOtherA-603942358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-93d9738d-5344-4405-b96b-e31d4c227d5f" returned: 0 in 0.805s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:01:23 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-995a91ca-5fc5-49a7-9c61-8ae7edf872e2 tempest-ServerActionsTestOtherA-603942358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-93d9738d-5344-4405-b96b-e31d4c227d5f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:01:23 devstack sudo[98031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-93d9738d-5344-4405-b96b-e31d4c227d5f Aug 10 16:01:23 devstack sudo[98031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:01:23 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-7c01b9cc-278e-424a-bf8e-05ac1b7962e3 tempest-GroupSnapshotsV319Test-659835532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:01:23 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-7c01b9cc-278e-424a-bf8e-05ac1b7962e3 tempest-GroupSnapshotsV319Test-659835532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:01:23 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-7c01b9cc-278e-424a-bf8e-05ac1b7962e3 tempest-GroupSnapshotsV319Test-659835532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:01:23 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-7c01b9cc-278e-424a-bf8e-05ac1b7962e3 tempest-GroupSnapshotsV319Test-659835532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:01:23 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-7c01b9cc-278e-424a-bf8e-05ac1b7962e3 tempest-GroupSnapshotsV319Test-659835532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:01:23 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7c01b9cc-278e-424a-bf8e-05ac1b7962e3 tempest-GroupSnapshotsV319Test-659835532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:01:23 devstack sudo[98034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:01:23 devstack sudo[98034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:01:23 devstack sudo[98031]: pam_unix(sudo:session): session closed for user root Aug 10 16:01:23 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-995a91ca-5fc5-49a7-9c61-8ae7edf872e2 tempest-ServerActionsTestOtherA-603942358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-93d9738d-5344-4405-b96b-e31d4c227d5f" returned: 0 in 0.384s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:01:23 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-995a91ca-5fc5-49a7-9c61-8ae7edf872e2 tempest-ServerActionsTestOtherA-603942358 None] Lock "cinder-quobyte-93d9738d-5344-4405-b96b-e31d4c227d5f" released by "delete_volume" :: held 1.254s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:01:24 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-995a91ca-5fc5-49a7-9c61-8ae7edf872e2 tempest-ServerActionsTestOtherA-603942358 None] Created reservations ['600d361b-013f-4fa9-b1f2-516c155f402b', '0b0f4ae7-28f9-48a1-8396-8fa71fe44d79', '152d4de0-47e6-4b24-a5ef-866ccfdce6f8', '888a78e0-3a94-48f9-9a5e-4ebaba19bcee'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:01:24 devstack sudo[98034]: pam_unix(sudo:session): session closed for user root Aug 10 16:01:24 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7c01b9cc-278e-424a-bf8e-05ac1b7962e3 tempest-GroupSnapshotsV319Test-659835532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.403s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:01:24 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-7c01b9cc-278e-424a-bf8e-05ac1b7962e3 tempest-GroupSnapshotsV319Test-659835532 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:01:24 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-7c01b9cc-278e-424a-bf8e-05ac1b7962e3 tempest-GroupSnapshotsV319Test-659835532 None] Delete group completed successfully. Aug 10 16:01:24 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-995a91ca-5fc5-49a7-9c61-8ae7edf872e2 tempest-ServerActionsTestOtherA-603942358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:01:24 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-995a91ca-5fc5-49a7-9c61-8ae7edf872e2 tempest-ServerActionsTestOtherA-603942358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:01:24 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-995a91ca-5fc5-49a7-9c61-8ae7edf872e2 tempest-ServerActionsTestOtherA-603942358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:01:24 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-995a91ca-5fc5-49a7-9c61-8ae7edf872e2 tempest-ServerActionsTestOtherA-603942358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:01:24 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-995a91ca-5fc5-49a7-9c61-8ae7edf872e2 tempest-ServerActionsTestOtherA-603942358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:01:24 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-995a91ca-5fc5-49a7-9c61-8ae7edf872e2 tempest-ServerActionsTestOtherA-603942358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:01:24 devstack sudo[98038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:01:24 devstack sudo[98038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:01:24 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-b69e1e59-e2db-4b7b-a7e4-d565280fb96c tempest-VolumesSnapshotTestJSON-1988768782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:01:24 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b69e1e59-e2db-4b7b-a7e4-d565280fb96c tempest-VolumesSnapshotTestJSON-1988768782 None] Flow 'volume_create_manager' (bfe6bd9b-b5ba-4510-b230-7a259a7502c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:01:24 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b69e1e59-e2db-4b7b-a7e4-d565280fb96c tempest-VolumesSnapshotTestJSON-1988768782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66b527fc-fa45-4631-a40d-bc0b7a7f818f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:01:24 devstack sudo[98038]: pam_unix(sudo:session): session closed for user root Aug 10 16:01:24 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b69e1e59-e2db-4b7b-a7e4-d565280fb96c tempest-VolumesSnapshotTestJSON-1988768782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66b527fc-fa45-4631-a40d-bc0b7a7f818f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:01:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-179597280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49e06805-d9a5-43ab-bef5-70b59b973297,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e124169510854def88c000087030eef2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:01:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:01:24Z,use_quota=True,user_id='e195aeff14b5481ab42226aff1e44cd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:01:24 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b69e1e59-e2db-4b7b-a7e4-d565280fb96c tempest-VolumesSnapshotTestJSON-1988768782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f774f95b-c24d-4efc-a1b8-f2d6a51efda4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:01:24 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b69e1e59-e2db-4b7b-a7e4-d565280fb96c tempest-VolumesSnapshotTestJSON-1988768782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f774f95b-c24d-4efc-a1b8-f2d6a51efda4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:01:24 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b69e1e59-e2db-4b7b-a7e4-d565280fb96c tempest-VolumesSnapshotTestJSON-1988768782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da9e3a14-ff6a-4138-9bf0-b86ed5d28e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:01:24 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b69e1e59-e2db-4b7b-a7e4-d565280fb96c tempest-VolumesSnapshotTestJSON-1988768782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da9e3a14-ff6a-4138-9bf0-b86ed5d28e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49e06805-d9a5-43ab-bef5-70b59b973297', 'volume_name': 'volume-49e06805-d9a5-43ab-bef5-70b59b973297', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:01:24 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b69e1e59-e2db-4b7b-a7e4-d565280fb96c tempest-VolumesSnapshotTestJSON-1988768782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f6ae922-2f2d-4c8c-8668-35b50ce9e554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:01:24 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b69e1e59-e2db-4b7b-a7e4-d565280fb96c tempest-VolumesSnapshotTestJSON-1988768782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f6ae922-2f2d-4c8c-8668-35b50ce9e554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:01:24 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b69e1e59-e2db-4b7b-a7e4-d565280fb96c tempest-VolumesSnapshotTestJSON-1988768782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ca8ef54-93d3-4ebd-8dc5-1c3f6fcfac33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:01:24 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-b69e1e59-e2db-4b7b-a7e4-d565280fb96c tempest-VolumesSnapshotTestJSON-1988768782 None] Volume 49e06805-d9a5-43ab-bef5-70b59b973297: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49e06805-d9a5-43ab-bef5-70b59b973297', 'volume_size': 1} Aug 10 16:01:24 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-b69e1e59-e2db-4b7b-a7e4-d565280fb96c tempest-VolumesSnapshotTestJSON-1988768782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:01:24 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-b69e1e59-e2db-4b7b-a7e4-d565280fb96c tempest-VolumesSnapshotTestJSON-1988768782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:01:24 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-b69e1e59-e2db-4b7b-a7e4-d565280fb96c tempest-VolumesSnapshotTestJSON-1988768782 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:01:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-179597280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49e06805-d9a5-43ab-bef5-70b59b973297,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e124169510854def88c000087030eef2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:01:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:01:24Z,use_quota=True,user_id='e195aeff14b5481ab42226aff1e44cd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:01:24 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-b69e1e59-e2db-4b7b-a7e4-d565280fb96c tempest-VolumesSnapshotTestJSON-1988768782 None] Creating volume 49e06805-d9a5-43ab-bef5-70b59b973297 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:01:24 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-b69e1e59-e2db-4b7b-a7e4-d565280fb96c tempest-VolumesSnapshotTestJSON-1988768782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:01:24 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-b69e1e59-e2db-4b7b-a7e4-d565280fb96c tempest-VolumesSnapshotTestJSON-1988768782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:01:24 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-b69e1e59-e2db-4b7b-a7e4-d565280fb96c tempest-VolumesSnapshotTestJSON-1988768782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:01:24 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-b69e1e59-e2db-4b7b-a7e4-d565280fb96c tempest-VolumesSnapshotTestJSON-1988768782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:01:24 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-b69e1e59-e2db-4b7b-a7e4-d565280fb96c tempest-VolumesSnapshotTestJSON-1988768782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:01:24 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-b69e1e59-e2db-4b7b-a7e4-d565280fb96c tempest-VolumesSnapshotTestJSON-1988768782 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:01:24 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-b69e1e59-e2db-4b7b-a7e4-d565280fb96c tempest-VolumesSnapshotTestJSON-1988768782 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:01:24 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b69e1e59-e2db-4b7b-a7e4-d565280fb96c tempest-VolumesSnapshotTestJSON-1988768782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-49e06805-d9a5-43ab-bef5-70b59b973297 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:01:24 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-995a91ca-5fc5-49a7-9c61-8ae7edf872e2 tempest-ServerActionsTestOtherA-603942358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.370s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:01:24 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-995a91ca-5fc5-49a7-9c61-8ae7edf872e2 tempest-ServerActionsTestOtherA-603942358 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:01:24 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-995a91ca-5fc5-49a7-9c61-8ae7edf872e2 tempest-ServerActionsTestOtherA-603942358 None] Deleted volume successfully. Aug 10 16:01:24 devstack sudo[98041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-49e06805-d9a5-43ab-bef5-70b59b973297 1073741824 Aug 10 16:01:24 devstack sudo[98041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:01:24 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-995a91ca-5fc5-49a7-9c61-8ae7edf872e2 tempest-ServerActionsTestOtherA-603942358 None] Lock "cinder-93d9738d-5344-4405-b96b-e31d4c227d5f-delete_volume" released by "delete_volume" :: held 2.019s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:01:25 devstack sudo[98041]: pam_unix(sudo:session): session closed for user root Aug 10 16:01:25 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b69e1e59-e2db-4b7b-a7e4-d565280fb96c tempest-VolumesSnapshotTestJSON-1988768782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-49e06805-d9a5-43ab-bef5-70b59b973297 1073741824" returned: 0 in 0.722s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:01:25 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b69e1e59-e2db-4b7b-a7e4-d565280fb96c tempest-VolumesSnapshotTestJSON-1988768782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-49e06805-d9a5-43ab-bef5-70b59b973297 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:01:25 devstack sudo[98049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-49e06805-d9a5-43ab-bef5-70b59b973297 Aug 10 16:01:25 devstack sudo[98049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:01:25 devstack sudo[98049]: pam_unix(sudo:session): session closed for user root Aug 10 16:01:25 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b69e1e59-e2db-4b7b-a7e4-d565280fb96c tempest-VolumesSnapshotTestJSON-1988768782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-49e06805-d9a5-43ab-bef5-70b59b973297" returned: 0 in 0.334s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:01:25 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-b69e1e59-e2db-4b7b-a7e4-d565280fb96c tempest-VolumesSnapshotTestJSON-1988768782 None] <== create_volume: return (1129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:01:25 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-b69e1e59-e2db-4b7b-a7e4-d565280fb96c tempest-VolumesSnapshotTestJSON-1988768782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.132s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:01:25 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b69e1e59-e2db-4b7b-a7e4-d565280fb96c tempest-VolumesSnapshotTestJSON-1988768782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ca8ef54-93d3-4ebd-8dc5-1c3f6fcfac33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49e06805-d9a5-43ab-bef5-70b59b973297', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:01:25 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b69e1e59-e2db-4b7b-a7e4-d565280fb96c tempest-VolumesSnapshotTestJSON-1988768782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f5b73bc-95ed-45b5-ac5f-6a2c814004f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:01:25 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-b69e1e59-e2db-4b7b-a7e4-d565280fb96c tempest-VolumesSnapshotTestJSON-1988768782 None] Volume volume-49e06805-d9a5-43ab-bef5-70b59b973297 (49e06805-d9a5-43ab-bef5-70b59b973297): created successfully Aug 10 16:01:25 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b69e1e59-e2db-4b7b-a7e4-d565280fb96c tempest-VolumesSnapshotTestJSON-1988768782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f5b73bc-95ed-45b5-ac5f-6a2c814004f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:01:25 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b69e1e59-e2db-4b7b-a7e4-d565280fb96c tempest-VolumesSnapshotTestJSON-1988768782 None] Flow 'volume_create_manager' (bfe6bd9b-b5ba-4510-b230-7a259a7502c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:01:25 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-b69e1e59-e2db-4b7b-a7e4-d565280fb96c tempest-VolumesSnapshotTestJSON-1988768782 None] Created volume successfully. Aug 10 16:01:26 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-1579fb93-f572-41ab-bccf-ee70b6cc2e1a tempest-VolumesSnapshotTestJSON-1988768782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:01:26 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-1579fb93-f572-41ab-bccf-ee70b6cc2e1a tempest-VolumesSnapshotTestJSON-1988768782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:01:26 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-1579fb93-f572-41ab-bccf-ee70b6cc2e1a tempest-VolumesSnapshotTestJSON-1988768782 None] Creating offline snapshot 15720718-a59d-48ad-a7b4-f151308c49f0 of volume 49e06805-d9a5-43ab-bef5-70b59b973297 {{(pid=88641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 16:01:26 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[778f898d-1c75-491b-9f55-755028872640]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:01:26 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-1579fb93-f572-41ab-bccf-ee70b6cc2e1a tempest-VolumesSnapshotTestJSON-1988768782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-49e06805-d9a5-43ab-bef5-70b59b973297 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:01:27 devstack sudo[98076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-49e06805-d9a5-43ab-bef5-70b59b973297 Aug 10 16:01:27 devstack sudo[98076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:01:27 devstack sudo[98076]: pam_unix(sudo:session): session closed for user root Aug 10 16:01:27 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-1579fb93-f572-41ab-bccf-ee70b6cc2e1a tempest-VolumesSnapshotTestJSON-1988768782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-49e06805-d9a5-43ab-bef5-70b59b973297" returned: 0 in 0.435s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:01:27 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-1579fb93-f572-41ab-bccf-ee70b6cc2e1a tempest-VolumesSnapshotTestJSON-1988768782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-49e06805-d9a5-43ab-bef5-70b59b973297,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-49e06805-d9a5-43ab-bef5-70b59b973297.15720718-a59d-48ad-a7b4-f151308c49f0 1G {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:01:27 devstack sudo[98081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-49e06805-d9a5-43ab-bef5-70b59b973297,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-49e06805-d9a5-43ab-bef5-70b59b973297.15720718-a59d-48ad-a7b4-f151308c49f0 1G Aug 10 16:01:27 devstack sudo[98081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:01:27 devstack sudo[98081]: pam_unix(sudo:session): session closed for user root Aug 10 16:01:27 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-1579fb93-f572-41ab-bccf-ee70b6cc2e1a tempest-VolumesSnapshotTestJSON-1988768782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-49e06805-d9a5-43ab-bef5-70b59b973297,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-49e06805-d9a5-43ab-bef5-70b59b973297.15720718-a59d-48ad-a7b4-f151308c49f0 1G" returned: 0 in 0.571s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:01:27 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-1579fb93-f572-41ab-bccf-ee70b6cc2e1a tempest-VolumesSnapshotTestJSON-1988768782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49e06805-d9a5-43ab-bef5-70b59b973297 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-49e06805-d9a5-43ab-bef5-70b59b973297.15720718-a59d-48ad-a7b4-f151308c49f0 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:01:27 devstack sudo[98087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49e06805-d9a5-43ab-bef5-70b59b973297 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-49e06805-d9a5-43ab-bef5-70b59b973297.15720718-a59d-48ad-a7b4-f151308c49f0 Aug 10 16:01:27 devstack sudo[98087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:01:28 devstack sudo[98087]: pam_unix(sudo:session): session closed for user root Aug 10 16:01:28 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-1579fb93-f572-41ab-bccf-ee70b6cc2e1a tempest-VolumesSnapshotTestJSON-1988768782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49e06805-d9a5-43ab-bef5-70b59b973297 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-49e06805-d9a5-43ab-bef5-70b59b973297.15720718-a59d-48ad-a7b4-f151308c49f0" returned: 0 in 0.332s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:01:28 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-1579fb93-f572-41ab-bccf-ee70b6cc2e1a tempest-VolumesSnapshotTestJSON-1988768782 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-49e06805-d9a5-43ab-bef5-70b59b973297.15720718-a59d-48ad-a7b4-f151308c49f0 is being set with open permissions: ugo+rw Aug 10 16:01:28 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-1579fb93-f572-41ab-bccf-ee70b6cc2e1a tempest-VolumesSnapshotTestJSON-1988768782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-49e06805-d9a5-43ab-bef5-70b59b973297.15720718-a59d-48ad-a7b4-f151308c49f0 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:01:28 devstack sudo[98092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-49e06805-d9a5-43ab-bef5-70b59b973297.15720718-a59d-48ad-a7b4-f151308c49f0 Aug 10 16:01:28 devstack sudo[98092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:01:28 devstack sudo[98092]: pam_unix(sudo:session): session closed for user root Aug 10 16:01:28 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-1579fb93-f572-41ab-bccf-ee70b6cc2e1a tempest-VolumesSnapshotTestJSON-1988768782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-49e06805-d9a5-43ab-bef5-70b59b973297.15720718-a59d-48ad-a7b4-f151308c49f0" returned: 0 in 0.347s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:01:28 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-1579fb93-f572-41ab-bccf-ee70b6cc2e1a tempest-VolumesSnapshotTestJSON-1988768782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-49e06805-d9a5-43ab-bef5-70b59b973297.info {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:01:28 devstack sudo[98095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-49e06805-d9a5-43ab-bef5-70b59b973297.info Aug 10 16:01:28 devstack sudo[98095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:01:29 devstack sudo[98095]: pam_unix(sudo:session): session closed for user root Aug 10 16:01:29 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-1579fb93-f572-41ab-bccf-ee70b6cc2e1a tempest-VolumesSnapshotTestJSON-1988768782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-49e06805-d9a5-43ab-bef5-70b59b973297.info" returned: 0 in 0.377s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:01:29 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-1579fb93-f572-41ab-bccf-ee70b6cc2e1a tempest-VolumesSnapshotTestJSON-1988768782 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-49e06805-d9a5-43ab-bef5-70b59b973297.info is being set with open permissions: ugo+rw Aug 10 16:01:29 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-1579fb93-f572-41ab-bccf-ee70b6cc2e1a tempest-VolumesSnapshotTestJSON-1988768782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-49e06805-d9a5-43ab-bef5-70b59b973297.info {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:01:29 devstack sudo[98099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-49e06805-d9a5-43ab-bef5-70b59b973297.info Aug 10 16:01:29 devstack sudo[98099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:01:29 devstack sudo[98099]: pam_unix(sudo:session): session closed for user root Aug 10 16:01:29 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-1579fb93-f572-41ab-bccf-ee70b6cc2e1a tempest-VolumesSnapshotTestJSON-1988768782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-49e06805-d9a5-43ab-bef5-70b59b973297.info" returned: 0 in 0.512s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:01:29 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-1579fb93-f572-41ab-bccf-ee70b6cc2e1a tempest-VolumesSnapshotTestJSON-1988768782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.707s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:01:29 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-1579fb93-f572-41ab-bccf-ee70b6cc2e1a tempest-VolumesSnapshotTestJSON-1988768782 None] Create snapshot completed successfully Aug 10 16:01:30 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-5b871447-b686-46d7-9e19-6d8a586c60aa tempest-VolumesSnapshotTestJSON-1988768782 None] Acquiring lock "cinder-15720718-a59d-48ad-a7b4-f151308c49f0-delete_snapshot" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:01:30 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-5b871447-b686-46d7-9e19-6d8a586c60aa tempest-VolumesSnapshotTestJSON-1988768782 None] Lock "cinder-15720718-a59d-48ad-a7b4-f151308c49f0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:01:30 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-5b871447-b686-46d7-9e19-6d8a586c60aa tempest-VolumesSnapshotTestJSON-1988768782 None] Acquiring lock "cinder-quobyte-49e06805-d9a5-43ab-bef5-70b59b973297" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:01:30 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-5b871447-b686-46d7-9e19-6d8a586c60aa tempest-VolumesSnapshotTestJSON-1988768782 None] Lock "cinder-quobyte-49e06805-d9a5-43ab-bef5-70b59b973297" acquired by "delete_snapshot" :: waited 0.035s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:01:30 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-5b871447-b686-46d7-9e19-6d8a586c60aa tempest-VolumesSnapshotTestJSON-1988768782 None] Acquiring lock "cinder-quobyte-15720718-a59d-48ad-a7b4-f151308c49f0" by "_delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:01:30 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-5b871447-b686-46d7-9e19-6d8a586c60aa tempest-VolumesSnapshotTestJSON-1988768782 None] Lock "cinder-quobyte-15720718-a59d-48ad-a7b4-f151308c49f0" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:01:30 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-5b871447-b686-46d7-9e19-6d8a586c60aa tempest-VolumesSnapshotTestJSON-1988768782 None] Deleting offline snapshot 15720718-a59d-48ad-a7b4-f151308c49f0 of volume 49e06805-d9a5-43ab-bef5-70b59b973297 {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 16:01:30 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-5b871447-b686-46d7-9e19-6d8a586c60aa tempest-VolumesSnapshotTestJSON-1988768782 None] snapshot_file for this snap is: volume-49e06805-d9a5-43ab-bef5-70b59b973297.15720718-a59d-48ad-a7b4-f151308c49f0 {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 16:01:30 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd9b2ff0-b54b-42e0-8297-87339c1bcab4]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:01:30 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5b871447-b686-46d7-9e19-6d8a586c60aa tempest-VolumesSnapshotTestJSON-1988768782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-49e06805-d9a5-43ab-bef5-70b59b973297.15720718-a59d-48ad-a7b4-f151308c49f0 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:01:30 devstack sudo[98102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-49e06805-d9a5-43ab-bef5-70b59b973297.15720718-a59d-48ad-a7b4-f151308c49f0 Aug 10 16:01:30 devstack sudo[98102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:01:30 devstack sudo[98102]: pam_unix(sudo:session): session closed for user root Aug 10 16:01:30 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5b871447-b686-46d7-9e19-6d8a586c60aa tempest-VolumesSnapshotTestJSON-1988768782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-49e06805-d9a5-43ab-bef5-70b59b973297.15720718-a59d-48ad-a7b4-f151308c49f0" returned: 0 in 0.441s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:01:30 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-5b871447-b686-46d7-9e19-6d8a586c60aa tempest-VolumesSnapshotTestJSON-1988768782 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-49e06805-d9a5-43ab-bef5-70b59b973297(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 16:01:30 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4264db2-7087-4cea-b5dd-ab2f0d3334d1]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:01:30 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5b871447-b686-46d7-9e19-6d8a586c60aa tempest-VolumesSnapshotTestJSON-1988768782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-49e06805-d9a5-43ab-bef5-70b59b973297 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:01:31 devstack sudo[98110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-49e06805-d9a5-43ab-bef5-70b59b973297 Aug 10 16:01:31 devstack sudo[98110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:01:31 devstack sudo[98110]: pam_unix(sudo:session): session closed for user root Aug 10 16:01:31 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5b871447-b686-46d7-9e19-6d8a586c60aa tempest-VolumesSnapshotTestJSON-1988768782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-49e06805-d9a5-43ab-bef5-70b59b973297" returned: 0 in 0.537s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:01:31 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5b871447-b686-46d7-9e19-6d8a586c60aa tempest-VolumesSnapshotTestJSON-1988768782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-49e06805-d9a5-43ab-bef5-70b59b973297.15720718-a59d-48ad-a7b4-f151308c49f0 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:01:31 devstack sudo[98115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-49e06805-d9a5-43ab-bef5-70b59b973297.15720718-a59d-48ad-a7b4-f151308c49f0 Aug 10 16:01:31 devstack sudo[98115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:01:31 devstack sudo[98115]: pam_unix(sudo:session): session closed for user root Aug 10 16:01:31 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5b871447-b686-46d7-9e19-6d8a586c60aa tempest-VolumesSnapshotTestJSON-1988768782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-49e06805-d9a5-43ab-bef5-70b59b973297.15720718-a59d-48ad-a7b4-f151308c49f0" returned: 0 in 0.480s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:01:31 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5b871447-b686-46d7-9e19-6d8a586c60aa tempest-VolumesSnapshotTestJSON-1988768782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-49e06805-d9a5-43ab-bef5-70b59b973297.15720718-a59d-48ad-a7b4-f151308c49f0 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:01:31 devstack sudo[98122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-49e06805-d9a5-43ab-bef5-70b59b973297.15720718-a59d-48ad-a7b4-f151308c49f0 Aug 10 16:01:31 devstack sudo[98122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:01:32 devstack sudo[98122]: pam_unix(sudo:session): session closed for user root Aug 10 16:01:32 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5b871447-b686-46d7-9e19-6d8a586c60aa tempest-VolumesSnapshotTestJSON-1988768782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-49e06805-d9a5-43ab-bef5-70b59b973297.15720718-a59d-48ad-a7b4-f151308c49f0" returned: 0 in 0.298s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:01:32 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-5b871447-b686-46d7-9e19-6d8a586c60aa tempest-VolumesSnapshotTestJSON-1988768782 None] Lock "cinder-quobyte-15720718-a59d-48ad-a7b4-f151308c49f0" released by "_delete_snapshot" :: held 1.944s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:01:32 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-5b871447-b686-46d7-9e19-6d8a586c60aa tempest-VolumesSnapshotTestJSON-1988768782 None] Lock "cinder-quobyte-49e06805-d9a5-43ab-bef5-70b59b973297" released by "delete_snapshot" :: held 1.977s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:01:32 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-5b871447-b686-46d7-9e19-6d8a586c60aa tempest-VolumesSnapshotTestJSON-1988768782 None] Created reservations ['23789e30-8975-49c7-afca-b6dda9f1af5e', 'd2d58a9e-3fc9-424d-913b-f4705cdf58aa', '63602359-17eb-4088-8824-cf3d50ab3247', '69f2d9c2-4c88-46db-8b62-9e4bcb907815'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:01:32 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-5b871447-b686-46d7-9e19-6d8a586c60aa tempest-VolumesSnapshotTestJSON-1988768782 None] Delete snapshot completed successfully. Aug 10 16:01:32 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-5b871447-b686-46d7-9e19-6d8a586c60aa tempest-VolumesSnapshotTestJSON-1988768782 None] Lock "cinder-15720718-a59d-48ad-a7b4-f151308c49f0-delete_snapshot" released by "delete_snapshot" :: held 2.239s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:01:34 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c4e01f3-ecbc-4f7d-a50d-2943e40dc901 tempest-VolumesSnapshotTestJSON-1988768782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:01:34 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2c4e01f3-ecbc-4f7d-a50d-2943e40dc901 tempest-VolumesSnapshotTestJSON-1988768782 None] Flow 'volume_create_manager' (3f6ee9f5-4e0c-47c4-9bea-768ebd51be9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:01:34 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2c4e01f3-ecbc-4f7d-a50d-2943e40dc901 tempest-VolumesSnapshotTestJSON-1988768782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1d69e3e-c903-4bb6-bef8-547b085af5ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:01:34 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2c4e01f3-ecbc-4f7d-a50d-2943e40dc901 tempest-VolumesSnapshotTestJSON-1988768782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1d69e3e-c903-4bb6-bef8-547b085af5ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:01:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-848592203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ca5ae16-711a-4870-a8e6-dcde970e4975,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e124169510854def88c000087030eef2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:01:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:01:34Z,use_quota=True,user_id='e195aeff14b5481ab42226aff1e44cd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:01:34 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2c4e01f3-ecbc-4f7d-a50d-2943e40dc901 tempest-VolumesSnapshotTestJSON-1988768782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fae5dcb3-c2df-42f1-b8c3-45079a0e09aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:01:34 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2c4e01f3-ecbc-4f7d-a50d-2943e40dc901 tempest-VolumesSnapshotTestJSON-1988768782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fae5dcb3-c2df-42f1-b8c3-45079a0e09aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:01:34 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2c4e01f3-ecbc-4f7d-a50d-2943e40dc901 tempest-VolumesSnapshotTestJSON-1988768782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5bf55d3-6bed-4712-bab1-75d9f2cc919e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:01:34 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2c4e01f3-ecbc-4f7d-a50d-2943e40dc901 tempest-VolumesSnapshotTestJSON-1988768782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5bf55d3-6bed-4712-bab1-75d9f2cc919e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ca5ae16-711a-4870-a8e6-dcde970e4975', 'volume_name': 'volume-3ca5ae16-711a-4870-a8e6-dcde970e4975', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:01:34 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2c4e01f3-ecbc-4f7d-a50d-2943e40dc901 tempest-VolumesSnapshotTestJSON-1988768782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55481352-0451-406c-b4f3-e9eb8aedc021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:01:34 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2c4e01f3-ecbc-4f7d-a50d-2943e40dc901 tempest-VolumesSnapshotTestJSON-1988768782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55481352-0451-406c-b4f3-e9eb8aedc021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:01:34 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2c4e01f3-ecbc-4f7d-a50d-2943e40dc901 tempest-VolumesSnapshotTestJSON-1988768782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c6af929-e0d1-4645-8488-bec250d5393b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:01:34 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-2c4e01f3-ecbc-4f7d-a50d-2943e40dc901 tempest-VolumesSnapshotTestJSON-1988768782 None] Volume 3ca5ae16-711a-4870-a8e6-dcde970e4975: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ca5ae16-711a-4870-a8e6-dcde970e4975', 'volume_size': 1} Aug 10 16:01:34 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-2c4e01f3-ecbc-4f7d-a50d-2943e40dc901 tempest-VolumesSnapshotTestJSON-1988768782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:01:34 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-2c4e01f3-ecbc-4f7d-a50d-2943e40dc901 tempest-VolumesSnapshotTestJSON-1988768782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:01:34 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-2c4e01f3-ecbc-4f7d-a50d-2943e40dc901 tempest-VolumesSnapshotTestJSON-1988768782 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:01:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-848592203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ca5ae16-711a-4870-a8e6-dcde970e4975,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e124169510854def88c000087030eef2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:01:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:01:34Z,use_quota=True,user_id='e195aeff14b5481ab42226aff1e44cd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:01:34 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-2c4e01f3-ecbc-4f7d-a50d-2943e40dc901 tempest-VolumesSnapshotTestJSON-1988768782 None] Creating volume 3ca5ae16-711a-4870-a8e6-dcde970e4975 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:01:34 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-2c4e01f3-ecbc-4f7d-a50d-2943e40dc901 tempest-VolumesSnapshotTestJSON-1988768782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:01:34 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-2c4e01f3-ecbc-4f7d-a50d-2943e40dc901 tempest-VolumesSnapshotTestJSON-1988768782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:01:34 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-2c4e01f3-ecbc-4f7d-a50d-2943e40dc901 tempest-VolumesSnapshotTestJSON-1988768782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:01:34 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-2c4e01f3-ecbc-4f7d-a50d-2943e40dc901 tempest-VolumesSnapshotTestJSON-1988768782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:01:34 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-2c4e01f3-ecbc-4f7d-a50d-2943e40dc901 tempest-VolumesSnapshotTestJSON-1988768782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:01:34 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-2c4e01f3-ecbc-4f7d-a50d-2943e40dc901 tempest-VolumesSnapshotTestJSON-1988768782 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:01:34 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-2c4e01f3-ecbc-4f7d-a50d-2943e40dc901 tempest-VolumesSnapshotTestJSON-1988768782 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:01:34 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-2c4e01f3-ecbc-4f7d-a50d-2943e40dc901 tempest-VolumesSnapshotTestJSON-1988768782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3ca5ae16-711a-4870-a8e6-dcde970e4975 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:01:34 devstack sudo[98126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3ca5ae16-711a-4870-a8e6-dcde970e4975 1073741824 Aug 10 16:01:34 devstack sudo[98126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:01:34 devstack sudo[98126]: pam_unix(sudo:session): session closed for user root Aug 10 16:01:34 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-2c4e01f3-ecbc-4f7d-a50d-2943e40dc901 tempest-VolumesSnapshotTestJSON-1988768782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3ca5ae16-711a-4870-a8e6-dcde970e4975 1073741824" returned: 0 in 0.581s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:01:34 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-2c4e01f3-ecbc-4f7d-a50d-2943e40dc901 tempest-VolumesSnapshotTestJSON-1988768782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3ca5ae16-711a-4870-a8e6-dcde970e4975 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:01:35 devstack sudo[98132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3ca5ae16-711a-4870-a8e6-dcde970e4975 Aug 10 16:01:35 devstack sudo[98132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:01:35 devstack sudo[98132]: pam_unix(sudo:session): session closed for user root Aug 10 16:01:35 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-2c4e01f3-ecbc-4f7d-a50d-2943e40dc901 tempest-VolumesSnapshotTestJSON-1988768782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3ca5ae16-711a-4870-a8e6-dcde970e4975" returned: 0 in 0.392s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:01:35 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-2c4e01f3-ecbc-4f7d-a50d-2943e40dc901 tempest-VolumesSnapshotTestJSON-1988768782 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:01:35 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-2c4e01f3-ecbc-4f7d-a50d-2943e40dc901 tempest-VolumesSnapshotTestJSON-1988768782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:01:35 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2c4e01f3-ecbc-4f7d-a50d-2943e40dc901 tempest-VolumesSnapshotTestJSON-1988768782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c6af929-e0d1-4645-8488-bec250d5393b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ca5ae16-711a-4870-a8e6-dcde970e4975', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:01:35 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2c4e01f3-ecbc-4f7d-a50d-2943e40dc901 tempest-VolumesSnapshotTestJSON-1988768782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a02e493-6db2-4f47-8bc0-2806bcf1795c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:01:35 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-2c4e01f3-ecbc-4f7d-a50d-2943e40dc901 tempest-VolumesSnapshotTestJSON-1988768782 None] Volume volume-3ca5ae16-711a-4870-a8e6-dcde970e4975 (3ca5ae16-711a-4870-a8e6-dcde970e4975): created successfully Aug 10 16:01:35 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2c4e01f3-ecbc-4f7d-a50d-2943e40dc901 tempest-VolumesSnapshotTestJSON-1988768782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a02e493-6db2-4f47-8bc0-2806bcf1795c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:01:35 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2c4e01f3-ecbc-4f7d-a50d-2943e40dc901 tempest-VolumesSnapshotTestJSON-1988768782 None] Flow 'volume_create_manager' (3f6ee9f5-4e0c-47c4-9bea-768ebd51be9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:01:35 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-2c4e01f3-ecbc-4f7d-a50d-2943e40dc901 tempest-VolumesSnapshotTestJSON-1988768782 None] Created volume successfully. Aug 10 16:01:36 devstack cinder-volume[88641]: DEBUG oslo_service.periodic_task [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88641) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 16:01:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:01:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:01:36 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:01:36 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:01:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:01:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:01:36 devstack sudo[98135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:01:36 devstack sudo[98135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:01:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-15d0e28c-f3e7-4f74-8d41-e6eea8a78819 tempest-VolumesSnapshotTestJSON-1988768782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:01:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-15d0e28c-f3e7-4f74-8d41-e6eea8a78819 tempest-VolumesSnapshotTestJSON-1988768782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:01:36 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-15d0e28c-f3e7-4f74-8d41-e6eea8a78819 tempest-VolumesSnapshotTestJSON-1988768782 None] Creating offline snapshot a7a9d3de-9549-49e4-8e15-9f46eb685e9e of volume 3ca5ae16-711a-4870-a8e6-dcde970e4975 {{(pid=88641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 16:01:36 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[8790876a-e166-4090-ad34-ebdad3b9794c]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:01:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-15d0e28c-f3e7-4f74-8d41-e6eea8a78819 tempest-VolumesSnapshotTestJSON-1988768782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3ca5ae16-711a-4870-a8e6-dcde970e4975 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:01:36 devstack sudo[98137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3ca5ae16-711a-4870-a8e6-dcde970e4975 Aug 10 16:01:36 devstack sudo[98137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:01:36 devstack sudo[98135]: pam_unix(sudo:session): session closed for user root Aug 10 16:01:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.530s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:01:36 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:01:37 devstack cinder-volume[88641]: DEBUG oslo_service.periodic_task [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Running periodic task VolumeManager._thread_info {{(pid=88641) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 16:01:37 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] thread count: 28 {{(pid=88641) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 10 16:01:37 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] thread info: [<_MainThread(MainThread, started 127361545748608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88641) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 10 16:01:37 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-077a21c3-609a-499d-92dd-36803d4e0978 tempest-TestInstancesWithCinderVolumes-1565760524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:01:37 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-077a21c3-609a-499d-92dd-36803d4e0978 tempest-TestInstancesWithCinderVolumes-1565760524 None] Flow 'volume_create_manager' (690351dc-9972-4a9f-9fd9-c6ff77279bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:01:37 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-077a21c3-609a-499d-92dd-36803d4e0978 tempest-TestInstancesWithCinderVolumes-1565760524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec87a91b-b9be-469a-b223-0ba8d0fe1680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:01:37 devstack sudo[98137]: pam_unix(sudo:session): session closed for user root Aug 10 16:01:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-15d0e28c-f3e7-4f74-8d41-e6eea8a78819 tempest-VolumesSnapshotTestJSON-1988768782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3ca5ae16-711a-4870-a8e6-dcde970e4975" returned: 0 in 0.597s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:01:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-15d0e28c-f3e7-4f74-8d41-e6eea8a78819 tempest-VolumesSnapshotTestJSON-1988768782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3ca5ae16-711a-4870-a8e6-dcde970e4975,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3ca5ae16-711a-4870-a8e6-dcde970e4975.a7a9d3de-9549-49e4-8e15-9f46eb685e9e 1G {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:01:37 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-077a21c3-609a-499d-92dd-36803d4e0978 tempest-TestInstancesWithCinderVolumes-1565760524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec87a91b-b9be-469a-b223-0ba8d0fe1680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:01:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-588401923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=747d5a1a-3ea0-4b60-985b-7355a3fa56d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdb3ecc5dba349e78619e7090406c2c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:01:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:01:37Z,use_quota=True,user_id='479fef74d7404d0db46406fc88cdfadc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ffb00ea4-43e6-40ea-96b1-47df1fb1abf7),volume_type_id=ffb00ea4-43e6-40ea-96b1-47df1fb1abf7)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:01:37 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-077a21c3-609a-499d-92dd-36803d4e0978 tempest-TestInstancesWithCinderVolumes-1565760524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c3eca6a-c454-460a-a552-fa108d993d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:01:37 devstack sudo[98144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3ca5ae16-711a-4870-a8e6-dcde970e4975,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3ca5ae16-711a-4870-a8e6-dcde970e4975.a7a9d3de-9549-49e4-8e15-9f46eb685e9e 1G Aug 10 16:01:37 devstack sudo[98144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:01:37 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-077a21c3-609a-499d-92dd-36803d4e0978 tempest-TestInstancesWithCinderVolumes-1565760524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c3eca6a-c454-460a-a552-fa108d993d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:01:37 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-077a21c3-609a-499d-92dd-36803d4e0978 tempest-TestInstancesWithCinderVolumes-1565760524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d62018f5-7b84-4743-9f7a-b36369acc5b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:01:37 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-077a21c3-609a-499d-92dd-36803d4e0978 tempest-TestInstancesWithCinderVolumes-1565760524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d62018f5-7b84-4743-9f7a-b36369acc5b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '747d5a1a-3ea0-4b60-985b-7355a3fa56d9', 'volume_name': 'volume-747d5a1a-3ea0-4b60-985b-7355a3fa56d9', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:01:37 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-077a21c3-609a-499d-92dd-36803d4e0978 tempest-TestInstancesWithCinderVolumes-1565760524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66175d4f-fefa-4242-8336-c587e1876c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:01:37 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-077a21c3-609a-499d-92dd-36803d4e0978 tempest-TestInstancesWithCinderVolumes-1565760524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66175d4f-fefa-4242-8336-c587e1876c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:01:37 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-077a21c3-609a-499d-92dd-36803d4e0978 tempest-TestInstancesWithCinderVolumes-1565760524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f8ba18d-408e-498b-b016-1e4eb95ab4d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:01:37 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-077a21c3-609a-499d-92dd-36803d4e0978 tempest-TestInstancesWithCinderVolumes-1565760524 None] Volume 747d5a1a-3ea0-4b60-985b-7355a3fa56d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-747d5a1a-3ea0-4b60-985b-7355a3fa56d9', 'volume_size': 1} Aug 10 16:01:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-077a21c3-609a-499d-92dd-36803d4e0978 tempest-TestInstancesWithCinderVolumes-1565760524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:01:37 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-24c9f25c-78ff-4d9a-80bf-9c287637be06 tempest-TestInstancesWithCinderVolumes-1565760524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:01:37 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-24c9f25c-78ff-4d9a-80bf-9c287637be06 tempest-TestInstancesWithCinderVolumes-1565760524 None] Flow 'volume_create_manager' (82832bc7-a9fc-4d2d-8ca5-8bb80834c9a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:01:37 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-24c9f25c-78ff-4d9a-80bf-9c287637be06 tempest-TestInstancesWithCinderVolumes-1565760524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b7c3940-88bc-428e-9d43-8647c6fa324a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:01:37 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-24c9f25c-78ff-4d9a-80bf-9c287637be06 tempest-TestInstancesWithCinderVolumes-1565760524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b7c3940-88bc-428e-9d43-8647c6fa324a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:01:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1106415505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a0bed7f-488d-422c-8637-0ec030277f91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdb3ecc5dba349e78619e7090406c2c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:01:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:01:38Z,use_quota=True,user_id='479fef74d7404d0db46406fc88cdfadc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fe17ead-1a93-4770-9203-3cc68f06be5a),volume_type_id=3fe17ead-1a93-4770-9203-3cc68f06be5a)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:01:37 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-24c9f25c-78ff-4d9a-80bf-9c287637be06 tempest-TestInstancesWithCinderVolumes-1565760524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0157871b-fd75-4c00-9a29-5a6be7646331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:01:37 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-24c9f25c-78ff-4d9a-80bf-9c287637be06 tempest-TestInstancesWithCinderVolumes-1565760524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0157871b-fd75-4c00-9a29-5a6be7646331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:01:37 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-24c9f25c-78ff-4d9a-80bf-9c287637be06 tempest-TestInstancesWithCinderVolumes-1565760524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73259033-70fe-4b83-ba81-d19faeffc910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:01:37 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-24c9f25c-78ff-4d9a-80bf-9c287637be06 tempest-TestInstancesWithCinderVolumes-1565760524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73259033-70fe-4b83-ba81-d19faeffc910) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a0bed7f-488d-422c-8637-0ec030277f91', 'volume_name': 'volume-0a0bed7f-488d-422c-8637-0ec030277f91', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:01:37 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-24c9f25c-78ff-4d9a-80bf-9c287637be06 tempest-TestInstancesWithCinderVolumes-1565760524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09052c06-a5d2-4a09-8955-c39c5f2c0bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:01:37 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-24c9f25c-78ff-4d9a-80bf-9c287637be06 tempest-TestInstancesWithCinderVolumes-1565760524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09052c06-a5d2-4a09-8955-c39c5f2c0bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:01:37 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-24c9f25c-78ff-4d9a-80bf-9c287637be06 tempest-TestInstancesWithCinderVolumes-1565760524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02ffecc2-0786-4205-8505-413fb8e79eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:01:37 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-24c9f25c-78ff-4d9a-80bf-9c287637be06 tempest-TestInstancesWithCinderVolumes-1565760524 None] Volume 0a0bed7f-488d-422c-8637-0ec030277f91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a0bed7f-488d-422c-8637-0ec030277f91', 'volume_size': 1} Aug 10 16:01:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-24c9f25c-78ff-4d9a-80bf-9c287637be06 tempest-TestInstancesWithCinderVolumes-1565760524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:01:37 devstack sudo[98144]: pam_unix(sudo:session): session closed for user root Aug 10 16:01:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-15d0e28c-f3e7-4f74-8d41-e6eea8a78819 tempest-VolumesSnapshotTestJSON-1988768782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3ca5ae16-711a-4870-a8e6-dcde970e4975,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3ca5ae16-711a-4870-a8e6-dcde970e4975.a7a9d3de-9549-49e4-8e15-9f46eb685e9e 1G" returned: 0 in 0.758s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:01:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-15d0e28c-f3e7-4f74-8d41-e6eea8a78819 tempest-VolumesSnapshotTestJSON-1988768782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ca5ae16-711a-4870-a8e6-dcde970e4975 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3ca5ae16-711a-4870-a8e6-dcde970e4975.a7a9d3de-9549-49e4-8e15-9f46eb685e9e {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:01:38 devstack sudo[98150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ca5ae16-711a-4870-a8e6-dcde970e4975 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3ca5ae16-711a-4870-a8e6-dcde970e4975.a7a9d3de-9549-49e4-8e15-9f46eb685e9e Aug 10 16:01:38 devstack sudo[98150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:01:38 devstack sudo[98150]: pam_unix(sudo:session): session closed for user root Aug 10 16:01:38 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-15d0e28c-f3e7-4f74-8d41-e6eea8a78819 tempest-VolumesSnapshotTestJSON-1988768782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ca5ae16-711a-4870-a8e6-dcde970e4975 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3ca5ae16-711a-4870-a8e6-dcde970e4975.a7a9d3de-9549-49e4-8e15-9f46eb685e9e" returned: 0 in 0.397s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:01:38 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-15d0e28c-f3e7-4f74-8d41-e6eea8a78819 tempest-VolumesSnapshotTestJSON-1988768782 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3ca5ae16-711a-4870-a8e6-dcde970e4975.a7a9d3de-9549-49e4-8e15-9f46eb685e9e is being set with open permissions: ugo+rw Aug 10 16:01:38 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-15d0e28c-f3e7-4f74-8d41-e6eea8a78819 tempest-VolumesSnapshotTestJSON-1988768782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3ca5ae16-711a-4870-a8e6-dcde970e4975.a7a9d3de-9549-49e4-8e15-9f46eb685e9e {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:01:38 devstack sudo[98156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3ca5ae16-711a-4870-a8e6-dcde970e4975.a7a9d3de-9549-49e4-8e15-9f46eb685e9e Aug 10 16:01:38 devstack sudo[98156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:01:38 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c917999-455f-45c8-b691-a7fe5b16f4b0 tempest-TestInstancesWithCinderVolumes-1565760524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:01:38 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9c917999-455f-45c8-b691-a7fe5b16f4b0 tempest-TestInstancesWithCinderVolumes-1565760524 None] Flow 'volume_create_manager' (6f064ecf-960a-41a7-a59e-ab3afdd5dc30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:01:38 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9c917999-455f-45c8-b691-a7fe5b16f4b0 tempest-TestInstancesWithCinderVolumes-1565760524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18ebddd1-9eb0-488e-bba7-09bc25e4b6dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:01:38 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9c917999-455f-45c8-b691-a7fe5b16f4b0 tempest-TestInstancesWithCinderVolumes-1565760524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18ebddd1-9eb0-488e-bba7-09bc25e4b6dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:01:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-216459720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a36b2e78-b3cd-4dd3-81dd-0b0d72f07b15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdb3ecc5dba349e78619e7090406c2c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:01:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:01:38Z,use_quota=True,user_id='479fef74d7404d0db46406fc88cdfadc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b9860326-2377-4853-bef3-d1d384599606),volume_type_id=b9860326-2377-4853-bef3-d1d384599606)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:01:38 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9c917999-455f-45c8-b691-a7fe5b16f4b0 tempest-TestInstancesWithCinderVolumes-1565760524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da677cc6-67e5-47ba-a746-ac06fd8c67c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:01:38 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9c917999-455f-45c8-b691-a7fe5b16f4b0 tempest-TestInstancesWithCinderVolumes-1565760524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da677cc6-67e5-47ba-a746-ac06fd8c67c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:01:38 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9c917999-455f-45c8-b691-a7fe5b16f4b0 tempest-TestInstancesWithCinderVolumes-1565760524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad81832c-7868-4f43-8ad5-d326be715458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:01:38 devstack cinder-volume[88641]: DEBUG cinder.image.glance [None req-9c917999-455f-45c8-b691-a7fe5b16f4b0 tempest-TestInstancesWithCinderVolumes-1565760524 None] Creating Keystone auth plugin from conf {{(pid=88641) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 10 16:01:38 devstack sudo[98156]: pam_unix(sudo:session): session closed for user root Aug 10 16:01:38 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-15d0e28c-f3e7-4f74-8d41-e6eea8a78819 tempest-VolumesSnapshotTestJSON-1988768782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3ca5ae16-711a-4870-a8e6-dcde970e4975.a7a9d3de-9549-49e4-8e15-9f46eb685e9e" returned: 0 in 0.306s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:01:38 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-15d0e28c-f3e7-4f74-8d41-e6eea8a78819 tempest-VolumesSnapshotTestJSON-1988768782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3ca5ae16-711a-4870-a8e6-dcde970e4975.info {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:01:38 devstack sudo[98159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3ca5ae16-711a-4870-a8e6-dcde970e4975.info Aug 10 16:01:38 devstack sudo[98159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:01:39 devstack sudo[98159]: pam_unix(sudo:session): session closed for user root Aug 10 16:01:39 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-15d0e28c-f3e7-4f74-8d41-e6eea8a78819 tempest-VolumesSnapshotTestJSON-1988768782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3ca5ae16-711a-4870-a8e6-dcde970e4975.info" returned: 0 in 0.314s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:01:39 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-15d0e28c-f3e7-4f74-8d41-e6eea8a78819 tempest-VolumesSnapshotTestJSON-1988768782 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3ca5ae16-711a-4870-a8e6-dcde970e4975.info is being set with open permissions: ugo+rw Aug 10 16:01:39 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-15d0e28c-f3e7-4f74-8d41-e6eea8a78819 tempest-VolumesSnapshotTestJSON-1988768782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3ca5ae16-711a-4870-a8e6-dcde970e4975.info {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:01:39 devstack sudo[98162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3ca5ae16-711a-4870-a8e6-dcde970e4975.info Aug 10 16:01:39 devstack sudo[98162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:01:39 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9c917999-455f-45c8-b691-a7fe5b16f4b0 tempest-TestInstancesWithCinderVolumes-1565760524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad81832c-7868-4f43-8ad5-d326be715458) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a36b2e78-b3cd-4dd3-81dd-0b0d72f07b15', 'volume_name': 'volume-a36b2e78-b3cd-4dd3-81dd-0b0d72f07b15', 'volume_size': 1, 'image_id': 'f4c8c6d9-10ae-4b4f-80d5-d661a3aa58ff', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f4c8c6d9-10ae-4b4f-80d5-d661a3aa58ff', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1291203185', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cdb3ecc5dba349e78619e7090406c2c2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f4c8c6d9-10ae-4b4f-80d5-d661a3aa58ff', 'created_at': datetime.datetime(2026, 8, 10, 14, 1, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 10, 14, 1, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f4c8c6d9-10ae-4b4f-80d5-d661a3aa58ff/file', 'properties': {}}, 'image_service': }' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:01:39 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9c917999-455f-45c8-b691-a7fe5b16f4b0 tempest-TestInstancesWithCinderVolumes-1565760524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cb28531-51a9-428b-b640-df53b40b8ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:01:39 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9c917999-455f-45c8-b691-a7fe5b16f4b0 tempest-TestInstancesWithCinderVolumes-1565760524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cb28531-51a9-428b-b640-df53b40b8ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:01:39 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9c917999-455f-45c8-b691-a7fe5b16f4b0 tempest-TestInstancesWithCinderVolumes-1565760524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4c7a36d-d433-4b81-a895-e02d052026ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:01:39 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-9c917999-455f-45c8-b691-a7fe5b16f4b0 tempest-TestInstancesWithCinderVolumes-1565760524 None] Volume a36b2e78-b3cd-4dd3-81dd-0b0d72f07b15: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a36b2e78-b3cd-4dd3-81dd-0b0d72f07b15', 'volume_size': 1, 'image_id': 'f4c8c6d9-10ae-4b4f-80d5-d661a3aa58ff', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f4c8c6d9-10ae-4b4f-80d5-d661a3aa58ff', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1291203185', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cdb3ecc5dba349e78619e7090406c2c2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f4c8c6d9-10ae-4b4f-80d5-d661a3aa58ff', 'created_at': datetime.datetime(2026, 8, 10, 14, 1, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 10, 14, 1, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f4c8c6d9-10ae-4b4f-80d5-d661a3aa58ff/file', 'properties': {}}, 'image_service': } Aug 10 16:01:39 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c917999-455f-45c8-b691-a7fe5b16f4b0 tempest-TestInstancesWithCinderVolumes-1565760524 None] Trying to clone a36b2e78-b3cd-4dd3-81dd-0b0d72f07b15 from image f4c8c6d9-10ae-4b4f-80d5-d661a3aa58ff at location (None, [{'url': 'file:///opt/stack/data/glance/images/f4c8c6d9-10ae-4b4f-80d5-d661a3aa58ff', 'metadata': {}}]). {{(pid=88641) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 10 16:01:39 devstack sudo[98162]: pam_unix(sudo:session): session closed for user root Aug 10 16:01:39 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-15d0e28c-f3e7-4f74-8d41-e6eea8a78819 tempest-VolumesSnapshotTestJSON-1988768782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3ca5ae16-711a-4870-a8e6-dcde970e4975.info" returned: 0 in 0.376s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:01:39 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-15d0e28c-f3e7-4f74-8d41-e6eea8a78819 tempest-VolumesSnapshotTestJSON-1988768782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.856s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:01:39 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-077a21c3-609a-499d-92dd-36803d4e0978 tempest-TestInstancesWithCinderVolumes-1565760524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.127s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:01:39 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-077a21c3-609a-499d-92dd-36803d4e0978 tempest-TestInstancesWithCinderVolumes-1565760524 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:01:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-588401923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=747d5a1a-3ea0-4b60-985b-7355a3fa56d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdb3ecc5dba349e78619e7090406c2c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:01:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:01:37Z,use_quota=True,user_id='479fef74d7404d0db46406fc88cdfadc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ffb00ea4-43e6-40ea-96b1-47df1fb1abf7),volume_type_id=ffb00ea4-43e6-40ea-96b1-47df1fb1abf7)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:01:39 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-077a21c3-609a-499d-92dd-36803d4e0978 tempest-TestInstancesWithCinderVolumes-1565760524 None] Creating volume 747d5a1a-3ea0-4b60-985b-7355a3fa56d9 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:01:39 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-077a21c3-609a-499d-92dd-36803d4e0978 tempest-TestInstancesWithCinderVolumes-1565760524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:01:39 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-077a21c3-609a-499d-92dd-36803d4e0978 tempest-TestInstancesWithCinderVolumes-1565760524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:01:39 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-077a21c3-609a-499d-92dd-36803d4e0978 tempest-TestInstancesWithCinderVolumes-1565760524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:01:39 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-077a21c3-609a-499d-92dd-36803d4e0978 tempest-TestInstancesWithCinderVolumes-1565760524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:01:39 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-077a21c3-609a-499d-92dd-36803d4e0978 tempest-TestInstancesWithCinderVolumes-1565760524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:01:39 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-077a21c3-609a-499d-92dd-36803d4e0978 tempest-TestInstancesWithCinderVolumes-1565760524 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:01:39 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-077a21c3-609a-499d-92dd-36803d4e0978 tempest-TestInstancesWithCinderVolumes-1565760524 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:01:39 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-077a21c3-609a-499d-92dd-36803d4e0978 tempest-TestInstancesWithCinderVolumes-1565760524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-747d5a1a-3ea0-4b60-985b-7355a3fa56d9 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:01:39 devstack sudo[98165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-747d5a1a-3ea0-4b60-985b-7355a3fa56d9 1073741824 Aug 10 16:01:39 devstack sudo[98165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:01:39 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-15d0e28c-f3e7-4f74-8d41-e6eea8a78819 tempest-VolumesSnapshotTestJSON-1988768782 None] Create snapshot completed successfully Aug 10 16:01:40 devstack sudo[98165]: pam_unix(sudo:session): session closed for user root Aug 10 16:01:40 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-077a21c3-609a-499d-92dd-36803d4e0978 tempest-TestInstancesWithCinderVolumes-1565760524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-747d5a1a-3ea0-4b60-985b-7355a3fa56d9 1073741824" returned: 0 in 0.613s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:01:40 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-077a21c3-609a-499d-92dd-36803d4e0978 tempest-TestInstancesWithCinderVolumes-1565760524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-747d5a1a-3ea0-4b60-985b-7355a3fa56d9 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:01:40 devstack sudo[98170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-747d5a1a-3ea0-4b60-985b-7355a3fa56d9 Aug 10 16:01:40 devstack sudo[98170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:01:40 devstack sudo[98170]: pam_unix(sudo:session): session closed for user root Aug 10 16:01:40 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-077a21c3-609a-499d-92dd-36803d4e0978 tempest-TestInstancesWithCinderVolumes-1565760524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-747d5a1a-3ea0-4b60-985b-7355a3fa56d9" returned: 0 in 0.355s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:01:40 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-077a21c3-609a-499d-92dd-36803d4e0978 tempest-TestInstancesWithCinderVolumes-1565760524 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:01:40 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-077a21c3-609a-499d-92dd-36803d4e0978 tempest-TestInstancesWithCinderVolumes-1565760524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:01:40 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-24c9f25c-78ff-4d9a-80bf-9c287637be06 tempest-TestInstancesWithCinderVolumes-1565760524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.562s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:01:40 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-24c9f25c-78ff-4d9a-80bf-9c287637be06 tempest-TestInstancesWithCinderVolumes-1565760524 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:01:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1106415505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a0bed7f-488d-422c-8637-0ec030277f91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdb3ecc5dba349e78619e7090406c2c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:01:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:01:38Z,use_quota=True,user_id='479fef74d7404d0db46406fc88cdfadc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fe17ead-1a93-4770-9203-3cc68f06be5a),volume_type_id=3fe17ead-1a93-4770-9203-3cc68f06be5a)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:01:40 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-24c9f25c-78ff-4d9a-80bf-9c287637be06 tempest-TestInstancesWithCinderVolumes-1565760524 None] Creating volume 0a0bed7f-488d-422c-8637-0ec030277f91 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:01:40 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-24c9f25c-78ff-4d9a-80bf-9c287637be06 tempest-TestInstancesWithCinderVolumes-1565760524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:01:40 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-24c9f25c-78ff-4d9a-80bf-9c287637be06 tempest-TestInstancesWithCinderVolumes-1565760524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:01:40 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-24c9f25c-78ff-4d9a-80bf-9c287637be06 tempest-TestInstancesWithCinderVolumes-1565760524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:01:40 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-24c9f25c-78ff-4d9a-80bf-9c287637be06 tempest-TestInstancesWithCinderVolumes-1565760524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:01:40 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-24c9f25c-78ff-4d9a-80bf-9c287637be06 tempest-TestInstancesWithCinderVolumes-1565760524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:01:40 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-24c9f25c-78ff-4d9a-80bf-9c287637be06 tempest-TestInstancesWithCinderVolumes-1565760524 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:01:40 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-24c9f25c-78ff-4d9a-80bf-9c287637be06 tempest-TestInstancesWithCinderVolumes-1565760524 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:01:40 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-24c9f25c-78ff-4d9a-80bf-9c287637be06 tempest-TestInstancesWithCinderVolumes-1565760524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-0a0bed7f-488d-422c-8637-0ec030277f91 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:01:40 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6c8b0bf-ae47-4281-bb3b-708629cc9765 tempest-VolumesSnapshotTestJSON-1988768782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:01:40 devstack sudo[98173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-0a0bed7f-488d-422c-8637-0ec030277f91 1073741824 Aug 10 16:01:40 devstack sudo[98173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:01:40 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-077a21c3-609a-499d-92dd-36803d4e0978 tempest-TestInstancesWithCinderVolumes-1565760524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f8ba18d-408e-498b-b016-1e4eb95ab4d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-747d5a1a-3ea0-4b60-985b-7355a3fa56d9', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:01:40 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-077a21c3-609a-499d-92dd-36803d4e0978 tempest-TestInstancesWithCinderVolumes-1565760524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be221d0e-326b-4895-8601-2d32503830b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:01:40 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-077a21c3-609a-499d-92dd-36803d4e0978 tempest-TestInstancesWithCinderVolumes-1565760524 None] Volume volume-747d5a1a-3ea0-4b60-985b-7355a3fa56d9 (747d5a1a-3ea0-4b60-985b-7355a3fa56d9): created successfully Aug 10 16:01:40 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-077a21c3-609a-499d-92dd-36803d4e0978 tempest-TestInstancesWithCinderVolumes-1565760524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be221d0e-326b-4895-8601-2d32503830b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:01:40 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-077a21c3-609a-499d-92dd-36803d4e0978 tempest-TestInstancesWithCinderVolumes-1565760524 None] Flow 'volume_create_manager' (690351dc-9972-4a9f-9fd9-c6ff77279bc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:01:40 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b6c8b0bf-ae47-4281-bb3b-708629cc9765 tempest-VolumesSnapshotTestJSON-1988768782 None] Flow 'volume_create_manager' (f1b5272b-dbbc-4793-b58f-828a631e477a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:01:40 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b6c8b0bf-ae47-4281-bb3b-708629cc9765 tempest-VolumesSnapshotTestJSON-1988768782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01d40007-d328-4862-b7b6-3bd408e9e97d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:01:40 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b6c8b0bf-ae47-4281-bb3b-708629cc9765 tempest-VolumesSnapshotTestJSON-1988768782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01d40007-d328-4862-b7b6-3bd408e9e97d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:01:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-448305426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e69e527-5b6e-49cf-93f0-7a521a972bc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e124169510854def88c000087030eef2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:01:40Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=a7a9d3de-9549-49e4-8e15-9f46eb685e9e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:01:40Z,use_quota=True,user_id='e195aeff14b5481ab42226aff1e44cd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:01:40 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b6c8b0bf-ae47-4281-bb3b-708629cc9765 tempest-VolumesSnapshotTestJSON-1988768782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (187a3b27-a740-401d-9d51-bffa4c4bae29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:01:40 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b6c8b0bf-ae47-4281-bb3b-708629cc9765 tempest-VolumesSnapshotTestJSON-1988768782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (187a3b27-a740-401d-9d51-bffa4c4bae29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:01:40 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b6c8b0bf-ae47-4281-bb3b-708629cc9765 tempest-VolumesSnapshotTestJSON-1988768782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43c8b714-c426-400f-8a4e-badf2a99eacd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:01:40 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b6c8b0bf-ae47-4281-bb3b-708629cc9765 tempest-VolumesSnapshotTestJSON-1988768782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43c8b714-c426-400f-8a4e-badf2a99eacd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6e69e527-5b6e-49cf-93f0-7a521a972bc7', 'volume_name': 'volume-6e69e527-5b6e-49cf-93f0-7a521a972bc7', 'volume_size': 2, 'snapshot_id': 'a7a9d3de-9549-49e4-8e15-9f46eb685e9e'}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:01:40 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b6c8b0bf-ae47-4281-bb3b-708629cc9765 tempest-VolumesSnapshotTestJSON-1988768782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ca00f80-0384-4c56-8d20-65796fd797dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:01:40 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b6c8b0bf-ae47-4281-bb3b-708629cc9765 tempest-VolumesSnapshotTestJSON-1988768782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ca00f80-0384-4c56-8d20-65796fd797dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:01:40 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b6c8b0bf-ae47-4281-bb3b-708629cc9765 tempest-VolumesSnapshotTestJSON-1988768782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86713ece-c929-43ca-b503-870b81243cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:01:40 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-b6c8b0bf-ae47-4281-bb3b-708629cc9765 tempest-VolumesSnapshotTestJSON-1988768782 None] Volume 6e69e527-5b6e-49cf-93f0-7a521a972bc7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6e69e527-5b6e-49cf-93f0-7a521a972bc7', 'volume_size': 2, 'snapshot_id': 'a7a9d3de-9549-49e4-8e15-9f46eb685e9e'} Aug 10 16:01:40 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-077a21c3-609a-499d-92dd-36803d4e0978 tempest-TestInstancesWithCinderVolumes-1565760524 None] Created volume successfully. Aug 10 16:01:40 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-b6c8b0bf-ae47-4281-bb3b-708629cc9765 tempest-VolumesSnapshotTestJSON-1988768782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:01:41 devstack sudo[98173]: pam_unix(sudo:session): session closed for user root Aug 10 16:01:41 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-24c9f25c-78ff-4d9a-80bf-9c287637be06 tempest-TestInstancesWithCinderVolumes-1565760524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-0a0bed7f-488d-422c-8637-0ec030277f91 1073741824" returned: 0 in 0.602s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:01:41 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-24c9f25c-78ff-4d9a-80bf-9c287637be06 tempest-TestInstancesWithCinderVolumes-1565760524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-0a0bed7f-488d-422c-8637-0ec030277f91 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:01:41 devstack sudo[98179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-0a0bed7f-488d-422c-8637-0ec030277f91 Aug 10 16:01:41 devstack sudo[98179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:01:41 devstack sudo[98179]: pam_unix(sudo:session): session closed for user root Aug 10 16:01:41 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-24c9f25c-78ff-4d9a-80bf-9c287637be06 tempest-TestInstancesWithCinderVolumes-1565760524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-0a0bed7f-488d-422c-8637-0ec030277f91" returned: 0 in 0.308s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:01:41 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-24c9f25c-78ff-4d9a-80bf-9c287637be06 tempest-TestInstancesWithCinderVolumes-1565760524 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:01:41 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-24c9f25c-78ff-4d9a-80bf-9c287637be06 tempest-TestInstancesWithCinderVolumes-1565760524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:01:41 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-b6c8b0bf-ae47-4281-bb3b-708629cc9765 tempest-VolumesSnapshotTestJSON-1988768782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.709s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:01:41 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-b6c8b0bf-ae47-4281-bb3b-708629cc9765 tempest-VolumesSnapshotTestJSON-1988768782 None] Acquiring lock "cinder-quobyte-a7a9d3de-9549-49e4-8e15-9f46eb685e9e-6e69e527-5b6e-49cf-93f0-7a521a972bc7" by "_create_volume_from_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:01:41 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-24c9f25c-78ff-4d9a-80bf-9c287637be06 tempest-TestInstancesWithCinderVolumes-1565760524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02ffecc2-0786-4205-8505-413fb8e79eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a0bed7f-488d-422c-8637-0ec030277f91', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:01:41 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-24c9f25c-78ff-4d9a-80bf-9c287637be06 tempest-TestInstancesWithCinderVolumes-1565760524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc33dd0b-8d18-465b-ad37-bf921fac33a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:01:41 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-b6c8b0bf-ae47-4281-bb3b-708629cc9765 tempest-VolumesSnapshotTestJSON-1988768782 None] Lock "cinder-quobyte-a7a9d3de-9549-49e4-8e15-9f46eb685e9e-6e69e527-5b6e-49cf-93f0-7a521a972bc7" acquired by "_create_volume_from_snapshot" :: waited 0.050s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:01:41 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-b6c8b0bf-ae47-4281-bb3b-708629cc9765 tempest-VolumesSnapshotTestJSON-1988768782 None] Creating volume 6e69e527-5b6e-49cf-93f0-7a521a972bc7 from snapshot a7a9d3de-9549-49e4-8e15-9f46eb685e9e {{(pid=88641) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 10 16:01:41 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-b6c8b0bf-ae47-4281-bb3b-708629cc9765 tempest-VolumesSnapshotTestJSON-1988768782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:01:41 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-b6c8b0bf-ae47-4281-bb3b-708629cc9765 tempest-VolumesSnapshotTestJSON-1988768782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:01:41 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-b6c8b0bf-ae47-4281-bb3b-708629cc9765 tempest-VolumesSnapshotTestJSON-1988768782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:01:41 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-b6c8b0bf-ae47-4281-bb3b-708629cc9765 tempest-VolumesSnapshotTestJSON-1988768782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:01:41 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-b6c8b0bf-ae47-4281-bb3b-708629cc9765 tempest-VolumesSnapshotTestJSON-1988768782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:01:41 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-b6c8b0bf-ae47-4281-bb3b-708629cc9765 tempest-VolumesSnapshotTestJSON-1988768782 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:01:41 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-b6c8b0bf-ae47-4281-bb3b-708629cc9765 tempest-VolumesSnapshotTestJSON-1988768782 None] Acquiring lock "cinder-quobyte-6e69e527-5b6e-49cf-93f0-7a521a972bc7" by "_copy_volume_from_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:01:41 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-b6c8b0bf-ae47-4281-bb3b-708629cc9765 tempest-VolumesSnapshotTestJSON-1988768782 None] Lock "cinder-quobyte-6e69e527-5b6e-49cf-93f0-7a521a972bc7" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:01:41 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-b6c8b0bf-ae47-4281-bb3b-708629cc9765 tempest-VolumesSnapshotTestJSON-1988768782 None] snapshot: a7a9d3de-9549-49e4-8e15-9f46eb685e9e, volume: 6e69e527-5b6e-49cf-93f0-7a521a972bc7, {{(pid=88641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 10 16:01:41 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-24c9f25c-78ff-4d9a-80bf-9c287637be06 tempest-TestInstancesWithCinderVolumes-1565760524 None] Volume volume-0a0bed7f-488d-422c-8637-0ec030277f91 (0a0bed7f-488d-422c-8637-0ec030277f91): created successfully Aug 10 16:01:41 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-24c9f25c-78ff-4d9a-80bf-9c287637be06 tempest-TestInstancesWithCinderVolumes-1565760524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc33dd0b-8d18-465b-ad37-bf921fac33a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:01:41 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-24c9f25c-78ff-4d9a-80bf-9c287637be06 tempest-TestInstancesWithCinderVolumes-1565760524 None] Flow 'volume_create_manager' (82832bc7-a9fc-4d2d-8ca5-8bb80834c9a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:01:41 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-b6c8b0bf-ae47-4281-bb3b-708629cc9765 tempest-VolumesSnapshotTestJSON-1988768782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:01:41 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-b6c8b0bf-ae47-4281-bb3b-708629cc9765 tempest-VolumesSnapshotTestJSON-1988768782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:01:41 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-b6c8b0bf-ae47-4281-bb3b-708629cc9765 tempest-VolumesSnapshotTestJSON-1988768782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:01:41 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-b6c8b0bf-ae47-4281-bb3b-708629cc9765 tempest-VolumesSnapshotTestJSON-1988768782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:01:41 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-b6c8b0bf-ae47-4281-bb3b-708629cc9765 tempest-VolumesSnapshotTestJSON-1988768782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:01:41 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-24c9f25c-78ff-4d9a-80bf-9c287637be06 tempest-TestInstancesWithCinderVolumes-1565760524 None] Created volume successfully. Aug 10 16:01:41 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[523f2b82-9f02-4484-a979-169569f01531]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:01:41 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b6c8b0bf-ae47-4281-bb3b-708629cc9765 tempest-VolumesSnapshotTestJSON-1988768782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3ca5ae16-711a-4870-a8e6-dcde970e4975.a7a9d3de-9549-49e4-8e15-9f46eb685e9e {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:01:41 devstack sudo[98182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3ca5ae16-711a-4870-a8e6-dcde970e4975.a7a9d3de-9549-49e4-8e15-9f46eb685e9e Aug 10 16:01:41 devstack sudo[98182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:01:41 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-9d67b2f2-b40a-47f5-b7ab-eeedd5ca6a14 tempest-GroupsTest-278860274 None] Group tempest-Group1-595428029: creating Aug 10 16:01:41 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-9d67b2f2-b40a-47f5-b7ab-eeedd5ca6a14 tempest-GroupsTest-278860274 None] Group tempest-Group1-595428029: created successfully Aug 10 16:01:42 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-9d67b2f2-b40a-47f5-b7ab-eeedd5ca6a14 tempest-GroupsTest-278860274 None] Create group completed successfully. Aug 10 16:01:42 devstack sudo[98182]: pam_unix(sudo:session): session closed for user root Aug 10 16:01:42 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b6c8b0bf-ae47-4281-bb3b-708629cc9765 tempest-VolumesSnapshotTestJSON-1988768782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3ca5ae16-711a-4870-a8e6-dcde970e4975.a7a9d3de-9549-49e4-8e15-9f46eb685e9e" returned: 0 in 0.482s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:01:42 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-b6c8b0bf-ae47-4281-bb3b-708629cc9765 tempest-VolumesSnapshotTestJSON-1988768782 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ca5ae16-711a-4870-a8e6-dcde970e4975(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 16:01:42 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[747fa372-35e4-4a35-a672-21570c281eff]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:01:42 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b6c8b0bf-ae47-4281-bb3b-708629cc9765 tempest-VolumesSnapshotTestJSON-1988768782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3ca5ae16-711a-4870-a8e6-dcde970e4975 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:01:42 devstack sudo[98188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3ca5ae16-711a-4870-a8e6-dcde970e4975 Aug 10 16:01:42 devstack sudo[98188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:01:42 devstack sudo[98188]: pam_unix(sudo:session): session closed for user root Aug 10 16:01:42 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b6c8b0bf-ae47-4281-bb3b-708629cc9765 tempest-VolumesSnapshotTestJSON-1988768782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3ca5ae16-711a-4870-a8e6-dcde970e4975" returned: 0 in 0.424s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:01:42 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-b6c8b0bf-ae47-4281-bb3b-708629cc9765 tempest-VolumesSnapshotTestJSON-1988768782 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3ca5ae16-711a-4870-a8e6-dcde970e4975 {{(pid=88641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 10 16:01:42 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-b6c8b0bf-ae47-4281-bb3b-708629cc9765 tempest-VolumesSnapshotTestJSON-1988768782 None] Creating direct copy from snapshot {{(pid=88641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 10 16:01:42 devstack cinder-volume[88641]: DEBUG cinder.utils [None req-b6c8b0bf-ae47-4281-bb3b-708629cc9765 tempest-VolumesSnapshotTestJSON-1988768782 None] Path /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6e69e527-5b6e-49cf-93f0-7a521a972bc7 not found in is_blk_device check {{(pid=88641) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 10 16:01:42 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b6c8b0bf-ae47-4281-bb3b-708629cc9765 tempest-VolumesSnapshotTestJSON-1988768782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3ca5ae16-711a-4870-a8e6-dcde970e4975 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6e69e527-5b6e-49cf-93f0-7a521a972bc7 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:01:42 devstack sudo[98194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3ca5ae16-711a-4870-a8e6-dcde970e4975 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6e69e527-5b6e-49cf-93f0-7a521a972bc7 Aug 10 16:01:42 devstack sudo[98194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:01:43 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-51f8d056-1852-4a49-a597-fec2484582f1 tempest-GroupsTest-278860274 None] Group tempest-Group2-1899757917: creating Aug 10 16:01:43 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-51f8d056-1852-4a49-a597-fec2484582f1 tempest-GroupsTest-278860274 None] Group tempest-Group2-1899757917: created successfully Aug 10 16:01:43 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-51f8d056-1852-4a49-a597-fec2484582f1 tempest-GroupsTest-278860274 None] Create group completed successfully. Aug 10 16:01:45 devstack cinder-volume[88641]: DEBUG cinder.image.image_utils [None req-9c917999-455f-45c8-b691-a7fe5b16f4b0 tempest-TestInstancesWithCinderVolumes-1565760524 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f4c8c6d9-10ae-4b4f-80d5-d661a3aa58ff_tldwsffpdevstack@QuobyteHD, size 20.69 MB, duration 6.52 sec {{(pid=88641) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 10 16:01:45 devstack cinder-volume[88641]: INFO cinder.image.image_utils [None req-9c917999-455f-45c8-b691-a7fe5b16f4b0 tempest-TestInstancesWithCinderVolumes-1565760524 None] Image download 20.69 MB at 3.17 MB/s Aug 10 16:01:45 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[adaf7464-818c-42cf-8fcd-9463f8f364fd]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:01:45 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9c917999-455f-45c8-b691-a7fe5b16f4b0 tempest-TestInstancesWithCinderVolumes-1565760524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4c8c6d9-10ae-4b4f-80d5-d661a3aa58ff_tldwsffpdevstack@QuobyteHD {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:01:46 devstack sudo[98206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4c8c6d9-10ae-4b4f-80d5-d661a3aa58ff_tldwsffpdevstack@QuobyteHD Aug 10 16:01:46 devstack sudo[98206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:01:46 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-8856d537-03b5-416e-83eb-68f8cba8a08f tempest-GroupsTest-278860274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:01:46 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-8856d537-03b5-416e-83eb-68f8cba8a08f tempest-GroupsTest-278860274 None] Flow 'volume_create_manager' (63d84a4d-0967-4a48-8291-eb2fde99b56b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:01:46 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-8856d537-03b5-416e-83eb-68f8cba8a08f tempest-GroupsTest-278860274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4ea3bbd-fb53-4b63-aad8-3954b153d264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:01:46 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-8856d537-03b5-416e-83eb-68f8cba8a08f tempest-GroupsTest-278860274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4ea3bbd-fb53-4b63-aad8-3954b153d264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:01:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1055691562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d526bb82-e8f6-4380-a3d4-cf70ae05fcad,host='devstack@QuobyteHD#QuobyteHD',id=aec893dc-5c4a-4aa3-8678-117adc84d808,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f7ec07e258c44f5bea5c6f27304c6e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:01:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:01:46Z,use_quota=True,user_id='0f355310a6d4414db2b138b1e974ead7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(96dd57c3-e588-43d9-a3d5-8f23feed985b),volume_type_id=96dd57c3-e588-43d9-a3d5-8f23feed985b)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:01:46 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-8856d537-03b5-416e-83eb-68f8cba8a08f tempest-GroupsTest-278860274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69ec48d9-dc5e-49f7-b3d5-f27e51c3045a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:01:46 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-8856d537-03b5-416e-83eb-68f8cba8a08f tempest-GroupsTest-278860274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69ec48d9-dc5e-49f7-b3d5-f27e51c3045a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:01:46 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-8856d537-03b5-416e-83eb-68f8cba8a08f tempest-GroupsTest-278860274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5b619ca-d702-49e8-8309-b8bc5141fad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:01:46 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-8856d537-03b5-416e-83eb-68f8cba8a08f tempest-GroupsTest-278860274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5b619ca-d702-49e8-8309-b8bc5141fad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aec893dc-5c4a-4aa3-8678-117adc84d808', 'volume_name': 'volume-aec893dc-5c4a-4aa3-8678-117adc84d808', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:01:46 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-8856d537-03b5-416e-83eb-68f8cba8a08f tempest-GroupsTest-278860274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95274954-7696-4fa6-88c5-e9abb9765c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:01:46 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-8856d537-03b5-416e-83eb-68f8cba8a08f tempest-GroupsTest-278860274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95274954-7696-4fa6-88c5-e9abb9765c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:01:46 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-8856d537-03b5-416e-83eb-68f8cba8a08f tempest-GroupsTest-278860274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de65186f-72ca-41bd-8142-47333785131d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:01:46 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-8856d537-03b5-416e-83eb-68f8cba8a08f tempest-GroupsTest-278860274 None] Volume aec893dc-5c4a-4aa3-8678-117adc84d808: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aec893dc-5c4a-4aa3-8678-117adc84d808', 'volume_size': 1} Aug 10 16:01:46 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-8856d537-03b5-416e-83eb-68f8cba8a08f tempest-GroupsTest-278860274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:01:46 devstack sudo[98206]: pam_unix(sudo:session): session closed for user root Aug 10 16:01:46 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9c917999-455f-45c8-b691-a7fe5b16f4b0 tempest-TestInstancesWithCinderVolumes-1565760524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4c8c6d9-10ae-4b4f-80d5-d661a3aa58ff_tldwsffpdevstack@QuobyteHD" returned: 0 in 0.742s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:01:46 devstack cinder-volume[88641]: DEBUG cinder.image.image_utils [None req-9c917999-455f-45c8-b691-a7fe5b16f4b0 tempest-TestInstancesWithCinderVolumes-1565760524 None] Temporary image f4c8c6d9-10ae-4b4f-80d5-d661a3aa58ff is fetched for user 479fef74d7404d0db46406fc88cdfadc. {{(pid=88641) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 10 16:01:46 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f67b72f-07dc-48cd-960a-83d3ac38a038]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:01:46 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9c917999-455f-45c8-b691-a7fe5b16f4b0 tempest-TestInstancesWithCinderVolumes-1565760524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4c8c6d9-10ae-4b4f-80d5-d661a3aa58ff_tldwsffpdevstack@QuobyteHD {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:01:47 devstack sudo[98211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4c8c6d9-10ae-4b4f-80d5-d661a3aa58ff_tldwsffpdevstack@QuobyteHD Aug 10 16:01:47 devstack sudo[98211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:01:47 devstack sudo[98211]: pam_unix(sudo:session): session closed for user root Aug 10 16:01:47 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9c917999-455f-45c8-b691-a7fe5b16f4b0 tempest-TestInstancesWithCinderVolumes-1565760524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4c8c6d9-10ae-4b4f-80d5-d661a3aa58ff_tldwsffpdevstack@QuobyteHD" returned: 0 in 0.925s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:01:47 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-9c917999-455f-45c8-b691-a7fe5b16f4b0 tempest-TestInstancesWithCinderVolumes-1565760524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:01:48 devstack sudo[98194]: pam_unix(sudo:session): session closed for user root Aug 10 16:01:48 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b6c8b0bf-ae47-4281-bb3b-708629cc9765 tempest-VolumesSnapshotTestJSON-1988768782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3ca5ae16-711a-4870-a8e6-dcde970e4975 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6e69e527-5b6e-49cf-93f0-7a521a972bc7" returned: 0 in 6.025s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:01:48 devstack cinder-volume[88641]: DEBUG cinder.image.image_utils [None req-b6c8b0bf-ae47-4281-bb3b-708629cc9765 tempest-VolumesSnapshotTestJSON-1988768782 None] Image conversion details: src /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3ca5ae16-711a-4870-a8e6-dcde970e4975, size 1024.00 MB, duration 6.03 sec, destination /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6e69e527-5b6e-49cf-93f0-7a521a972bc7 {{(pid=88641) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 10 16:01:48 devstack cinder-volume[88641]: INFO cinder.image.image_utils [None req-b6c8b0bf-ae47-4281-bb3b-708629cc9765 tempest-VolumesSnapshotTestJSON-1988768782 None] Converted 1024.00 MB image at 169.94 MB/s Aug 10 16:01:48 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-b6c8b0bf-ae47-4281-bb3b-708629cc9765 tempest-VolumesSnapshotTestJSON-1988768782 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6e69e527-5b6e-49cf-93f0-7a521a972bc7 is being set with open permissions: ugo+rw Aug 10 16:01:48 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b6c8b0bf-ae47-4281-bb3b-708629cc9765 tempest-VolumesSnapshotTestJSON-1988768782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6e69e527-5b6e-49cf-93f0-7a521a972bc7 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:01:48 devstack sudo[98216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6e69e527-5b6e-49cf-93f0-7a521a972bc7 Aug 10 16:01:48 devstack sudo[98216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:01:48 devstack sudo[98216]: pam_unix(sudo:session): session closed for user root Aug 10 16:01:48 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b6c8b0bf-ae47-4281-bb3b-708629cc9765 tempest-VolumesSnapshotTestJSON-1988768782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6e69e527-5b6e-49cf-93f0-7a521a972bc7" returned: 0 in 0.292s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:01:48 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-b6c8b0bf-ae47-4281-bb3b-708629cc9765 tempest-VolumesSnapshotTestJSON-1988768782 None] Lock "cinder-quobyte-6e69e527-5b6e-49cf-93f0-7a521a972bc7" released by "_copy_volume_from_snapshot" :: held 7.376s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:01:48 devstack cinder-volume[88641]: DEBUG dbcounter [-] [88641] Writing DB stats cinder:SELECT=121,cinder:UPDATE=133,cinder:INSERT=32,cinder:DELETE=6 {{(pid=88641) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 16:01:48 devstack cinder-volume[88641]: DEBUG dbcounter [-] [88641] Writing DB stats cinder:SELECT=117,cinder:UPDATE=136,cinder:INSERT=36,cinder:DELETE=11 {{(pid=88641) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 16:01:48 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-b6c8b0bf-ae47-4281-bb3b-708629cc9765 tempest-VolumesSnapshotTestJSON-1988768782 None] Lock "cinder-quobyte-a7a9d3de-9549-49e4-8e15-9f46eb685e9e-6e69e527-5b6e-49cf-93f0-7a521a972bc7" released by "_create_volume_from_snapshot" :: held 7.462s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:01:48 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-b6c8b0bf-ae47-4281-bb3b-708629cc9765 tempest-VolumesSnapshotTestJSON-1988768782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.514s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:01:48 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-8856d537-03b5-416e-83eb-68f8cba8a08f tempest-GroupsTest-278860274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.390s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:01:48 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-8856d537-03b5-416e-83eb-68f8cba8a08f tempest-GroupsTest-278860274 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d526bb82-e8f6-4380-a3d4-cf70ae05fcad,created_at=2026-08-10T14:01:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1055691562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d526bb82-e8f6-4380-a3d4-cf70ae05fcad,host='devstack@QuobyteHD#QuobyteHD',id=aec893dc-5c4a-4aa3-8678-117adc84d808,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f7ec07e258c44f5bea5c6f27304c6e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:01:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:01:46Z,use_quota=True,user_id='0f355310a6d4414db2b138b1e974ead7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(96dd57c3-e588-43d9-a3d5-8f23feed985b),volume_type_id=96dd57c3-e588-43d9-a3d5-8f23feed985b)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:01:48 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-8856d537-03b5-416e-83eb-68f8cba8a08f tempest-GroupsTest-278860274 None] Creating volume aec893dc-5c4a-4aa3-8678-117adc84d808 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:01:48 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-8856d537-03b5-416e-83eb-68f8cba8a08f tempest-GroupsTest-278860274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:01:48 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-8856d537-03b5-416e-83eb-68f8cba8a08f tempest-GroupsTest-278860274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:01:48 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-8856d537-03b5-416e-83eb-68f8cba8a08f tempest-GroupsTest-278860274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:01:48 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-8856d537-03b5-416e-83eb-68f8cba8a08f tempest-GroupsTest-278860274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:01:48 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-8856d537-03b5-416e-83eb-68f8cba8a08f tempest-GroupsTest-278860274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:01:48 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-8856d537-03b5-416e-83eb-68f8cba8a08f tempest-GroupsTest-278860274 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:01:48 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-8856d537-03b5-416e-83eb-68f8cba8a08f tempest-GroupsTest-278860274 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:01:48 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-8856d537-03b5-416e-83eb-68f8cba8a08f tempest-GroupsTest-278860274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-aec893dc-5c4a-4aa3-8678-117adc84d808 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:01:49 devstack sudo[98219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-aec893dc-5c4a-4aa3-8678-117adc84d808 1073741824 Aug 10 16:01:49 devstack sudo[98219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:01:49 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b6c8b0bf-ae47-4281-bb3b-708629cc9765 tempest-VolumesSnapshotTestJSON-1988768782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86713ece-c929-43ca-b503-870b81243cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e69e527-5b6e-49cf-93f0-7a521a972bc7', 'volume_size': 2, 'snapshot_id': 'a7a9d3de-9549-49e4-8e15-9f46eb685e9e'}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:01:49 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b6c8b0bf-ae47-4281-bb3b-708629cc9765 tempest-VolumesSnapshotTestJSON-1988768782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5386874-94f7-4ccb-958a-67ade3248108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:01:49 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-b6c8b0bf-ae47-4281-bb3b-708629cc9765 tempest-VolumesSnapshotTestJSON-1988768782 None] Volume volume-6e69e527-5b6e-49cf-93f0-7a521a972bc7 (6e69e527-5b6e-49cf-93f0-7a521a972bc7): created successfully Aug 10 16:01:49 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b6c8b0bf-ae47-4281-bb3b-708629cc9765 tempest-VolumesSnapshotTestJSON-1988768782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5386874-94f7-4ccb-958a-67ade3248108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:01:49 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b6c8b0bf-ae47-4281-bb3b-708629cc9765 tempest-VolumesSnapshotTestJSON-1988768782 None] Flow 'volume_create_manager' (f1b5272b-dbbc-4793-b58f-828a631e477a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:01:49 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-b6c8b0bf-ae47-4281-bb3b-708629cc9765 tempest-VolumesSnapshotTestJSON-1988768782 None] Created volume successfully. Aug 10 16:01:49 devstack sudo[98219]: pam_unix(sudo:session): session closed for user root Aug 10 16:01:49 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-8856d537-03b5-416e-83eb-68f8cba8a08f tempest-GroupsTest-278860274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-aec893dc-5c4a-4aa3-8678-117adc84d808 1073741824" returned: 0 in 0.530s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:01:49 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-8856d537-03b5-416e-83eb-68f8cba8a08f tempest-GroupsTest-278860274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-aec893dc-5c4a-4aa3-8678-117adc84d808 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:01:49 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-e5533c35-3d9c-40d5-98e2-84be7570700d tempest-VolumesSnapshotTestJSON-1988768782 None] Acquiring lock "cinder-6e69e527-5b6e-49cf-93f0-7a521a972bc7-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:01:49 devstack sudo[98225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-aec893dc-5c4a-4aa3-8678-117adc84d808 Aug 10 16:01:49 devstack sudo[98225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:01:49 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-e5533c35-3d9c-40d5-98e2-84be7570700d tempest-VolumesSnapshotTestJSON-1988768782 None] Lock "cinder-6e69e527-5b6e-49cf-93f0-7a521a972bc7-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:01:49 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-e5533c35-3d9c-40d5-98e2-84be7570700d tempest-VolumesSnapshotTestJSON-1988768782 None] Acquiring lock "cinder-quobyte-6e69e527-5b6e-49cf-93f0-7a521a972bc7" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:01:49 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-e5533c35-3d9c-40d5-98e2-84be7570700d tempest-VolumesSnapshotTestJSON-1988768782 None] Lock "cinder-quobyte-6e69e527-5b6e-49cf-93f0-7a521a972bc7" acquired by "delete_volume" :: waited 0.024s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:01:49 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa3165f-41b6-46e3-bca1-fdf6c9b605e0]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:01:49 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e5533c35-3d9c-40d5-98e2-84be7570700d tempest-VolumesSnapshotTestJSON-1988768782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6e69e527-5b6e-49cf-93f0-7a521a972bc7 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:01:49 devstack sudo[98225]: pam_unix(sudo:session): session closed for user root Aug 10 16:01:49 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-8856d537-03b5-416e-83eb-68f8cba8a08f tempest-GroupsTest-278860274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-aec893dc-5c4a-4aa3-8678-117adc84d808" returned: 0 in 0.289s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:01:49 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-8856d537-03b5-416e-83eb-68f8cba8a08f tempest-GroupsTest-278860274 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:01:49 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-8856d537-03b5-416e-83eb-68f8cba8a08f tempest-GroupsTest-278860274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:01:49 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-9c917999-455f-45c8-b691-a7fe5b16f4b0 tempest-TestInstancesWithCinderVolumes-1565760524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.040s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:01:49 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-9c917999-455f-45c8-b691-a7fe5b16f4b0 tempest-TestInstancesWithCinderVolumes-1565760524 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:01:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-216459720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a36b2e78-b3cd-4dd3-81dd-0b0d72f07b15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdb3ecc5dba349e78619e7090406c2c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:01:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:01:38Z,use_quota=True,user_id='479fef74d7404d0db46406fc88cdfadc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b9860326-2377-4853-bef3-d1d384599606),volume_type_id=b9860326-2377-4853-bef3-d1d384599606)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:01:49 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-9c917999-455f-45c8-b691-a7fe5b16f4b0 tempest-TestInstancesWithCinderVolumes-1565760524 None] Creating volume a36b2e78-b3cd-4dd3-81dd-0b0d72f07b15 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:01:49 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-9c917999-455f-45c8-b691-a7fe5b16f4b0 tempest-TestInstancesWithCinderVolumes-1565760524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:01:49 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-9c917999-455f-45c8-b691-a7fe5b16f4b0 tempest-TestInstancesWithCinderVolumes-1565760524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:01:49 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-9c917999-455f-45c8-b691-a7fe5b16f4b0 tempest-TestInstancesWithCinderVolumes-1565760524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:01:49 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-9c917999-455f-45c8-b691-a7fe5b16f4b0 tempest-TestInstancesWithCinderVolumes-1565760524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:01:49 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-9c917999-455f-45c8-b691-a7fe5b16f4b0 tempest-TestInstancesWithCinderVolumes-1565760524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:01:49 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-9c917999-455f-45c8-b691-a7fe5b16f4b0 tempest-TestInstancesWithCinderVolumes-1565760524 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:01:49 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-9c917999-455f-45c8-b691-a7fe5b16f4b0 tempest-TestInstancesWithCinderVolumes-1565760524 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:01:49 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9c917999-455f-45c8-b691-a7fe5b16f4b0 tempest-TestInstancesWithCinderVolumes-1565760524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a36b2e78-b3cd-4dd3-81dd-0b0d72f07b15 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:01:49 devstack sudo[98227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6e69e527-5b6e-49cf-93f0-7a521a972bc7 Aug 10 16:01:49 devstack sudo[98227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:01:49 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-8856d537-03b5-416e-83eb-68f8cba8a08f tempest-GroupsTest-278860274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de65186f-72ca-41bd-8142-47333785131d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aec893dc-5c4a-4aa3-8678-117adc84d808', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:01:49 devstack sudo[98229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a36b2e78-b3cd-4dd3-81dd-0b0d72f07b15 1073741824 Aug 10 16:01:49 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-8856d537-03b5-416e-83eb-68f8cba8a08f tempest-GroupsTest-278860274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7ba5576-b970-48a3-9961-d1821e2eb7c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:01:49 devstack sudo[98229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:01:49 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-8856d537-03b5-416e-83eb-68f8cba8a08f tempest-GroupsTest-278860274 None] Volume volume-aec893dc-5c4a-4aa3-8678-117adc84d808 (aec893dc-5c4a-4aa3-8678-117adc84d808): created successfully Aug 10 16:01:49 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-8856d537-03b5-416e-83eb-68f8cba8a08f tempest-GroupsTest-278860274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7ba5576-b970-48a3-9961-d1821e2eb7c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:01:49 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-8856d537-03b5-416e-83eb-68f8cba8a08f tempest-GroupsTest-278860274 None] Flow 'volume_create_manager' (63d84a4d-0967-4a48-8291-eb2fde99b56b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:01:49 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-8856d537-03b5-416e-83eb-68f8cba8a08f tempest-GroupsTest-278860274 None] Created volume successfully. Aug 10 16:01:50 devstack sudo[98227]: pam_unix(sudo:session): session closed for user root Aug 10 16:01:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e5533c35-3d9c-40d5-98e2-84be7570700d tempest-VolumesSnapshotTestJSON-1988768782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6e69e527-5b6e-49cf-93f0-7a521a972bc7" returned: 0 in 0.431s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:01:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e5533c35-3d9c-40d5-98e2-84be7570700d tempest-VolumesSnapshotTestJSON-1988768782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6e69e527-5b6e-49cf-93f0-7a521a972bc7 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:01:50 devstack sudo[98238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6e69e527-5b6e-49cf-93f0-7a521a972bc7 Aug 10 16:01:50 devstack sudo[98238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:01:50 devstack sudo[98229]: pam_unix(sudo:session): session closed for user root Aug 10 16:01:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9c917999-455f-45c8-b691-a7fe5b16f4b0 tempest-TestInstancesWithCinderVolumes-1565760524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a36b2e78-b3cd-4dd3-81dd-0b0d72f07b15 1073741824" returned: 0 in 0.625s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:01:50 devstack sudo[98238]: pam_unix(sudo:session): session closed for user root Aug 10 16:01:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e5533c35-3d9c-40d5-98e2-84be7570700d tempest-VolumesSnapshotTestJSON-1988768782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6e69e527-5b6e-49cf-93f0-7a521a972bc7" returned: 0 in 0.329s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:01:50 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-e5533c35-3d9c-40d5-98e2-84be7570700d tempest-VolumesSnapshotTestJSON-1988768782 None] Lock "cinder-quobyte-6e69e527-5b6e-49cf-93f0-7a521a972bc7" released by "delete_volume" :: held 0.823s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:01:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9c917999-455f-45c8-b691-a7fe5b16f4b0 tempest-TestInstancesWithCinderVolumes-1565760524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a36b2e78-b3cd-4dd3-81dd-0b0d72f07b15 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:01:50 devstack sudo[98277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a36b2e78-b3cd-4dd3-81dd-0b0d72f07b15 Aug 10 16:01:50 devstack sudo[98277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:01:50 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-e5533c35-3d9c-40d5-98e2-84be7570700d tempest-VolumesSnapshotTestJSON-1988768782 None] Created reservations ['0519862b-ca70-4b84-a237-84632245faff', '61979ed4-94c1-457a-8660-9ef3d8468eb0', '0e277841-c942-4cf2-a484-0f56134ab9cd', '90b8ca93-6627-4222-bd38-f254377a9168'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:01:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-e5533c35-3d9c-40d5-98e2-84be7570700d tempest-VolumesSnapshotTestJSON-1988768782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:01:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-e5533c35-3d9c-40d5-98e2-84be7570700d tempest-VolumesSnapshotTestJSON-1988768782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:01:50 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-e5533c35-3d9c-40d5-98e2-84be7570700d tempest-VolumesSnapshotTestJSON-1988768782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:01:50 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-e5533c35-3d9c-40d5-98e2-84be7570700d tempest-VolumesSnapshotTestJSON-1988768782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:01:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-e5533c35-3d9c-40d5-98e2-84be7570700d tempest-VolumesSnapshotTestJSON-1988768782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:01:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e5533c35-3d9c-40d5-98e2-84be7570700d tempest-VolumesSnapshotTestJSON-1988768782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:01:50 devstack sudo[98279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:01:50 devstack sudo[98279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:01:51 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-77b6ba6d-afad-47dc-a138-65b4cc079549 tempest-VolumesSnapshotTestJSON-1988768782 None] Acquiring lock "cinder-a7a9d3de-9549-49e4-8e15-9f46eb685e9e-delete_snapshot" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:01:51 devstack sudo[98279]: pam_unix(sudo:session): session closed for user root Aug 10 16:01:51 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-77b6ba6d-afad-47dc-a138-65b4cc079549 tempest-VolumesSnapshotTestJSON-1988768782 None] Lock "cinder-a7a9d3de-9549-49e4-8e15-9f46eb685e9e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:01:51 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-77b6ba6d-afad-47dc-a138-65b4cc079549 tempest-VolumesSnapshotTestJSON-1988768782 None] Acquiring lock "cinder-quobyte-3ca5ae16-711a-4870-a8e6-dcde970e4975" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:01:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e5533c35-3d9c-40d5-98e2-84be7570700d tempest-VolumesSnapshotTestJSON-1988768782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.419s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:01:51 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-e5533c35-3d9c-40d5-98e2-84be7570700d tempest-VolumesSnapshotTestJSON-1988768782 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:01:51 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-e5533c35-3d9c-40d5-98e2-84be7570700d tempest-VolumesSnapshotTestJSON-1988768782 None] Deleted volume successfully. Aug 10 16:01:51 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-fb030fa5-cde9-4b86-a724-9190263e76de tempest-GroupsTest-278860274 None] Acquiring lock "cinder-quobyte-aec893dc-5c4a-4aa3-8678-117adc84d808" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:01:51 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-77b6ba6d-afad-47dc-a138-65b4cc079549 tempest-VolumesSnapshotTestJSON-1988768782 None] Lock "cinder-quobyte-3ca5ae16-711a-4870-a8e6-dcde970e4975" acquired by "delete_snapshot" :: waited 0.044s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:01:51 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-77b6ba6d-afad-47dc-a138-65b4cc079549 tempest-VolumesSnapshotTestJSON-1988768782 None] Acquiring lock "cinder-quobyte-a7a9d3de-9549-49e4-8e15-9f46eb685e9e" by "_delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:01:51 devstack sudo[98277]: pam_unix(sudo:session): session closed for user root Aug 10 16:01:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9c917999-455f-45c8-b691-a7fe5b16f4b0 tempest-TestInstancesWithCinderVolumes-1565760524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a36b2e78-b3cd-4dd3-81dd-0b0d72f07b15" returned: 0 in 0.661s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:01:51 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-9c917999-455f-45c8-b691-a7fe5b16f4b0 tempest-TestInstancesWithCinderVolumes-1565760524 None] <== create_volume: return (1356ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:01:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-9c917999-455f-45c8-b691-a7fe5b16f4b0 tempest-TestInstancesWithCinderVolumes-1565760524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.360s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:01:51 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-fb030fa5-cde9-4b86-a724-9190263e76de tempest-GroupsTest-278860274 None] Lock "cinder-quobyte-aec893dc-5c4a-4aa3-8678-117adc84d808" acquired by "delete_volume" :: waited 0.036s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:01:51 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-e5533c35-3d9c-40d5-98e2-84be7570700d tempest-VolumesSnapshotTestJSON-1988768782 None] Lock "cinder-6e69e527-5b6e-49cf-93f0-7a521a972bc7-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:01:51 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-77b6ba6d-afad-47dc-a138-65b4cc079549 tempest-VolumesSnapshotTestJSON-1988768782 None] Lock "cinder-quobyte-a7a9d3de-9549-49e4-8e15-9f46eb685e9e" acquired by "_delete_snapshot" :: waited 0.056s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:01:51 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-77b6ba6d-afad-47dc-a138-65b4cc079549 tempest-VolumesSnapshotTestJSON-1988768782 None] Deleting offline snapshot a7a9d3de-9549-49e4-8e15-9f46eb685e9e of volume 3ca5ae16-711a-4870-a8e6-dcde970e4975 {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 16:01:51 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-77b6ba6d-afad-47dc-a138-65b4cc079549 tempest-VolumesSnapshotTestJSON-1988768782 None] snapshot_file for this snap is: volume-3ca5ae16-711a-4870-a8e6-dcde970e4975.a7a9d3de-9549-49e4-8e15-9f46eb685e9e {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 16:01:51 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ee8994-ece4-4cdf-b608-216e21d02bd8]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:01:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fb030fa5-cde9-4b86-a724-9190263e76de tempest-GroupsTest-278860274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-aec893dc-5c4a-4aa3-8678-117adc84d808 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:01:51 devstack cinder-volume[88641]: DEBUG cinder.volume.volume_utils [None req-9c917999-455f-45c8-b691-a7fe5b16f4b0 tempest-TestInstancesWithCinderVolumes-1565760524 None] Attempting download of f4c8c6d9-10ae-4b4f-80d5-d661a3aa58ff ((None, [{'url': 'file:///opt/stack/data/glance/images/f4c8c6d9-10ae-4b4f-80d5-d661a3aa58ff', 'metadata': {}}])) to volume a36b2e78-b3cd-4dd3-81dd-0b0d72f07b15. {{(pid=88641) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 10 16:01:51 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a9febc-9e7b-41e7-a22e-9f3de51cf25c]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:01:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-77b6ba6d-afad-47dc-a138-65b4cc079549 tempest-VolumesSnapshotTestJSON-1988768782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3ca5ae16-711a-4870-a8e6-dcde970e4975.a7a9d3de-9549-49e4-8e15-9f46eb685e9e {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:01:51 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aee18c8-ed1e-4daf-9979-f614a31642f1]: (4, 'raw') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:01:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9c917999-455f-45c8-b691-a7fe5b16f4b0 tempest-TestInstancesWithCinderVolumes-1565760524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f4c8c6d9-10ae-4b4f-80d5-d661a3aa58ff_xwylz5we {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:01:51 devstack sudo[98285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-aec893dc-5c4a-4aa3-8678-117adc84d808 Aug 10 16:01:51 devstack sudo[98285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:01:51 devstack sudo[98286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3ca5ae16-711a-4870-a8e6-dcde970e4975.a7a9d3de-9549-49e4-8e15-9f46eb685e9e Aug 10 16:01:51 devstack sudo[98286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:01:51 devstack sudo[98287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f4c8c6d9-10ae-4b4f-80d5-d661a3aa58ff_xwylz5we Aug 10 16:01:51 devstack sudo[98287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:01:51 devstack sudo[98285]: pam_unix(sudo:session): session closed for user root Aug 10 16:01:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fb030fa5-cde9-4b86-a724-9190263e76de tempest-GroupsTest-278860274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-aec893dc-5c4a-4aa3-8678-117adc84d808" returned: 0 in 0.544s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:01:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fb030fa5-cde9-4b86-a724-9190263e76de tempest-GroupsTest-278860274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-aec893dc-5c4a-4aa3-8678-117adc84d808 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:01:51 devstack sudo[98300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-aec893dc-5c4a-4aa3-8678-117adc84d808 Aug 10 16:01:51 devstack sudo[98300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:01:51 devstack sudo[98286]: pam_unix(sudo:session): session closed for user root Aug 10 16:01:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-77b6ba6d-afad-47dc-a138-65b4cc079549 tempest-VolumesSnapshotTestJSON-1988768782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3ca5ae16-711a-4870-a8e6-dcde970e4975.a7a9d3de-9549-49e4-8e15-9f46eb685e9e" returned: 0 in 0.562s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:01:51 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-77b6ba6d-afad-47dc-a138-65b4cc079549 tempest-VolumesSnapshotTestJSON-1988768782 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ca5ae16-711a-4870-a8e6-dcde970e4975(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 16:01:51 devstack sudo[98287]: pam_unix(sudo:session): session closed for user root Aug 10 16:01:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9c917999-455f-45c8-b691-a7fe5b16f4b0 tempest-TestInstancesWithCinderVolumes-1565760524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f4c8c6d9-10ae-4b4f-80d5-d661a3aa58ff_xwylz5we" returned: 0 in 0.515s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:01:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9c917999-455f-45c8-b691-a7fe5b16f4b0 tempest-TestInstancesWithCinderVolumes-1565760524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f4c8c6d9-10ae-4b4f-80d5-d661a3aa58ff_xwylz5we {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:01:51 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ddd810-4368-4dcb-a481-405a806edad1]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:01:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-77b6ba6d-afad-47dc-a138-65b4cc079549 tempest-VolumesSnapshotTestJSON-1988768782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3ca5ae16-711a-4870-a8e6-dcde970e4975 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:01:52 devstack sudo[98304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f4c8c6d9-10ae-4b4f-80d5-d661a3aa58ff_xwylz5we Aug 10 16:01:52 devstack sudo[98304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:01:52 devstack sudo[98300]: pam_unix(sudo:session): session closed for user root Aug 10 16:01:52 devstack sudo[98305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3ca5ae16-711a-4870-a8e6-dcde970e4975 Aug 10 16:01:52 devstack sudo[98305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:01:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fb030fa5-cde9-4b86-a724-9190263e76de tempest-GroupsTest-278860274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-aec893dc-5c4a-4aa3-8678-117adc84d808" returned: 0 in 0.294s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:01:52 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-fb030fa5-cde9-4b86-a724-9190263e76de tempest-GroupsTest-278860274 None] Lock "cinder-quobyte-aec893dc-5c4a-4aa3-8678-117adc84d808" released by "delete_volume" :: held 0.919s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:01:52 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-fb030fa5-cde9-4b86-a724-9190263e76de tempest-GroupsTest-278860274 None] Created reservations ['89b9bdc6-6907-4468-a0e0-a00d2c1f0079'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:01:52 devstack cinder-volume[88641]: WARNING cinder.quota [None req-fb030fa5-cde9-4b86-a724-9190263e76de tempest-GroupsTest-278860274 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1397239160 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1397239160, it is now deprecated. Please use the default quota class for default quota. Aug 10 16:01:52 devstack cinder-volume[88641]: WARNING cinder.quota [None req-fb030fa5-cde9-4b86-a724-9190263e76de tempest-GroupsTest-278860274 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1397239160 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1397239160, it is now deprecated. Please use the default quota class for default quota. Aug 10 16:01:52 devstack sudo[98304]: pam_unix(sudo:session): session closed for user root Aug 10 16:01:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9c917999-455f-45c8-b691-a7fe5b16f4b0 tempest-TestInstancesWithCinderVolumes-1565760524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f4c8c6d9-10ae-4b4f-80d5-d661a3aa58ff_xwylz5we" returned: 1 in 0.376s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:01:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9c917999-455f-45c8-b691-a7fe5b16f4b0 tempest-TestInstancesWithCinderVolumes-1565760524 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f4c8c6d9-10ae-4b4f-80d5-d661a3aa58ff_xwylz5we' failed. Not Retrying. {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 10 16:01:52 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a0f85e1-9334-422e-98cf-e9fa307f47e6]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:01:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9c917999-455f-45c8-b691-a7fe5b16f4b0 tempest-TestInstancesWithCinderVolumes-1565760524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4c8c6d9-10ae-4b4f-80d5-d661a3aa58ff_tldwsffpdevstack@QuobyteHD {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:01:52 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-fb030fa5-cde9-4b86-a724-9190263e76de tempest-GroupsTest-278860274 None] Created reservations ['85840501-23cf-4bd3-84a6-c880ad2cfbcb', '51441340-f0d8-48cc-8a4f-66be4c71274a', 'ed4fe75c-53f4-491f-be67-1fb37b520e25', 'f7037f91-1ee7-409c-a436-2a76abfc0492'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:01:52 devstack sudo[98311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4c8c6d9-10ae-4b4f-80d5-d661a3aa58ff_tldwsffpdevstack@QuobyteHD Aug 10 16:01:52 devstack sudo[98311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:01:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-fb030fa5-cde9-4b86-a724-9190263e76de tempest-GroupsTest-278860274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:01:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-fb030fa5-cde9-4b86-a724-9190263e76de tempest-GroupsTest-278860274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:01:52 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-fb030fa5-cde9-4b86-a724-9190263e76de tempest-GroupsTest-278860274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:01:52 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-fb030fa5-cde9-4b86-a724-9190263e76de tempest-GroupsTest-278860274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:01:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-fb030fa5-cde9-4b86-a724-9190263e76de tempest-GroupsTest-278860274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:01:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fb030fa5-cde9-4b86-a724-9190263e76de tempest-GroupsTest-278860274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:01:52 devstack sudo[98315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:01:52 devstack sudo[98315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:01:52 devstack sudo[98311]: pam_unix(sudo:session): session closed for user root Aug 10 16:01:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9c917999-455f-45c8-b691-a7fe5b16f4b0 tempest-TestInstancesWithCinderVolumes-1565760524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f4c8c6d9-10ae-4b4f-80d5-d661a3aa58ff_tldwsffpdevstack@QuobyteHD" returned: 0 in 0.468s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:01:52 devstack cinder-volume[88641]: DEBUG cinder.image.image_utils [None req-9c917999-455f-45c8-b691-a7fe5b16f4b0 tempest-TestInstancesWithCinderVolumes-1565760524 None] f4c8c6d9-10ae-4b4f-80d5-d661a3aa58ff was qcow2, converting to qcow2 {{(pid=88641) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 10 16:01:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9c917999-455f-45c8-b691-a7fe5b16f4b0 tempest-TestInstancesWithCinderVolumes-1565760524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f4c8c6d9-10ae-4b4f-80d5-d661a3aa58ff_tldwsffpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a36b2e78-b3cd-4dd3-81dd-0b0d72f07b15 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:01:52 devstack sudo[98322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f4c8c6d9-10ae-4b4f-80d5-d661a3aa58ff_tldwsffpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a36b2e78-b3cd-4dd3-81dd-0b0d72f07b15 Aug 10 16:01:52 devstack sudo[98322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:01:52 devstack sudo[98305]: pam_unix(sudo:session): session closed for user root Aug 10 16:01:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-77b6ba6d-afad-47dc-a138-65b4cc079549 tempest-VolumesSnapshotTestJSON-1988768782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3ca5ae16-711a-4870-a8e6-dcde970e4975" returned: 0 in 0.904s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:01:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-77b6ba6d-afad-47dc-a138-65b4cc079549 tempest-VolumesSnapshotTestJSON-1988768782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3ca5ae16-711a-4870-a8e6-dcde970e4975.a7a9d3de-9549-49e4-8e15-9f46eb685e9e {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:01:52 devstack sudo[98315]: pam_unix(sudo:session): session closed for user root Aug 10 16:01:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fb030fa5-cde9-4b86-a724-9190263e76de tempest-GroupsTest-278860274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.310s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:01:52 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-fb030fa5-cde9-4b86-a724-9190263e76de tempest-GroupsTest-278860274 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:01:52 devstack sudo[98324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3ca5ae16-711a-4870-a8e6-dcde970e4975.a7a9d3de-9549-49e4-8e15-9f46eb685e9e Aug 10 16:01:52 devstack sudo[98324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:01:52 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-fb030fa5-cde9-4b86-a724-9190263e76de tempest-GroupsTest-278860274 None] Delete group completed successfully. Aug 10 16:01:52 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-6d47cdbd-3150-44e1-a847-9c4f89516625 tempest-GroupsTest-278860274 None] Created reservations ['1d9e830a-2083-46ca-9e01-618d13007788'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:01:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-6d47cdbd-3150-44e1-a847-9c4f89516625 tempest-GroupsTest-278860274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:01:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-6d47cdbd-3150-44e1-a847-9c4f89516625 tempest-GroupsTest-278860274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:01:52 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-6d47cdbd-3150-44e1-a847-9c4f89516625 tempest-GroupsTest-278860274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:01:52 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-6d47cdbd-3150-44e1-a847-9c4f89516625 tempest-GroupsTest-278860274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:01:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-6d47cdbd-3150-44e1-a847-9c4f89516625 tempest-GroupsTest-278860274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:01:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6d47cdbd-3150-44e1-a847-9c4f89516625 tempest-GroupsTest-278860274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:01:53 devstack sudo[98326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:01:53 devstack sudo[98326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:01:53 devstack sudo[98324]: pam_unix(sudo:session): session closed for user root Aug 10 16:01:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-77b6ba6d-afad-47dc-a138-65b4cc079549 tempest-VolumesSnapshotTestJSON-1988768782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3ca5ae16-711a-4870-a8e6-dcde970e4975.a7a9d3de-9549-49e4-8e15-9f46eb685e9e" returned: 0 in 0.431s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:01:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-77b6ba6d-afad-47dc-a138-65b4cc079549 tempest-VolumesSnapshotTestJSON-1988768782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3ca5ae16-711a-4870-a8e6-dcde970e4975.a7a9d3de-9549-49e4-8e15-9f46eb685e9e {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:01:53 devstack sudo[98336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3ca5ae16-711a-4870-a8e6-dcde970e4975.a7a9d3de-9549-49e4-8e15-9f46eb685e9e Aug 10 16:01:53 devstack sudo[98336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:01:53 devstack sudo[98326]: pam_unix(sudo:session): session closed for user root Aug 10 16:01:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6d47cdbd-3150-44e1-a847-9c4f89516625 tempest-GroupsTest-278860274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.344s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:01:53 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-6d47cdbd-3150-44e1-a847-9c4f89516625 tempest-GroupsTest-278860274 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:01:53 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-6d47cdbd-3150-44e1-a847-9c4f89516625 tempest-GroupsTest-278860274 None] Delete group completed successfully. Aug 10 16:01:53 devstack sudo[98336]: pam_unix(sudo:session): session closed for user root Aug 10 16:01:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-77b6ba6d-afad-47dc-a138-65b4cc079549 tempest-VolumesSnapshotTestJSON-1988768782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3ca5ae16-711a-4870-a8e6-dcde970e4975.a7a9d3de-9549-49e4-8e15-9f46eb685e9e" returned: 0 in 0.282s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:01:53 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-77b6ba6d-afad-47dc-a138-65b4cc079549 tempest-VolumesSnapshotTestJSON-1988768782 None] Lock "cinder-quobyte-a7a9d3de-9549-49e4-8e15-9f46eb685e9e" released by "_delete_snapshot" :: held 2.337s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:01:53 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-77b6ba6d-afad-47dc-a138-65b4cc079549 tempest-VolumesSnapshotTestJSON-1988768782 None] Lock "cinder-quobyte-3ca5ae16-711a-4870-a8e6-dcde970e4975" released by "delete_snapshot" :: held 2.404s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:01:53 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-77b6ba6d-afad-47dc-a138-65b4cc079549 tempest-VolumesSnapshotTestJSON-1988768782 None] Created reservations ['1a52a321-3607-4699-91ab-674cf3466eb8', '556190a6-a7a1-489e-93bc-185bf10789e2', 'e58f17a7-f72f-4f7e-b9c2-0a250a32e616', 'd546dba4-9228-41a9-a4cb-f36a491c860a'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:01:53 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-77b6ba6d-afad-47dc-a138-65b4cc079549 tempest-VolumesSnapshotTestJSON-1988768782 None] Delete snapshot completed successfully. Aug 10 16:01:53 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-77b6ba6d-afad-47dc-a138-65b4cc079549 tempest-VolumesSnapshotTestJSON-1988768782 None] Lock "cinder-a7a9d3de-9549-49e4-8e15-9f46eb685e9e-delete_snapshot" released by "delete_snapshot" :: held 2.641s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:01:54 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-edbca0b8-4a8e-4b35-904f-ec160d880df7 tempest-VolumesSnapshotTestJSON-1988768782 None] Acquiring lock "cinder-3ca5ae16-711a-4870-a8e6-dcde970e4975-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:01:54 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-edbca0b8-4a8e-4b35-904f-ec160d880df7 tempest-VolumesSnapshotTestJSON-1988768782 None] Lock "cinder-3ca5ae16-711a-4870-a8e6-dcde970e4975-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:01:54 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-edbca0b8-4a8e-4b35-904f-ec160d880df7 tempest-VolumesSnapshotTestJSON-1988768782 None] Acquiring lock "cinder-quobyte-3ca5ae16-711a-4870-a8e6-dcde970e4975" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:01:54 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-edbca0b8-4a8e-4b35-904f-ec160d880df7 tempest-VolumesSnapshotTestJSON-1988768782 None] Lock "cinder-quobyte-3ca5ae16-711a-4870-a8e6-dcde970e4975" acquired by "delete_volume" :: waited 0.028s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:01:54 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6028fe2-99e8-44bd-a0df-6ee792b3b37b]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:01:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-edbca0b8-4a8e-4b35-904f-ec160d880df7 tempest-VolumesSnapshotTestJSON-1988768782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3ca5ae16-711a-4870-a8e6-dcde970e4975 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:01:54 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-7313fe8a-00fd-4c11-a9fc-d12cc148d988 tempest-GroupsTest-278860274 None] Group tempest-GroupsTest-Group-1210742321: creating Aug 10 16:01:54 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-7313fe8a-00fd-4c11-a9fc-d12cc148d988 tempest-GroupsTest-278860274 None] Group tempest-GroupsTest-Group-1210742321: created successfully Aug 10 16:01:54 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-7313fe8a-00fd-4c11-a9fc-d12cc148d988 tempest-GroupsTest-278860274 None] Create group completed successfully. Aug 10 16:01:54 devstack sudo[98350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3ca5ae16-711a-4870-a8e6-dcde970e4975 Aug 10 16:01:54 devstack sudo[98350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:01:55 devstack sudo[98322]: pam_unix(sudo:session): session closed for user root Aug 10 16:01:55 devstack sudo[98350]: pam_unix(sudo:session): session closed for user root Aug 10 16:01:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9c917999-455f-45c8-b691-a7fe5b16f4b0 tempest-TestInstancesWithCinderVolumes-1565760524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f4c8c6d9-10ae-4b4f-80d5-d661a3aa58ff_tldwsffpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a36b2e78-b3cd-4dd3-81dd-0b0d72f07b15" returned: 0 in 2.513s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:01:55 devstack cinder-volume[88641]: DEBUG cinder.image.image_utils [None req-9c917999-455f-45c8-b691-a7fe5b16f4b0 tempest-TestInstancesWithCinderVolumes-1565760524 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f4c8c6d9-10ae-4b4f-80d5-d661a3aa58ff_tldwsffpdevstack@QuobyteHD, size 112.00 MB, duration 2.51 sec, destination /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a36b2e78-b3cd-4dd3-81dd-0b0d72f07b15 {{(pid=88641) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 10 16:01:55 devstack cinder-volume[88641]: INFO cinder.image.image_utils [None req-9c917999-455f-45c8-b691-a7fe5b16f4b0 tempest-TestInstancesWithCinderVolumes-1565760524 None] Converted 112.00 MB image at 44.56 MB/s Aug 10 16:01:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9c917999-455f-45c8-b691-a7fe5b16f4b0 tempest-TestInstancesWithCinderVolumes-1565760524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a36b2e78-b3cd-4dd3-81dd-0b0d72f07b15 1G {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:01:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-edbca0b8-4a8e-4b35-904f-ec160d880df7 tempest-VolumesSnapshotTestJSON-1988768782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3ca5ae16-711a-4870-a8e6-dcde970e4975" returned: 0 in 0.576s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:01:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-edbca0b8-4a8e-4b35-904f-ec160d880df7 tempest-VolumesSnapshotTestJSON-1988768782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3ca5ae16-711a-4870-a8e6-dcde970e4975 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:01:55 devstack sudo[98356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a36b2e78-b3cd-4dd3-81dd-0b0d72f07b15 1G Aug 10 16:01:55 devstack sudo[98356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:01:55 devstack sudo[98357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3ca5ae16-711a-4870-a8e6-dcde970e4975 Aug 10 16:01:55 devstack sudo[98357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:01:55 devstack sudo[98357]: pam_unix(sudo:session): session closed for user root Aug 10 16:01:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-edbca0b8-4a8e-4b35-904f-ec160d880df7 tempest-VolumesSnapshotTestJSON-1988768782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3ca5ae16-711a-4870-a8e6-dcde970e4975" returned: 0 in 0.298s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:01:55 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-edbca0b8-4a8e-4b35-904f-ec160d880df7 tempest-VolumesSnapshotTestJSON-1988768782 None] Lock "cinder-quobyte-3ca5ae16-711a-4870-a8e6-dcde970e4975" released by "delete_volume" :: held 0.964s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:01:55 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-edbca0b8-4a8e-4b35-904f-ec160d880df7 tempest-VolumesSnapshotTestJSON-1988768782 None] Created reservations ['db406d84-6604-4b14-be74-c3431ef7e49f', '6d63e61d-c51f-406b-a3dc-c43912e0ab38', '21506365-84a2-41c3-8f2d-d82765810f9a', 'b5b5feb9-f415-4417-9a43-615e858673ae'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:01:55 devstack sudo[98356]: pam_unix(sudo:session): session closed for user root Aug 10 16:01:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9c917999-455f-45c8-b691-a7fe5b16f4b0 tempest-TestInstancesWithCinderVolumes-1565760524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a36b2e78-b3cd-4dd3-81dd-0b0d72f07b15 1G" returned: 0 in 0.419s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:01:55 devstack cinder-volume[88641]: DEBUG cinder.volume.volume_utils [None req-9c917999-455f-45c8-b691-a7fe5b16f4b0 tempest-TestInstancesWithCinderVolumes-1565760524 None] Downloaded image f4c8c6d9-10ae-4b4f-80d5-d661a3aa58ff ((None, [{'url': 'file:///opt/stack/data/glance/images/f4c8c6d9-10ae-4b4f-80d5-d661a3aa58ff', 'metadata': {}}])) to volume a36b2e78-b3cd-4dd3-81dd-0b0d72f07b15 successfully. {{(pid=88641) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 10 16:01:55 devstack cinder-volume[88641]: DEBUG cinder.image.image_utils [None req-9c917999-455f-45c8-b691-a7fe5b16f4b0 tempest-TestInstancesWithCinderVolumes-1565760524 None] Temporary image f4c8c6d9-10ae-4b4f-80d5-d661a3aa58ff for user 479fef74d7404d0db46406fc88cdfadc is deleted. {{(pid=88641) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 10 16:01:55 devstack cinder-volume[88641]: DEBUG cinder.volume.volume_utils [None req-9c917999-455f-45c8-b691-a7fe5b16f4b0 tempest-TestInstancesWithCinderVolumes-1565760524 None] Marking volume a36b2e78-b3cd-4dd3-81dd-0b0d72f07b15 as bootable. {{(pid=88641) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 10 16:01:55 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c917999-455f-45c8-b691-a7fe5b16f4b0 tempest-TestInstancesWithCinderVolumes-1565760524 None] Copying metadata from image f4c8c6d9-10ae-4b4f-80d5-d661a3aa58ff to a36b2e78-b3cd-4dd3-81dd-0b0d72f07b15. {{(pid=88641) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 10 16:01:55 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c917999-455f-45c8-b691-a7fe5b16f4b0 tempest-TestInstancesWithCinderVolumes-1565760524 None] Creating volume glance metadata for volume a36b2e78-b3cd-4dd3-81dd-0b0d72f07b15 backed by image f4c8c6d9-10ae-4b4f-80d5-d661a3aa58ff with: {'image_id': 'f4c8c6d9-10ae-4b4f-80d5-d661a3aa58ff', 'image_name': 'tempest-scenario-img--1291203185', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88641) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 10 16:01:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-edbca0b8-4a8e-4b35-904f-ec160d880df7 tempest-VolumesSnapshotTestJSON-1988768782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:01:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-edbca0b8-4a8e-4b35-904f-ec160d880df7 tempest-VolumesSnapshotTestJSON-1988768782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:01:55 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-edbca0b8-4a8e-4b35-904f-ec160d880df7 tempest-VolumesSnapshotTestJSON-1988768782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:01:55 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-edbca0b8-4a8e-4b35-904f-ec160d880df7 tempest-VolumesSnapshotTestJSON-1988768782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:01:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-edbca0b8-4a8e-4b35-904f-ec160d880df7 tempest-VolumesSnapshotTestJSON-1988768782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:01:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-edbca0b8-4a8e-4b35-904f-ec160d880df7 tempest-VolumesSnapshotTestJSON-1988768782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:01:55 devstack sudo[98366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:01:55 devstack sudo[98366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:01:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9c917999-455f-45c8-b691-a7fe5b16f4b0 tempest-TestInstancesWithCinderVolumes-1565760524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4c7a36d-d433-4b81-a895-e02d052026ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a36b2e78-b3cd-4dd3-81dd-0b0d72f07b15', 'volume_size': 1, 'image_id': 'f4c8c6d9-10ae-4b4f-80d5-d661a3aa58ff', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f4c8c6d9-10ae-4b4f-80d5-d661a3aa58ff', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1291203185', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cdb3ecc5dba349e78619e7090406c2c2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f4c8c6d9-10ae-4b4f-80d5-d661a3aa58ff', 'created_at': datetime.datetime(2026, 8, 10, 14, 1, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 10, 14, 1, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f4c8c6d9-10ae-4b4f-80d5-d661a3aa58ff/file', 'properties': {}}, 'image_service': }' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:01:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9c917999-455f-45c8-b691-a7fe5b16f4b0 tempest-TestInstancesWithCinderVolumes-1565760524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ded6533e-b712-406f-8876-a7c04469d2d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:01:55 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-9c917999-455f-45c8-b691-a7fe5b16f4b0 tempest-TestInstancesWithCinderVolumes-1565760524 None] Volume volume-a36b2e78-b3cd-4dd3-81dd-0b0d72f07b15 (a36b2e78-b3cd-4dd3-81dd-0b0d72f07b15): created successfully Aug 10 16:01:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9c917999-455f-45c8-b691-a7fe5b16f4b0 tempest-TestInstancesWithCinderVolumes-1565760524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ded6533e-b712-406f-8876-a7c04469d2d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:01:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9c917999-455f-45c8-b691-a7fe5b16f4b0 tempest-TestInstancesWithCinderVolumes-1565760524 None] Flow 'volume_create_manager' (6f064ecf-960a-41a7-a59e-ab3afdd5dc30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:01:55 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-9c917999-455f-45c8-b691-a7fe5b16f4b0 tempest-TestInstancesWithCinderVolumes-1565760524 None] Created volume successfully. Aug 10 16:01:56 devstack sudo[98366]: pam_unix(sudo:session): session closed for user root Aug 10 16:01:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-edbca0b8-4a8e-4b35-904f-ec160d880df7 tempest-VolumesSnapshotTestJSON-1988768782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.284s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:01:56 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-edbca0b8-4a8e-4b35-904f-ec160d880df7 tempest-VolumesSnapshotTestJSON-1988768782 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:01:56 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-edbca0b8-4a8e-4b35-904f-ec160d880df7 tempest-VolumesSnapshotTestJSON-1988768782 None] Deleted volume successfully. Aug 10 16:01:56 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-edbca0b8-4a8e-4b35-904f-ec160d880df7 tempest-VolumesSnapshotTestJSON-1988768782 None] Lock "cinder-3ca5ae16-711a-4870-a8e6-dcde970e4975-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:01:56 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-815f6560-cb52-4a20-946d-02a91c94e31b tempest-GroupsTest-278860274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:01:56 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-815f6560-cb52-4a20-946d-02a91c94e31b tempest-GroupsTest-278860274 None] Flow 'volume_create_manager' (54be05e4-7fd9-4b6d-be63-daec6129782b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:01:56 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-815f6560-cb52-4a20-946d-02a91c94e31b tempest-GroupsTest-278860274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb4d7e56-caae-4dd6-bf64-2078d53d1012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:01:56 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-815f6560-cb52-4a20-946d-02a91c94e31b tempest-GroupsTest-278860274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb4d7e56-caae-4dd6-bf64-2078d53d1012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:01:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1087670499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d1a3329b-34d1-4522-8600-c58f83481f18,host='devstack@QuobyteHD#QuobyteHD',id=1ef466a2-0b16-4663-9281-07756b77bc63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f7ec07e258c44f5bea5c6f27304c6e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:01:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:01:56Z,use_quota=True,user_id='0f355310a6d4414db2b138b1e974ead7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5552df30-83b1-4984-86da-600746ac1532),volume_type_id=5552df30-83b1-4984-86da-600746ac1532)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:01:56 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-815f6560-cb52-4a20-946d-02a91c94e31b tempest-GroupsTest-278860274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83c30b28-ccfe-4bbb-9d62-942adc44a93f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:01:56 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-815f6560-cb52-4a20-946d-02a91c94e31b tempest-GroupsTest-278860274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83c30b28-ccfe-4bbb-9d62-942adc44a93f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:01:56 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-815f6560-cb52-4a20-946d-02a91c94e31b tempest-GroupsTest-278860274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c5345af-9230-44a3-935d-d96f8362d650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:01:56 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-815f6560-cb52-4a20-946d-02a91c94e31b tempest-GroupsTest-278860274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c5345af-9230-44a3-935d-d96f8362d650) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ef466a2-0b16-4663-9281-07756b77bc63', 'volume_name': 'volume-1ef466a2-0b16-4663-9281-07756b77bc63', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:01:56 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-815f6560-cb52-4a20-946d-02a91c94e31b tempest-GroupsTest-278860274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcb2705a-5ad6-4f31-bcb4-5cfd87377f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:01:56 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-815f6560-cb52-4a20-946d-02a91c94e31b tempest-GroupsTest-278860274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcb2705a-5ad6-4f31-bcb4-5cfd87377f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:01:56 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-815f6560-cb52-4a20-946d-02a91c94e31b tempest-GroupsTest-278860274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee8ad652-087b-4586-9db3-3f11b946077f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:01:56 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-815f6560-cb52-4a20-946d-02a91c94e31b tempest-GroupsTest-278860274 None] Volume 1ef466a2-0b16-4663-9281-07756b77bc63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ef466a2-0b16-4663-9281-07756b77bc63', 'volume_size': 1} Aug 10 16:01:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-815f6560-cb52-4a20-946d-02a91c94e31b tempest-GroupsTest-278860274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:01:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-815f6560-cb52-4a20-946d-02a91c94e31b tempest-GroupsTest-278860274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:01:56 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-815f6560-cb52-4a20-946d-02a91c94e31b tempest-GroupsTest-278860274 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d1a3329b-34d1-4522-8600-c58f83481f18,created_at=2026-08-10T14:01:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1087670499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d1a3329b-34d1-4522-8600-c58f83481f18,host='devstack@QuobyteHD#QuobyteHD',id=1ef466a2-0b16-4663-9281-07756b77bc63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f7ec07e258c44f5bea5c6f27304c6e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:01:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:01:56Z,use_quota=True,user_id='0f355310a6d4414db2b138b1e974ead7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5552df30-83b1-4984-86da-600746ac1532),volume_type_id=5552df30-83b1-4984-86da-600746ac1532)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:01:56 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-815f6560-cb52-4a20-946d-02a91c94e31b tempest-GroupsTest-278860274 None] Creating volume 1ef466a2-0b16-4663-9281-07756b77bc63 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:01:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-815f6560-cb52-4a20-946d-02a91c94e31b tempest-GroupsTest-278860274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:01:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-815f6560-cb52-4a20-946d-02a91c94e31b tempest-GroupsTest-278860274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:01:56 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-815f6560-cb52-4a20-946d-02a91c94e31b tempest-GroupsTest-278860274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:01:56 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-815f6560-cb52-4a20-946d-02a91c94e31b tempest-GroupsTest-278860274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:01:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-815f6560-cb52-4a20-946d-02a91c94e31b tempest-GroupsTest-278860274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:01:56 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-815f6560-cb52-4a20-946d-02a91c94e31b tempest-GroupsTest-278860274 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:01:56 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-815f6560-cb52-4a20-946d-02a91c94e31b tempest-GroupsTest-278860274 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:01:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-815f6560-cb52-4a20-946d-02a91c94e31b tempest-GroupsTest-278860274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-1ef466a2-0b16-4663-9281-07756b77bc63 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:01:56 devstack sudo[98369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-1ef466a2-0b16-4663-9281-07756b77bc63 1073741824 Aug 10 16:01:56 devstack sudo[98369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:01:57 devstack sudo[98369]: pam_unix(sudo:session): session closed for user root Aug 10 16:01:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-815f6560-cb52-4a20-946d-02a91c94e31b tempest-GroupsTest-278860274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-1ef466a2-0b16-4663-9281-07756b77bc63 1073741824" returned: 0 in 0.591s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:01:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-815f6560-cb52-4a20-946d-02a91c94e31b tempest-GroupsTest-278860274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-1ef466a2-0b16-4663-9281-07756b77bc63 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:01:57 devstack sudo[98375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-1ef466a2-0b16-4663-9281-07756b77bc63 Aug 10 16:01:57 devstack sudo[98375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:01:57 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-90bcc4f9-5ec2-4c82-bd57-d833a95cbf72 tempest-VolumesSnapshotTestJSON-1988768782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:01:57 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-90bcc4f9-5ec2-4c82-bd57-d833a95cbf72 tempest-VolumesSnapshotTestJSON-1988768782 None] Flow 'volume_create_manager' (6ada9cc7-3da9-496e-a565-0a56c8b34935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:01:57 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-90bcc4f9-5ec2-4c82-bd57-d833a95cbf72 tempest-VolumesSnapshotTestJSON-1988768782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de81f274-32fa-4ed3-b258-a2754ac1c6e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:01:57 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-90bcc4f9-5ec2-4c82-bd57-d833a95cbf72 tempest-VolumesSnapshotTestJSON-1988768782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de81f274-32fa-4ed3-b258-a2754ac1c6e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:01:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-301444211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3a99dac-fbd6-4bdb-b2aa-9b94c94b87bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e124169510854def88c000087030eef2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:01:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:01:57Z,use_quota=True,user_id='e195aeff14b5481ab42226aff1e44cd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:01:57 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-90bcc4f9-5ec2-4c82-bd57-d833a95cbf72 tempest-VolumesSnapshotTestJSON-1988768782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97793e9a-329f-440f-a0bf-25f49249c76e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:01:57 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-90bcc4f9-5ec2-4c82-bd57-d833a95cbf72 tempest-VolumesSnapshotTestJSON-1988768782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97793e9a-329f-440f-a0bf-25f49249c76e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:01:57 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-90bcc4f9-5ec2-4c82-bd57-d833a95cbf72 tempest-VolumesSnapshotTestJSON-1988768782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b671c8f-6be5-4653-a9f6-a3f713e8dea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:01:57 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-90bcc4f9-5ec2-4c82-bd57-d833a95cbf72 tempest-VolumesSnapshotTestJSON-1988768782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b671c8f-6be5-4653-a9f6-a3f713e8dea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3a99dac-fbd6-4bdb-b2aa-9b94c94b87bc', 'volume_name': 'volume-d3a99dac-fbd6-4bdb-b2aa-9b94c94b87bc', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:01:57 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-90bcc4f9-5ec2-4c82-bd57-d833a95cbf72 tempest-VolumesSnapshotTestJSON-1988768782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5d5eab1-2297-424a-85d8-73793298839c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:01:57 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-90bcc4f9-5ec2-4c82-bd57-d833a95cbf72 tempest-VolumesSnapshotTestJSON-1988768782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5d5eab1-2297-424a-85d8-73793298839c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:01:57 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-90bcc4f9-5ec2-4c82-bd57-d833a95cbf72 tempest-VolumesSnapshotTestJSON-1988768782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62f9c024-c169-402b-a927-cf334cc4bf44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:01:57 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-90bcc4f9-5ec2-4c82-bd57-d833a95cbf72 tempest-VolumesSnapshotTestJSON-1988768782 None] Volume d3a99dac-fbd6-4bdb-b2aa-9b94c94b87bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3a99dac-fbd6-4bdb-b2aa-9b94c94b87bc', 'volume_size': 1} Aug 10 16:01:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-90bcc4f9-5ec2-4c82-bd57-d833a95cbf72 tempest-VolumesSnapshotTestJSON-1988768782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:01:57 devstack sudo[98375]: pam_unix(sudo:session): session closed for user root Aug 10 16:01:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-815f6560-cb52-4a20-946d-02a91c94e31b tempest-GroupsTest-278860274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-1ef466a2-0b16-4663-9281-07756b77bc63" returned: 0 in 0.350s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:01:57 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-815f6560-cb52-4a20-946d-02a91c94e31b tempest-GroupsTest-278860274 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:01:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-815f6560-cb52-4a20-946d-02a91c94e31b tempest-GroupsTest-278860274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:01:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-90bcc4f9-5ec2-4c82-bd57-d833a95cbf72 tempest-VolumesSnapshotTestJSON-1988768782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.177s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:01:57 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-90bcc4f9-5ec2-4c82-bd57-d833a95cbf72 tempest-VolumesSnapshotTestJSON-1988768782 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:01:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-301444211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3a99dac-fbd6-4bdb-b2aa-9b94c94b87bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e124169510854def88c000087030eef2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:01:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:01:57Z,use_quota=True,user_id='e195aeff14b5481ab42226aff1e44cd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:01:57 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-90bcc4f9-5ec2-4c82-bd57-d833a95cbf72 tempest-VolumesSnapshotTestJSON-1988768782 None] Creating volume d3a99dac-fbd6-4bdb-b2aa-9b94c94b87bc {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:01:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-90bcc4f9-5ec2-4c82-bd57-d833a95cbf72 tempest-VolumesSnapshotTestJSON-1988768782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:01:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-90bcc4f9-5ec2-4c82-bd57-d833a95cbf72 tempest-VolumesSnapshotTestJSON-1988768782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:01:57 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-90bcc4f9-5ec2-4c82-bd57-d833a95cbf72 tempest-VolumesSnapshotTestJSON-1988768782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:01:57 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-90bcc4f9-5ec2-4c82-bd57-d833a95cbf72 tempest-VolumesSnapshotTestJSON-1988768782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:01:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-90bcc4f9-5ec2-4c82-bd57-d833a95cbf72 tempest-VolumesSnapshotTestJSON-1988768782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:01:57 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-90bcc4f9-5ec2-4c82-bd57-d833a95cbf72 tempest-VolumesSnapshotTestJSON-1988768782 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:01:57 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-90bcc4f9-5ec2-4c82-bd57-d833a95cbf72 tempest-VolumesSnapshotTestJSON-1988768782 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:01:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-90bcc4f9-5ec2-4c82-bd57-d833a95cbf72 tempest-VolumesSnapshotTestJSON-1988768782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d3a99dac-fbd6-4bdb-b2aa-9b94c94b87bc 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:01:57 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-815f6560-cb52-4a20-946d-02a91c94e31b tempest-GroupsTest-278860274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee8ad652-087b-4586-9db3-3f11b946077f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ef466a2-0b16-4663-9281-07756b77bc63', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:01:57 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-815f6560-cb52-4a20-946d-02a91c94e31b tempest-GroupsTest-278860274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (079825de-79e4-473b-997a-76b5e4567e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:01:57 devstack sudo[98381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d3a99dac-fbd6-4bdb-b2aa-9b94c94b87bc 1073741824 Aug 10 16:01:57 devstack sudo[98381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:01:57 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-815f6560-cb52-4a20-946d-02a91c94e31b tempest-GroupsTest-278860274 None] Volume volume-1ef466a2-0b16-4663-9281-07756b77bc63 (1ef466a2-0b16-4663-9281-07756b77bc63): created successfully Aug 10 16:01:57 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-815f6560-cb52-4a20-946d-02a91c94e31b tempest-GroupsTest-278860274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (079825de-79e4-473b-997a-76b5e4567e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:01:57 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-815f6560-cb52-4a20-946d-02a91c94e31b tempest-GroupsTest-278860274 None] Flow 'volume_create_manager' (54be05e4-7fd9-4b6d-be63-daec6129782b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:01:57 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-815f6560-cb52-4a20-946d-02a91c94e31b tempest-GroupsTest-278860274 None] Created volume successfully. Aug 10 16:01:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-90bcc4f9-5ec2-4c82-bd57-d833a95cbf72 tempest-VolumesSnapshotTestJSON-1988768782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d3a99dac-fbd6-4bdb-b2aa-9b94c94b87bc 1073741824" returned: 0 in 0.599s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:01:58 devstack sudo[98381]: pam_unix(sudo:session): session closed for user root Aug 10 16:01:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-90bcc4f9-5ec2-4c82-bd57-d833a95cbf72 tempest-VolumesSnapshotTestJSON-1988768782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d3a99dac-fbd6-4bdb-b2aa-9b94c94b87bc {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:01:58 devstack sudo[98387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d3a99dac-fbd6-4bdb-b2aa-9b94c94b87bc Aug 10 16:01:58 devstack sudo[98387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:01:58 devstack sudo[98387]: pam_unix(sudo:session): session closed for user root Aug 10 16:01:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-90bcc4f9-5ec2-4c82-bd57-d833a95cbf72 tempest-VolumesSnapshotTestJSON-1988768782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d3a99dac-fbd6-4bdb-b2aa-9b94c94b87bc" returned: 0 in 0.294s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:01:58 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-90bcc4f9-5ec2-4c82-bd57-d833a95cbf72 tempest-VolumesSnapshotTestJSON-1988768782 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:01:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-90bcc4f9-5ec2-4c82-bd57-d833a95cbf72 tempest-VolumesSnapshotTestJSON-1988768782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:01:58 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-90bcc4f9-5ec2-4c82-bd57-d833a95cbf72 tempest-VolumesSnapshotTestJSON-1988768782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62f9c024-c169-402b-a927-cf334cc4bf44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3a99dac-fbd6-4bdb-b2aa-9b94c94b87bc', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:01:58 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-90bcc4f9-5ec2-4c82-bd57-d833a95cbf72 tempest-VolumesSnapshotTestJSON-1988768782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b82eaa8-f769-4f17-82be-1fdb2c3f2cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:01:58 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-90bcc4f9-5ec2-4c82-bd57-d833a95cbf72 tempest-VolumesSnapshotTestJSON-1988768782 None] Volume volume-d3a99dac-fbd6-4bdb-b2aa-9b94c94b87bc (d3a99dac-fbd6-4bdb-b2aa-9b94c94b87bc): created successfully Aug 10 16:01:58 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-90bcc4f9-5ec2-4c82-bd57-d833a95cbf72 tempest-VolumesSnapshotTestJSON-1988768782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b82eaa8-f769-4f17-82be-1fdb2c3f2cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:01:58 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-90bcc4f9-5ec2-4c82-bd57-d833a95cbf72 tempest-VolumesSnapshotTestJSON-1988768782 None] Flow 'volume_create_manager' (6ada9cc7-3da9-496e-a565-0a56c8b34935) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:01:58 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-90bcc4f9-5ec2-4c82-bd57-d833a95cbf72 tempest-VolumesSnapshotTestJSON-1988768782 None] Created volume successfully. Aug 10 16:01:59 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-e61fa4ad-f263-4a9d-8212-759e908dfe57 req-cdf38795-f85a-4c1e-9f97-29b89f54e7e8 tempest-TestInstancesWithCinderVolumes-1565760524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:01:59 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-e61fa4ad-f263-4a9d-8212-759e908dfe57 req-cdf38795-f85a-4c1e-9f97-29b89f54e7e8 tempest-TestInstancesWithCinderVolumes-1565760524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:01:59 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-e61fa4ad-f263-4a9d-8212-759e908dfe57 req-cdf38795-f85a-4c1e-9f97-29b89f54e7e8 tempest-TestInstancesWithCinderVolumes-1565760524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:01:59 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [req-e61fa4ad-f263-4a9d-8212-759e908dfe57 req-cdf38795-f85a-4c1e-9f97-29b89f54e7e8 tempest-TestInstancesWithCinderVolumes-1565760524 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc', 'name': 'volume-a36b2e78-b3cd-4dd3-81dd-0b0d72f07b15', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1bf4c195-a554-4bc1-9171-c56ef5fbd62a', 'enforce_multipath': True} {{(pid=88641) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 10 16:02:00 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-aeb96fa3-cfb3-467f-970c-388b1eb55fa4 tempest-GroupsTest-278860274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:02:00 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-aeb96fa3-cfb3-467f-970c-388b1eb55fa4 tempest-GroupsTest-278860274 None] Flow 'volume_create_manager' (25a292ea-51a2-4b4a-a500-e3b437569efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:02:00 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-aeb96fa3-cfb3-467f-970c-388b1eb55fa4 tempest-GroupsTest-278860274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffd48f57-6b16-47f8-b122-5b3905a52d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:02:00 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-aeb96fa3-cfb3-467f-970c-388b1eb55fa4 tempest-GroupsTest-278860274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffd48f57-6b16-47f8-b122-5b3905a52d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:01:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-813163736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d1a3329b-34d1-4522-8600-c58f83481f18,host='devstack@QuobyteHD#QuobyteHD',id=225f5a78-7bfa-4d90-b131-185ad4862c8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f7ec07e258c44f5bea5c6f27304c6e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:02:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:02:00Z,use_quota=True,user_id='0f355310a6d4414db2b138b1e974ead7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5552df30-83b1-4984-86da-600746ac1532),volume_type_id=5552df30-83b1-4984-86da-600746ac1532)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:02:00 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-aeb96fa3-cfb3-467f-970c-388b1eb55fa4 tempest-GroupsTest-278860274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6a4666e-354b-4566-8276-189762a4ce39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:02:00 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-aeb96fa3-cfb3-467f-970c-388b1eb55fa4 tempest-GroupsTest-278860274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6a4666e-354b-4566-8276-189762a4ce39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:02:00 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-aeb96fa3-cfb3-467f-970c-388b1eb55fa4 tempest-GroupsTest-278860274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb046118-7fa2-4f11-9e27-29e38221059f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:02:00 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-aeb96fa3-cfb3-467f-970c-388b1eb55fa4 tempest-GroupsTest-278860274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb046118-7fa2-4f11-9e27-29e38221059f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '225f5a78-7bfa-4d90-b131-185ad4862c8d', 'volume_name': 'volume-225f5a78-7bfa-4d90-b131-185ad4862c8d', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:02:00 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-aeb96fa3-cfb3-467f-970c-388b1eb55fa4 tempest-GroupsTest-278860274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6daeaaa5-1bda-4d8a-9771-dc7d289b5fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:02:00 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-aeb96fa3-cfb3-467f-970c-388b1eb55fa4 tempest-GroupsTest-278860274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6daeaaa5-1bda-4d8a-9771-dc7d289b5fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:02:00 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-aeb96fa3-cfb3-467f-970c-388b1eb55fa4 tempest-GroupsTest-278860274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2eec5986-234b-47c8-bd57-0cf7636c4ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:02:00 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-aeb96fa3-cfb3-467f-970c-388b1eb55fa4 tempest-GroupsTest-278860274 None] Volume 225f5a78-7bfa-4d90-b131-185ad4862c8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-225f5a78-7bfa-4d90-b131-185ad4862c8d', 'volume_size': 1} Aug 10 16:02:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-aeb96fa3-cfb3-467f-970c-388b1eb55fa4 tempest-GroupsTest-278860274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:02:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-aeb96fa3-cfb3-467f-970c-388b1eb55fa4 tempest-GroupsTest-278860274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:02:00 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-aeb96fa3-cfb3-467f-970c-388b1eb55fa4 tempest-GroupsTest-278860274 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d1a3329b-34d1-4522-8600-c58f83481f18,created_at=2026-08-10T14:01:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-813163736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d1a3329b-34d1-4522-8600-c58f83481f18,host='devstack@QuobyteHD#QuobyteHD',id=225f5a78-7bfa-4d90-b131-185ad4862c8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f7ec07e258c44f5bea5c6f27304c6e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:02:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:02:00Z,use_quota=True,user_id='0f355310a6d4414db2b138b1e974ead7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5552df30-83b1-4984-86da-600746ac1532),volume_type_id=5552df30-83b1-4984-86da-600746ac1532)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:02:00 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-aeb96fa3-cfb3-467f-970c-388b1eb55fa4 tempest-GroupsTest-278860274 None] Creating volume 225f5a78-7bfa-4d90-b131-185ad4862c8d {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:02:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-aeb96fa3-cfb3-467f-970c-388b1eb55fa4 tempest-GroupsTest-278860274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:02:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-aeb96fa3-cfb3-467f-970c-388b1eb55fa4 tempest-GroupsTest-278860274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:02:00 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-aeb96fa3-cfb3-467f-970c-388b1eb55fa4 tempest-GroupsTest-278860274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:02:00 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-aeb96fa3-cfb3-467f-970c-388b1eb55fa4 tempest-GroupsTest-278860274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:02:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-aeb96fa3-cfb3-467f-970c-388b1eb55fa4 tempest-GroupsTest-278860274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:02:00 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-aeb96fa3-cfb3-467f-970c-388b1eb55fa4 tempest-GroupsTest-278860274 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:02:00 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-aeb96fa3-cfb3-467f-970c-388b1eb55fa4 tempest-GroupsTest-278860274 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:02:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-aeb96fa3-cfb3-467f-970c-388b1eb55fa4 tempest-GroupsTest-278860274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-225f5a78-7bfa-4d90-b131-185ad4862c8d 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:02:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-8114ffff-58ff-41c6-a2e6-972fb109f17f tempest-VolumesSnapshotTestJSON-1988768782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:02:00 devstack cinder-volume[88641]: INFO cinder.volume.manager [req-e61fa4ad-f263-4a9d-8212-759e908dfe57 req-cdf38795-f85a-4c1e-9f97-29b89f54e7e8 tempest-TestInstancesWithCinderVolumes-1565760524 None] attachment_update completed successfully. Aug 10 16:02:00 devstack sudo[98404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-225f5a78-7bfa-4d90-b131-185ad4862c8d 1073741824 Aug 10 16:02:00 devstack sudo[98404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:02:01 devstack sudo[98404]: pam_unix(sudo:session): session closed for user root Aug 10 16:02:01 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-aeb96fa3-cfb3-467f-970c-388b1eb55fa4 tempest-GroupsTest-278860274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-225f5a78-7bfa-4d90-b131-185ad4862c8d 1073741824" returned: 0 in 0.774s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:02:01 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-aeb96fa3-cfb3-467f-970c-388b1eb55fa4 tempest-GroupsTest-278860274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-225f5a78-7bfa-4d90-b131-185ad4862c8d {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:02:01 devstack sudo[98411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-225f5a78-7bfa-4d90-b131-185ad4862c8d Aug 10 16:02:01 devstack sudo[98411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:02:01 devstack sudo[98411]: pam_unix(sudo:session): session closed for user root Aug 10 16:02:01 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-aeb96fa3-cfb3-467f-970c-388b1eb55fa4 tempest-GroupsTest-278860274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-225f5a78-7bfa-4d90-b131-185ad4862c8d" returned: 0 in 0.324s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:02:01 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-aeb96fa3-cfb3-467f-970c-388b1eb55fa4 tempest-GroupsTest-278860274 None] <== create_volume: return (1163ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:02:01 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-aeb96fa3-cfb3-467f-970c-388b1eb55fa4 tempest-GroupsTest-278860274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.166s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:02:01 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-8114ffff-58ff-41c6-a2e6-972fb109f17f tempest-VolumesSnapshotTestJSON-1988768782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.122s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:02:01 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-aeb96fa3-cfb3-467f-970c-388b1eb55fa4 tempest-GroupsTest-278860274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2eec5986-234b-47c8-bd57-0cf7636c4ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-225f5a78-7bfa-4d90-b131-185ad4862c8d', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:02:01 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-aeb96fa3-cfb3-467f-970c-388b1eb55fa4 tempest-GroupsTest-278860274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa3931e3-7693-4bff-bc40-23a301645cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:02:01 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-8114ffff-58ff-41c6-a2e6-972fb109f17f tempest-VolumesSnapshotTestJSON-1988768782 None] Creating offline snapshot 03a75ca9-e2f1-42cd-9d2d-f8c296b88c57 of volume d3a99dac-fbd6-4bdb-b2aa-9b94c94b87bc {{(pid=88641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 16:02:01 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-aeb96fa3-cfb3-467f-970c-388b1eb55fa4 tempest-GroupsTest-278860274 None] Volume volume-225f5a78-7bfa-4d90-b131-185ad4862c8d (225f5a78-7bfa-4d90-b131-185ad4862c8d): created successfully Aug 10 16:02:01 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-aeb96fa3-cfb3-467f-970c-388b1eb55fa4 tempest-GroupsTest-278860274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa3931e3-7693-4bff-bc40-23a301645cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:02:01 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-aeb96fa3-cfb3-467f-970c-388b1eb55fa4 tempest-GroupsTest-278860274 None] Flow 'volume_create_manager' (25a292ea-51a2-4b4a-a500-e3b437569efb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:02:01 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[1704c7aa-3a7f-4972-8555-4b9815a9a2ad]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:02:01 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-8114ffff-58ff-41c6-a2e6-972fb109f17f tempest-VolumesSnapshotTestJSON-1988768782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d3a99dac-fbd6-4bdb-b2aa-9b94c94b87bc {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:02:01 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-aeb96fa3-cfb3-467f-970c-388b1eb55fa4 tempest-GroupsTest-278860274 None] Created volume successfully. Aug 10 16:02:01 devstack sudo[98414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d3a99dac-fbd6-4bdb-b2aa-9b94c94b87bc Aug 10 16:02:01 devstack sudo[98414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:02:02 devstack sudo[98414]: pam_unix(sudo:session): session closed for user root Aug 10 16:02:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-8114ffff-58ff-41c6-a2e6-972fb109f17f tempest-VolumesSnapshotTestJSON-1988768782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d3a99dac-fbd6-4bdb-b2aa-9b94c94b87bc" returned: 0 in 0.559s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:02:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-8114ffff-58ff-41c6-a2e6-972fb109f17f tempest-VolumesSnapshotTestJSON-1988768782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d3a99dac-fbd6-4bdb-b2aa-9b94c94b87bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d3a99dac-fbd6-4bdb-b2aa-9b94c94b87bc.03a75ca9-e2f1-42cd-9d2d-f8c296b88c57 1G {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:02:02 devstack sudo[98428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d3a99dac-fbd6-4bdb-b2aa-9b94c94b87bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d3a99dac-fbd6-4bdb-b2aa-9b94c94b87bc.03a75ca9-e2f1-42cd-9d2d-f8c296b88c57 1G Aug 10 16:02:02 devstack sudo[98428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:02:02 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-99e1b7d5-0d28-4ddf-8a6e-7c60fe5e4fdd tempest-GroupsTest-278860274 None] Update group completed successfully. Aug 10 16:02:02 devstack sudo[98428]: pam_unix(sudo:session): session closed for user root Aug 10 16:02:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-8114ffff-58ff-41c6-a2e6-972fb109f17f tempest-VolumesSnapshotTestJSON-1988768782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d3a99dac-fbd6-4bdb-b2aa-9b94c94b87bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d3a99dac-fbd6-4bdb-b2aa-9b94c94b87bc.03a75ca9-e2f1-42cd-9d2d-f8c296b88c57 1G" returned: 0 in 0.701s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:02:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-8114ffff-58ff-41c6-a2e6-972fb109f17f tempest-VolumesSnapshotTestJSON-1988768782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3a99dac-fbd6-4bdb-b2aa-9b94c94b87bc -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d3a99dac-fbd6-4bdb-b2aa-9b94c94b87bc.03a75ca9-e2f1-42cd-9d2d-f8c296b88c57 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:02:02 devstack sudo[98442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3a99dac-fbd6-4bdb-b2aa-9b94c94b87bc -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d3a99dac-fbd6-4bdb-b2aa-9b94c94b87bc.03a75ca9-e2f1-42cd-9d2d-f8c296b88c57 Aug 10 16:02:02 devstack sudo[98442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:02:03 devstack sudo[98442]: pam_unix(sudo:session): session closed for user root Aug 10 16:02:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-8114ffff-58ff-41c6-a2e6-972fb109f17f tempest-VolumesSnapshotTestJSON-1988768782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3a99dac-fbd6-4bdb-b2aa-9b94c94b87bc -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d3a99dac-fbd6-4bdb-b2aa-9b94c94b87bc.03a75ca9-e2f1-42cd-9d2d-f8c296b88c57" returned: 0 in 0.359s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:02:03 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-8114ffff-58ff-41c6-a2e6-972fb109f17f tempest-VolumesSnapshotTestJSON-1988768782 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d3a99dac-fbd6-4bdb-b2aa-9b94c94b87bc.03a75ca9-e2f1-42cd-9d2d-f8c296b88c57 is being set with open permissions: ugo+rw Aug 10 16:02:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-8114ffff-58ff-41c6-a2e6-972fb109f17f tempest-VolumesSnapshotTestJSON-1988768782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d3a99dac-fbd6-4bdb-b2aa-9b94c94b87bc.03a75ca9-e2f1-42cd-9d2d-f8c296b88c57 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:02:03 devstack sudo[98475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d3a99dac-fbd6-4bdb-b2aa-9b94c94b87bc.03a75ca9-e2f1-42cd-9d2d-f8c296b88c57 Aug 10 16:02:03 devstack sudo[98475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:02:03 devstack sudo[98475]: pam_unix(sudo:session): session closed for user root Aug 10 16:02:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-8114ffff-58ff-41c6-a2e6-972fb109f17f tempest-VolumesSnapshotTestJSON-1988768782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d3a99dac-fbd6-4bdb-b2aa-9b94c94b87bc.03a75ca9-e2f1-42cd-9d2d-f8c296b88c57" returned: 0 in 0.407s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:02:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-8114ffff-58ff-41c6-a2e6-972fb109f17f tempest-VolumesSnapshotTestJSON-1988768782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d3a99dac-fbd6-4bdb-b2aa-9b94c94b87bc.info {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:02:03 devstack sudo[98528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d3a99dac-fbd6-4bdb-b2aa-9b94c94b87bc.info Aug 10 16:02:03 devstack sudo[98528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:02:03 devstack sudo[98528]: pam_unix(sudo:session): session closed for user root Aug 10 16:02:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-8114ffff-58ff-41c6-a2e6-972fb109f17f tempest-VolumesSnapshotTestJSON-1988768782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d3a99dac-fbd6-4bdb-b2aa-9b94c94b87bc.info" returned: 0 in 0.342s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:02:03 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-8114ffff-58ff-41c6-a2e6-972fb109f17f tempest-VolumesSnapshotTestJSON-1988768782 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d3a99dac-fbd6-4bdb-b2aa-9b94c94b87bc.info is being set with open permissions: ugo+rw Aug 10 16:02:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-8114ffff-58ff-41c6-a2e6-972fb109f17f tempest-VolumesSnapshotTestJSON-1988768782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d3a99dac-fbd6-4bdb-b2aa-9b94c94b87bc.info {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:02:03 devstack sudo[98862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d3a99dac-fbd6-4bdb-b2aa-9b94c94b87bc.info Aug 10 16:02:03 devstack sudo[98862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:02:04 devstack sudo[98862]: pam_unix(sudo:session): session closed for user root Aug 10 16:02:04 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-153111a5-7215-4c13-ae31-0cc7fae3a428 tempest-GroupsTest-278860274 None] Update group completed successfully. Aug 10 16:02:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-8114ffff-58ff-41c6-a2e6-972fb109f17f tempest-VolumesSnapshotTestJSON-1988768782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d3a99dac-fbd6-4bdb-b2aa-9b94c94b87bc.info" returned: 0 in 0.532s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:02:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-8114ffff-58ff-41c6-a2e6-972fb109f17f tempest-VolumesSnapshotTestJSON-1988768782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.093s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:02:04 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-8114ffff-58ff-41c6-a2e6-972fb109f17f tempest-VolumesSnapshotTestJSON-1988768782 None] Create snapshot completed successfully Aug 10 16:02:06 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-917bcf4e-8dc9-4c6c-a9d1-8540ec668d38 tempest-VolumesSnapshotTestJSON-1988768782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:02:06 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-917bcf4e-8dc9-4c6c-a9d1-8540ec668d38 tempest-VolumesSnapshotTestJSON-1988768782 None] Flow 'volume_create_manager' (405a9e69-0a36-44f0-b227-edb7bf9b0c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:02:06 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-917bcf4e-8dc9-4c6c-a9d1-8540ec668d38 tempest-VolumesSnapshotTestJSON-1988768782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e2902e3-793c-4741-bac7-701908f79489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:02:06 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-917bcf4e-8dc9-4c6c-a9d1-8540ec668d38 tempest-VolumesSnapshotTestJSON-1988768782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e2902e3-793c-4741-bac7-701908f79489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:02:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2045927368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89937369-638a-4f45-9a00-3b6284553a6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e124169510854def88c000087030eef2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:02:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=03a75ca9-e2f1-42cd-9d2d-f8c296b88c57,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:02:06Z,use_quota=True,user_id='e195aeff14b5481ab42226aff1e44cd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:02:06 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-917bcf4e-8dc9-4c6c-a9d1-8540ec668d38 tempest-VolumesSnapshotTestJSON-1988768782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb770952-10d3-4232-b407-4e1261b30418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:02:06 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-917bcf4e-8dc9-4c6c-a9d1-8540ec668d38 tempest-VolumesSnapshotTestJSON-1988768782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb770952-10d3-4232-b407-4e1261b30418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:02:06 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-917bcf4e-8dc9-4c6c-a9d1-8540ec668d38 tempest-VolumesSnapshotTestJSON-1988768782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22b677f1-77fb-4b7a-a44d-f37af381dc35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:02:06 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-917bcf4e-8dc9-4c6c-a9d1-8540ec668d38 tempest-VolumesSnapshotTestJSON-1988768782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22b677f1-77fb-4b7a-a44d-f37af381dc35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '89937369-638a-4f45-9a00-3b6284553a6b', 'volume_name': 'volume-89937369-638a-4f45-9a00-3b6284553a6b', 'volume_size': 1, 'snapshot_id': '03a75ca9-e2f1-42cd-9d2d-f8c296b88c57'}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:02:06 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-917bcf4e-8dc9-4c6c-a9d1-8540ec668d38 tempest-VolumesSnapshotTestJSON-1988768782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21750aa6-6386-42cc-9311-bec6ddd9c905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:02:06 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-917bcf4e-8dc9-4c6c-a9d1-8540ec668d38 tempest-VolumesSnapshotTestJSON-1988768782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21750aa6-6386-42cc-9311-bec6ddd9c905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:02:06 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-917bcf4e-8dc9-4c6c-a9d1-8540ec668d38 tempest-VolumesSnapshotTestJSON-1988768782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c703394a-117c-4466-bfff-42a13031d238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:02:06 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-917bcf4e-8dc9-4c6c-a9d1-8540ec668d38 tempest-VolumesSnapshotTestJSON-1988768782 None] Volume 89937369-638a-4f45-9a00-3b6284553a6b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-89937369-638a-4f45-9a00-3b6284553a6b', 'volume_size': 1, 'snapshot_id': '03a75ca9-e2f1-42cd-9d2d-f8c296b88c57'} Aug 10 16:02:06 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-917bcf4e-8dc9-4c6c-a9d1-8540ec668d38 tempest-VolumesSnapshotTestJSON-1988768782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:02:06 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-917bcf4e-8dc9-4c6c-a9d1-8540ec668d38 tempest-VolumesSnapshotTestJSON-1988768782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:02:06 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-917bcf4e-8dc9-4c6c-a9d1-8540ec668d38 tempest-VolumesSnapshotTestJSON-1988768782 None] Acquiring lock "cinder-quobyte-03a75ca9-e2f1-42cd-9d2d-f8c296b88c57-89937369-638a-4f45-9a00-3b6284553a6b" by "_create_volume_from_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:02:06 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-917bcf4e-8dc9-4c6c-a9d1-8540ec668d38 tempest-VolumesSnapshotTestJSON-1988768782 None] Lock "cinder-quobyte-03a75ca9-e2f1-42cd-9d2d-f8c296b88c57-89937369-638a-4f45-9a00-3b6284553a6b" acquired by "_create_volume_from_snapshot" :: waited 0.187s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:02:06 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-917bcf4e-8dc9-4c6c-a9d1-8540ec668d38 tempest-VolumesSnapshotTestJSON-1988768782 None] Creating volume 89937369-638a-4f45-9a00-3b6284553a6b from snapshot 03a75ca9-e2f1-42cd-9d2d-f8c296b88c57 {{(pid=88641) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 10 16:02:06 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-917bcf4e-8dc9-4c6c-a9d1-8540ec668d38 tempest-VolumesSnapshotTestJSON-1988768782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:02:06 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-917bcf4e-8dc9-4c6c-a9d1-8540ec668d38 tempest-VolumesSnapshotTestJSON-1988768782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:02:06 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-917bcf4e-8dc9-4c6c-a9d1-8540ec668d38 tempest-VolumesSnapshotTestJSON-1988768782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:02:06 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-917bcf4e-8dc9-4c6c-a9d1-8540ec668d38 tempest-VolumesSnapshotTestJSON-1988768782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:02:06 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-917bcf4e-8dc9-4c6c-a9d1-8540ec668d38 tempest-VolumesSnapshotTestJSON-1988768782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:02:06 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-917bcf4e-8dc9-4c6c-a9d1-8540ec668d38 tempest-VolumesSnapshotTestJSON-1988768782 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:02:06 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-917bcf4e-8dc9-4c6c-a9d1-8540ec668d38 tempest-VolumesSnapshotTestJSON-1988768782 None] Acquiring lock "cinder-quobyte-89937369-638a-4f45-9a00-3b6284553a6b" by "_copy_volume_from_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:02:06 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-4b3b3a59-0a2e-4ddc-91c9-b214922cacd8 tempest-GroupsTest-278860274 None] Acquiring lock "cinder-quobyte-1ef466a2-0b16-4663-9281-07756b77bc63" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:02:07 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-917bcf4e-8dc9-4c6c-a9d1-8540ec668d38 tempest-VolumesSnapshotTestJSON-1988768782 None] Lock "cinder-quobyte-89937369-638a-4f45-9a00-3b6284553a6b" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:02:07 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-917bcf4e-8dc9-4c6c-a9d1-8540ec668d38 tempest-VolumesSnapshotTestJSON-1988768782 None] snapshot: 03a75ca9-e2f1-42cd-9d2d-f8c296b88c57, volume: 89937369-638a-4f45-9a00-3b6284553a6b, {{(pid=88641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 10 16:02:07 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-4b3b3a59-0a2e-4ddc-91c9-b214922cacd8 tempest-GroupsTest-278860274 None] Lock "cinder-quobyte-1ef466a2-0b16-4663-9281-07756b77bc63" acquired by "delete_volume" :: waited 0.047s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:02:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-917bcf4e-8dc9-4c6c-a9d1-8540ec668d38 tempest-VolumesSnapshotTestJSON-1988768782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:02:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-917bcf4e-8dc9-4c6c-a9d1-8540ec668d38 tempest-VolumesSnapshotTestJSON-1988768782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:02:07 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-917bcf4e-8dc9-4c6c-a9d1-8540ec668d38 tempest-VolumesSnapshotTestJSON-1988768782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:02:07 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-917bcf4e-8dc9-4c6c-a9d1-8540ec668d38 tempest-VolumesSnapshotTestJSON-1988768782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:02:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-917bcf4e-8dc9-4c6c-a9d1-8540ec668d38 tempest-VolumesSnapshotTestJSON-1988768782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:02:07 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[d522d8bb-cad1-4d2c-b4ce-ecbd1080b07b]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:02:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4b3b3a59-0a2e-4ddc-91c9-b214922cacd8 tempest-GroupsTest-278860274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-1ef466a2-0b16-4663-9281-07756b77bc63 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:02:07 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed94e8f8-ff6b-4d52-a9b4-dfca82d69c81]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:02:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-917bcf4e-8dc9-4c6c-a9d1-8540ec668d38 tempest-VolumesSnapshotTestJSON-1988768782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d3a99dac-fbd6-4bdb-b2aa-9b94c94b87bc.03a75ca9-e2f1-42cd-9d2d-f8c296b88c57 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:02:07 devstack sudo[98982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d3a99dac-fbd6-4bdb-b2aa-9b94c94b87bc.03a75ca9-e2f1-42cd-9d2d-f8c296b88c57 Aug 10 16:02:07 devstack sudo[98982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:02:07 devstack sudo[98978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-1ef466a2-0b16-4663-9281-07756b77bc63 Aug 10 16:02:07 devstack sudo[98978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:02:08 devstack sudo[98982]: pam_unix(sudo:session): session closed for user root Aug 10 16:02:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-917bcf4e-8dc9-4c6c-a9d1-8540ec668d38 tempest-VolumesSnapshotTestJSON-1988768782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d3a99dac-fbd6-4bdb-b2aa-9b94c94b87bc.03a75ca9-e2f1-42cd-9d2d-f8c296b88c57" returned: 0 in 0.932s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:02:08 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-917bcf4e-8dc9-4c6c-a9d1-8540ec668d38 tempest-VolumesSnapshotTestJSON-1988768782 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3a99dac-fbd6-4bdb-b2aa-9b94c94b87bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 16:02:08 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[152d751f-9d7e-4753-910b-69cd7ab1a3db]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:02:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-917bcf4e-8dc9-4c6c-a9d1-8540ec668d38 tempest-VolumesSnapshotTestJSON-1988768782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d3a99dac-fbd6-4bdb-b2aa-9b94c94b87bc {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:02:08 devstack sudo[98978]: pam_unix(sudo:session): session closed for user root Aug 10 16:02:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4b3b3a59-0a2e-4ddc-91c9-b214922cacd8 tempest-GroupsTest-278860274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-1ef466a2-0b16-4663-9281-07756b77bc63" returned: 0 in 1.048s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:02:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4b3b3a59-0a2e-4ddc-91c9-b214922cacd8 tempest-GroupsTest-278860274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-1ef466a2-0b16-4663-9281-07756b77bc63 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:02:08 devstack sudo[99010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-1ef466a2-0b16-4663-9281-07756b77bc63 Aug 10 16:02:08 devstack sudo[99010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:02:08 devstack sudo[99009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d3a99dac-fbd6-4bdb-b2aa-9b94c94b87bc Aug 10 16:02:08 devstack sudo[99009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:02:08 devstack sudo[99010]: pam_unix(sudo:session): session closed for user root Aug 10 16:02:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4b3b3a59-0a2e-4ddc-91c9-b214922cacd8 tempest-GroupsTest-278860274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-1ef466a2-0b16-4663-9281-07756b77bc63" returned: 0 in 0.494s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:02:08 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-4b3b3a59-0a2e-4ddc-91c9-b214922cacd8 tempest-GroupsTest-278860274 None] Lock "cinder-quobyte-1ef466a2-0b16-4663-9281-07756b77bc63" released by "delete_volume" :: held 1.666s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:02:08 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-4b3b3a59-0a2e-4ddc-91c9-b214922cacd8 tempest-GroupsTest-278860274 None] Acquiring lock "cinder-quobyte-225f5a78-7bfa-4d90-b131-185ad4862c8d" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:02:08 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-4b3b3a59-0a2e-4ddc-91c9-b214922cacd8 tempest-GroupsTest-278860274 None] Lock "cinder-quobyte-225f5a78-7bfa-4d90-b131-185ad4862c8d" acquired by "delete_volume" :: waited 0.034s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:02:08 devstack sudo[99009]: pam_unix(sudo:session): session closed for user root Aug 10 16:02:08 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[69129e50-5063-4b18-bb0d-dfa51cce589a]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:02:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4b3b3a59-0a2e-4ddc-91c9-b214922cacd8 tempest-GroupsTest-278860274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-225f5a78-7bfa-4d90-b131-185ad4862c8d {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:02:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-917bcf4e-8dc9-4c6c-a9d1-8540ec668d38 tempest-VolumesSnapshotTestJSON-1988768782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d3a99dac-fbd6-4bdb-b2aa-9b94c94b87bc" returned: 0 in 0.684s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:02:08 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-917bcf4e-8dc9-4c6c-a9d1-8540ec668d38 tempest-VolumesSnapshotTestJSON-1988768782 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d3a99dac-fbd6-4bdb-b2aa-9b94c94b87bc {{(pid=88641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 10 16:02:08 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-917bcf4e-8dc9-4c6c-a9d1-8540ec668d38 tempest-VolumesSnapshotTestJSON-1988768782 None] Creating direct copy from snapshot {{(pid=88641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 10 16:02:08 devstack cinder-volume[88641]: DEBUG cinder.utils [None req-917bcf4e-8dc9-4c6c-a9d1-8540ec668d38 tempest-VolumesSnapshotTestJSON-1988768782 None] Path /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-89937369-638a-4f45-9a00-3b6284553a6b not found in is_blk_device check {{(pid=88641) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 10 16:02:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-917bcf4e-8dc9-4c6c-a9d1-8540ec668d38 tempest-VolumesSnapshotTestJSON-1988768782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d3a99dac-fbd6-4bdb-b2aa-9b94c94b87bc /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-89937369-638a-4f45-9a00-3b6284553a6b {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:02:08 devstack sudo[99018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d3a99dac-fbd6-4bdb-b2aa-9b94c94b87bc /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-89937369-638a-4f45-9a00-3b6284553a6b Aug 10 16:02:08 devstack sudo[99018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:02:08 devstack sudo[99017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-225f5a78-7bfa-4d90-b131-185ad4862c8d Aug 10 16:02:08 devstack sudo[99017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:02:09 devstack sudo[99017]: pam_unix(sudo:session): session closed for user root Aug 10 16:02:09 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4b3b3a59-0a2e-4ddc-91c9-b214922cacd8 tempest-GroupsTest-278860274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-225f5a78-7bfa-4d90-b131-185ad4862c8d" returned: 0 in 0.650s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:02:09 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4b3b3a59-0a2e-4ddc-91c9-b214922cacd8 tempest-GroupsTest-278860274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-225f5a78-7bfa-4d90-b131-185ad4862c8d {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:02:09 devstack sudo[99029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-225f5a78-7bfa-4d90-b131-185ad4862c8d Aug 10 16:02:09 devstack sudo[99029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:02:10 devstack sudo[99029]: pam_unix(sudo:session): session closed for user root Aug 10 16:02:10 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4b3b3a59-0a2e-4ddc-91c9-b214922cacd8 tempest-GroupsTest-278860274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-225f5a78-7bfa-4d90-b131-185ad4862c8d" returned: 0 in 0.957s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:02:10 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-4b3b3a59-0a2e-4ddc-91c9-b214922cacd8 tempest-GroupsTest-278860274 None] Lock "cinder-quobyte-225f5a78-7bfa-4d90-b131-185ad4862c8d" released by "delete_volume" :: held 1.768s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:02:10 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-4b3b3a59-0a2e-4ddc-91c9-b214922cacd8 tempest-GroupsTest-278860274 None] Created reservations ['c79e22b3-fc75-4e9e-895d-66c884311952'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:02:10 devstack cinder-volume[88641]: WARNING cinder.quota [None req-4b3b3a59-0a2e-4ddc-91c9-b214922cacd8 tempest-GroupsTest-278860274 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-86499202 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-86499202, it is now deprecated. Please use the default quota class for default quota. Aug 10 16:02:10 devstack cinder-volume[88641]: WARNING cinder.quota [None req-4b3b3a59-0a2e-4ddc-91c9-b214922cacd8 tempest-GroupsTest-278860274 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-86499202 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-86499202, it is now deprecated. Please use the default quota class for default quota. Aug 10 16:02:10 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-4b3b3a59-0a2e-4ddc-91c9-b214922cacd8 tempest-GroupsTest-278860274 None] Created reservations ['e41baf06-1d5f-44be-8070-f8f3de0b6b63', '9b221687-2c6d-4b8f-8c72-5c3ad88804be', '0b334940-4c05-4f54-af09-20f325cd65ca', 'fafbf5f1-10cb-4730-97aa-ff27f607a464'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:02:11 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-4b3b3a59-0a2e-4ddc-91c9-b214922cacd8 tempest-GroupsTest-278860274 None] Created reservations ['dbb4a408-6178-4226-b015-3706d93cc073', 'b18a1d0f-faf0-415e-a388-163ac684e472', '5514aa15-d800-4db5-a081-38f9530207b5', '8f409875-e448-42d6-844e-e71c207f1491'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:02:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-4b3b3a59-0a2e-4ddc-91c9-b214922cacd8 tempest-GroupsTest-278860274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:02:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-4b3b3a59-0a2e-4ddc-91c9-b214922cacd8 tempest-GroupsTest-278860274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:02:11 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-4b3b3a59-0a2e-4ddc-91c9-b214922cacd8 tempest-GroupsTest-278860274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:02:11 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-4b3b3a59-0a2e-4ddc-91c9-b214922cacd8 tempest-GroupsTest-278860274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:02:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-4b3b3a59-0a2e-4ddc-91c9-b214922cacd8 tempest-GroupsTest-278860274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:02:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4b3b3a59-0a2e-4ddc-91c9-b214922cacd8 tempest-GroupsTest-278860274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:02:12 devstack sudo[99040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:02:12 devstack sudo[99040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:02:12 devstack sudo[99040]: pam_unix(sudo:session): session closed for user root Aug 10 16:02:12 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4b3b3a59-0a2e-4ddc-91c9-b214922cacd8 tempest-GroupsTest-278860274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.838s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:02:12 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-4b3b3a59-0a2e-4ddc-91c9-b214922cacd8 tempest-GroupsTest-278860274 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:02:12 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-4b3b3a59-0a2e-4ddc-91c9-b214922cacd8 tempest-GroupsTest-278860274 None] Delete group completed successfully. Aug 10 16:02:19 devstack sudo[99018]: pam_unix(sudo:session): session closed for user root Aug 10 16:02:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-917bcf4e-8dc9-4c6c-a9d1-8540ec668d38 tempest-VolumesSnapshotTestJSON-1988768782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d3a99dac-fbd6-4bdb-b2aa-9b94c94b87bc /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-89937369-638a-4f45-9a00-3b6284553a6b" returned: 0 in 10.564s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:02:19 devstack cinder-volume[88641]: DEBUG cinder.image.image_utils [None req-917bcf4e-8dc9-4c6c-a9d1-8540ec668d38 tempest-VolumesSnapshotTestJSON-1988768782 None] Image conversion details: src /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d3a99dac-fbd6-4bdb-b2aa-9b94c94b87bc, size 1024.00 MB, duration 10.57 sec, destination /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-89937369-638a-4f45-9a00-3b6284553a6b {{(pid=88641) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 10 16:02:19 devstack cinder-volume[88641]: INFO cinder.image.image_utils [None req-917bcf4e-8dc9-4c6c-a9d1-8540ec668d38 tempest-VolumesSnapshotTestJSON-1988768782 None] Converted 1024.00 MB image at 96.92 MB/s Aug 10 16:02:19 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-917bcf4e-8dc9-4c6c-a9d1-8540ec668d38 tempest-VolumesSnapshotTestJSON-1988768782 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-89937369-638a-4f45-9a00-3b6284553a6b is being set with open permissions: ugo+rw Aug 10 16:02:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-917bcf4e-8dc9-4c6c-a9d1-8540ec668d38 tempest-VolumesSnapshotTestJSON-1988768782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-89937369-638a-4f45-9a00-3b6284553a6b {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:02:19 devstack sudo[99046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-89937369-638a-4f45-9a00-3b6284553a6b Aug 10 16:02:19 devstack sudo[99046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:02:19 devstack sudo[99046]: pam_unix(sudo:session): session closed for user root Aug 10 16:02:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-917bcf4e-8dc9-4c6c-a9d1-8540ec668d38 tempest-VolumesSnapshotTestJSON-1988768782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-89937369-638a-4f45-9a00-3b6284553a6b" returned: 0 in 0.569s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:02:19 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-917bcf4e-8dc9-4c6c-a9d1-8540ec668d38 tempest-VolumesSnapshotTestJSON-1988768782 None] Lock "cinder-quobyte-89937369-638a-4f45-9a00-3b6284553a6b" released by "_copy_volume_from_snapshot" :: held 12.969s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:02:20 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-917bcf4e-8dc9-4c6c-a9d1-8540ec668d38 tempest-VolumesSnapshotTestJSON-1988768782 None] Lock "cinder-quobyte-03a75ca9-e2f1-42cd-9d2d-f8c296b88c57-89937369-638a-4f45-9a00-3b6284553a6b" released by "_create_volume_from_snapshot" :: held 13.104s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:02:20 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-917bcf4e-8dc9-4c6c-a9d1-8540ec668d38 tempest-VolumesSnapshotTestJSON-1988768782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.292s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:02:20 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-917bcf4e-8dc9-4c6c-a9d1-8540ec668d38 tempest-VolumesSnapshotTestJSON-1988768782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c703394a-117c-4466-bfff-42a13031d238) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89937369-638a-4f45-9a00-3b6284553a6b', 'volume_size': 1, 'snapshot_id': '03a75ca9-e2f1-42cd-9d2d-f8c296b88c57'}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:02:20 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-917bcf4e-8dc9-4c6c-a9d1-8540ec668d38 tempest-VolumesSnapshotTestJSON-1988768782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (637e859c-e8e7-4837-bd0a-3e50dffea074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:02:20 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-917bcf4e-8dc9-4c6c-a9d1-8540ec668d38 tempest-VolumesSnapshotTestJSON-1988768782 None] Volume volume-89937369-638a-4f45-9a00-3b6284553a6b (89937369-638a-4f45-9a00-3b6284553a6b): created successfully Aug 10 16:02:20 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-917bcf4e-8dc9-4c6c-a9d1-8540ec668d38 tempest-VolumesSnapshotTestJSON-1988768782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (637e859c-e8e7-4837-bd0a-3e50dffea074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:02:20 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-917bcf4e-8dc9-4c6c-a9d1-8540ec668d38 tempest-VolumesSnapshotTestJSON-1988768782 None] Flow 'volume_create_manager' (405a9e69-0a36-44f0-b227-edb7bf9b0c6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:02:20 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-917bcf4e-8dc9-4c6c-a9d1-8540ec668d38 tempest-VolumesSnapshotTestJSON-1988768782 None] Created volume successfully. Aug 10 16:02:21 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-c6de91b4-4634-4c5f-a500-2d7161f8a306 tempest-VolumesSnapshotTestJSON-1988768782 None] Acquiring lock "cinder-89937369-638a-4f45-9a00-3b6284553a6b-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:02:21 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-c6de91b4-4634-4c5f-a500-2d7161f8a306 tempest-VolumesSnapshotTestJSON-1988768782 None] Lock "cinder-89937369-638a-4f45-9a00-3b6284553a6b-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:02:21 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-c6de91b4-4634-4c5f-a500-2d7161f8a306 tempest-VolumesSnapshotTestJSON-1988768782 None] Acquiring lock "cinder-quobyte-89937369-638a-4f45-9a00-3b6284553a6b" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:02:21 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-c6de91b4-4634-4c5f-a500-2d7161f8a306 tempest-VolumesSnapshotTestJSON-1988768782 None] Lock "cinder-quobyte-89937369-638a-4f45-9a00-3b6284553a6b" acquired by "delete_volume" :: waited 0.056s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:02:21 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[e29834eb-19d8-4f6e-b34e-b41b75ce3604]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:02:21 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c6de91b4-4634-4c5f-a500-2d7161f8a306 tempest-VolumesSnapshotTestJSON-1988768782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-89937369-638a-4f45-9a00-3b6284553a6b {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:02:21 devstack sudo[99054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-89937369-638a-4f45-9a00-3b6284553a6b Aug 10 16:02:21 devstack sudo[99054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:02:22 devstack sudo[99054]: pam_unix(sudo:session): session closed for user root Aug 10 16:02:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c6de91b4-4634-4c5f-a500-2d7161f8a306 tempest-VolumesSnapshotTestJSON-1988768782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-89937369-638a-4f45-9a00-3b6284553a6b" returned: 0 in 0.731s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:02:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c6de91b4-4634-4c5f-a500-2d7161f8a306 tempest-VolumesSnapshotTestJSON-1988768782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-89937369-638a-4f45-9a00-3b6284553a6b {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:02:22 devstack sudo[99060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-89937369-638a-4f45-9a00-3b6284553a6b Aug 10 16:02:22 devstack sudo[99060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:02:22 devstack sudo[99060]: pam_unix(sudo:session): session closed for user root Aug 10 16:02:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c6de91b4-4634-4c5f-a500-2d7161f8a306 tempest-VolumesSnapshotTestJSON-1988768782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-89937369-638a-4f45-9a00-3b6284553a6b" returned: 0 in 0.835s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:02:22 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-c6de91b4-4634-4c5f-a500-2d7161f8a306 tempest-VolumesSnapshotTestJSON-1988768782 None] Lock "cinder-quobyte-89937369-638a-4f45-9a00-3b6284553a6b" released by "delete_volume" :: held 1.649s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:02:23 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-c6de91b4-4634-4c5f-a500-2d7161f8a306 tempest-VolumesSnapshotTestJSON-1988768782 None] Created reservations ['7ec0b189-34f4-4d8b-9d1a-68bdbfdbab0a', '10356ead-d623-42ea-b6da-3c53ac282c40', 'cf8182e0-df92-4840-8db4-68a65de26bbb', '84f7d004-09b1-432c-8cb3-5222acd9610e'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:02:23 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-c6de91b4-4634-4c5f-a500-2d7161f8a306 tempest-VolumesSnapshotTestJSON-1988768782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:02:23 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-c6de91b4-4634-4c5f-a500-2d7161f8a306 tempest-VolumesSnapshotTestJSON-1988768782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:02:23 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-c6de91b4-4634-4c5f-a500-2d7161f8a306 tempest-VolumesSnapshotTestJSON-1988768782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:02:23 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-c6de91b4-4634-4c5f-a500-2d7161f8a306 tempest-VolumesSnapshotTestJSON-1988768782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:02:23 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-c6de91b4-4634-4c5f-a500-2d7161f8a306 tempest-VolumesSnapshotTestJSON-1988768782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:02:23 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c6de91b4-4634-4c5f-a500-2d7161f8a306 tempest-VolumesSnapshotTestJSON-1988768782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:02:23 devstack sudo[99087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:02:23 devstack sudo[99087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:02:23 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-fe8553a0-4de7-40a4-9e70-f32adefff5c2 tempest-VolumesSnapshotTestJSON-1988768782 None] Acquiring lock "cinder-03a75ca9-e2f1-42cd-9d2d-f8c296b88c57-delete_snapshot" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:02:23 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-fe8553a0-4de7-40a4-9e70-f32adefff5c2 tempest-VolumesSnapshotTestJSON-1988768782 None] Lock "cinder-03a75ca9-e2f1-42cd-9d2d-f8c296b88c57-delete_snapshot" acquired by "delete_snapshot" :: waited 0.075s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:02:23 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-fe8553a0-4de7-40a4-9e70-f32adefff5c2 tempest-VolumesSnapshotTestJSON-1988768782 None] Acquiring lock "cinder-quobyte-d3a99dac-fbd6-4bdb-b2aa-9b94c94b87bc" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:02:23 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-fe8553a0-4de7-40a4-9e70-f32adefff5c2 tempest-VolumesSnapshotTestJSON-1988768782 None] Lock "cinder-quobyte-d3a99dac-fbd6-4bdb-b2aa-9b94c94b87bc" acquired by "delete_snapshot" :: waited 0.065s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:02:23 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-fe8553a0-4de7-40a4-9e70-f32adefff5c2 tempest-VolumesSnapshotTestJSON-1988768782 None] Acquiring lock "cinder-quobyte-03a75ca9-e2f1-42cd-9d2d-f8c296b88c57" by "_delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:02:23 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-fe8553a0-4de7-40a4-9e70-f32adefff5c2 tempest-VolumesSnapshotTestJSON-1988768782 None] Lock "cinder-quobyte-03a75ca9-e2f1-42cd-9d2d-f8c296b88c57" acquired by "_delete_snapshot" :: waited 0.077s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:02:23 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-fe8553a0-4de7-40a4-9e70-f32adefff5c2 tempest-VolumesSnapshotTestJSON-1988768782 None] Deleting offline snapshot 03a75ca9-e2f1-42cd-9d2d-f8c296b88c57 of volume d3a99dac-fbd6-4bdb-b2aa-9b94c94b87bc {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 16:02:23 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-fe8553a0-4de7-40a4-9e70-f32adefff5c2 tempest-VolumesSnapshotTestJSON-1988768782 None] snapshot_file for this snap is: volume-d3a99dac-fbd6-4bdb-b2aa-9b94c94b87bc.03a75ca9-e2f1-42cd-9d2d-f8c296b88c57 {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 16:02:23 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[3103b175-8e6f-4643-8740-99e5c1aab29c]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:02:23 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fe8553a0-4de7-40a4-9e70-f32adefff5c2 tempest-VolumesSnapshotTestJSON-1988768782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d3a99dac-fbd6-4bdb-b2aa-9b94c94b87bc.03a75ca9-e2f1-42cd-9d2d-f8c296b88c57 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:02:24 devstack sudo[99087]: pam_unix(sudo:session): session closed for user root Aug 10 16:02:24 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c6de91b4-4634-4c5f-a500-2d7161f8a306 tempest-VolumesSnapshotTestJSON-1988768782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.837s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:02:24 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-c6de91b4-4634-4c5f-a500-2d7161f8a306 tempest-VolumesSnapshotTestJSON-1988768782 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:02:24 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-c6de91b4-4634-4c5f-a500-2d7161f8a306 tempest-VolumesSnapshotTestJSON-1988768782 None] Deleted volume successfully. Aug 10 16:02:24 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-c6de91b4-4634-4c5f-a500-2d7161f8a306 tempest-VolumesSnapshotTestJSON-1988768782 None] Lock "cinder-89937369-638a-4f45-9a00-3b6284553a6b-delete_volume" released by "delete_volume" :: held 3.004s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:02:24 devstack sudo[99090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d3a99dac-fbd6-4bdb-b2aa-9b94c94b87bc.03a75ca9-e2f1-42cd-9d2d-f8c296b88c57 Aug 10 16:02:24 devstack sudo[99090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:02:24 devstack sudo[99090]: pam_unix(sudo:session): session closed for user root Aug 10 16:02:24 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fe8553a0-4de7-40a4-9e70-f32adefff5c2 tempest-VolumesSnapshotTestJSON-1988768782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d3a99dac-fbd6-4bdb-b2aa-9b94c94b87bc.03a75ca9-e2f1-42cd-9d2d-f8c296b88c57" returned: 0 in 0.914s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:02:24 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-fe8553a0-4de7-40a4-9e70-f32adefff5c2 tempest-VolumesSnapshotTestJSON-1988768782 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3a99dac-fbd6-4bdb-b2aa-9b94c94b87bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 16:02:24 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a50013b-d29e-4685-a8f9-99b47467b776]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:02:24 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fe8553a0-4de7-40a4-9e70-f32adefff5c2 tempest-VolumesSnapshotTestJSON-1988768782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d3a99dac-fbd6-4bdb-b2aa-9b94c94b87bc {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:02:25 devstack sudo[99128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d3a99dac-fbd6-4bdb-b2aa-9b94c94b87bc Aug 10 16:02:25 devstack sudo[99128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:02:25 devstack sudo[99128]: pam_unix(sudo:session): session closed for user root Aug 10 16:02:25 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fe8553a0-4de7-40a4-9e70-f32adefff5c2 tempest-VolumesSnapshotTestJSON-1988768782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d3a99dac-fbd6-4bdb-b2aa-9b94c94b87bc" returned: 0 in 0.865s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:02:25 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fe8553a0-4de7-40a4-9e70-f32adefff5c2 tempest-VolumesSnapshotTestJSON-1988768782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d3a99dac-fbd6-4bdb-b2aa-9b94c94b87bc.03a75ca9-e2f1-42cd-9d2d-f8c296b88c57 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:02:25 devstack sudo[99134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d3a99dac-fbd6-4bdb-b2aa-9b94c94b87bc.03a75ca9-e2f1-42cd-9d2d-f8c296b88c57 Aug 10 16:02:25 devstack sudo[99134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:02:26 devstack sudo[99134]: pam_unix(sudo:session): session closed for user root Aug 10 16:02:26 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fe8553a0-4de7-40a4-9e70-f32adefff5c2 tempest-VolumesSnapshotTestJSON-1988768782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d3a99dac-fbd6-4bdb-b2aa-9b94c94b87bc.03a75ca9-e2f1-42cd-9d2d-f8c296b88c57" returned: 0 in 0.489s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:02:26 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fe8553a0-4de7-40a4-9e70-f32adefff5c2 tempest-VolumesSnapshotTestJSON-1988768782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d3a99dac-fbd6-4bdb-b2aa-9b94c94b87bc.03a75ca9-e2f1-42cd-9d2d-f8c296b88c57 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:02:26 devstack sudo[99140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d3a99dac-fbd6-4bdb-b2aa-9b94c94b87bc.03a75ca9-e2f1-42cd-9d2d-f8c296b88c57 Aug 10 16:02:26 devstack sudo[99140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:02:26 devstack sudo[99140]: pam_unix(sudo:session): session closed for user root Aug 10 16:02:26 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fe8553a0-4de7-40a4-9e70-f32adefff5c2 tempest-VolumesSnapshotTestJSON-1988768782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d3a99dac-fbd6-4bdb-b2aa-9b94c94b87bc.03a75ca9-e2f1-42cd-9d2d-f8c296b88c57" returned: 0 in 0.316s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:02:26 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-fe8553a0-4de7-40a4-9e70-f32adefff5c2 tempest-VolumesSnapshotTestJSON-1988768782 None] Lock "cinder-quobyte-03a75ca9-e2f1-42cd-9d2d-f8c296b88c57" released by "_delete_snapshot" :: held 2.829s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:02:26 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-fe8553a0-4de7-40a4-9e70-f32adefff5c2 tempest-VolumesSnapshotTestJSON-1988768782 None] Lock "cinder-quobyte-d3a99dac-fbd6-4bdb-b2aa-9b94c94b87bc" released by "delete_snapshot" :: held 2.915s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:02:26 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-fe8553a0-4de7-40a4-9e70-f32adefff5c2 tempest-VolumesSnapshotTestJSON-1988768782 None] Created reservations ['d7abef60-0e3c-431d-bfeb-b2f93260c386', 'f09b438f-be3e-4f6d-8265-63a7973bc898', 'e7d3facf-811c-4681-a963-fda43974db75', 'd94d0e84-00ac-4983-8f36-078c136d244c'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:02:26 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-fe8553a0-4de7-40a4-9e70-f32adefff5c2 tempest-VolumesSnapshotTestJSON-1988768782 None] Delete snapshot completed successfully. Aug 10 16:02:26 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-fe8553a0-4de7-40a4-9e70-f32adefff5c2 tempest-VolumesSnapshotTestJSON-1988768782 None] Lock "cinder-03a75ca9-e2f1-42cd-9d2d-f8c296b88c57-delete_snapshot" released by "delete_snapshot" :: held 3.177s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:02:27 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-60e2e808-bc92-4e38-b2f7-504d2fb5f7a5 tempest-VolumesSnapshotTestJSON-1988768782 None] Acquiring lock "cinder-d3a99dac-fbd6-4bdb-b2aa-9b94c94b87bc-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:02:27 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-60e2e808-bc92-4e38-b2f7-504d2fb5f7a5 tempest-VolumesSnapshotTestJSON-1988768782 None] Lock "cinder-d3a99dac-fbd6-4bdb-b2aa-9b94c94b87bc-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:02:27 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-60e2e808-bc92-4e38-b2f7-504d2fb5f7a5 tempest-VolumesSnapshotTestJSON-1988768782 None] Acquiring lock "cinder-quobyte-d3a99dac-fbd6-4bdb-b2aa-9b94c94b87bc" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:02:27 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-60e2e808-bc92-4e38-b2f7-504d2fb5f7a5 tempest-VolumesSnapshotTestJSON-1988768782 None] Lock "cinder-quobyte-d3a99dac-fbd6-4bdb-b2aa-9b94c94b87bc" acquired by "delete_volume" :: waited 0.032s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:02:27 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b5a364-ac6f-405c-b8c7-3b921a85e519]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:02:27 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-60e2e808-bc92-4e38-b2f7-504d2fb5f7a5 tempest-VolumesSnapshotTestJSON-1988768782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d3a99dac-fbd6-4bdb-b2aa-9b94c94b87bc {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:02:27 devstack sudo[99144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d3a99dac-fbd6-4bdb-b2aa-9b94c94b87bc Aug 10 16:02:27 devstack sudo[99144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:02:27 devstack sudo[99144]: pam_unix(sudo:session): session closed for user root Aug 10 16:02:28 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-60e2e808-bc92-4e38-b2f7-504d2fb5f7a5 tempest-VolumesSnapshotTestJSON-1988768782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d3a99dac-fbd6-4bdb-b2aa-9b94c94b87bc" returned: 0 in 0.652s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:02:28 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-60e2e808-bc92-4e38-b2f7-504d2fb5f7a5 tempest-VolumesSnapshotTestJSON-1988768782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d3a99dac-fbd6-4bdb-b2aa-9b94c94b87bc {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:02:28 devstack sudo[99149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d3a99dac-fbd6-4bdb-b2aa-9b94c94b87bc Aug 10 16:02:28 devstack sudo[99149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:02:28 devstack sudo[99149]: pam_unix(sudo:session): session closed for user root Aug 10 16:02:28 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-60e2e808-bc92-4e38-b2f7-504d2fb5f7a5 tempest-VolumesSnapshotTestJSON-1988768782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d3a99dac-fbd6-4bdb-b2aa-9b94c94b87bc" returned: 0 in 0.278s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:02:28 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-60e2e808-bc92-4e38-b2f7-504d2fb5f7a5 tempest-VolumesSnapshotTestJSON-1988768782 None] Lock "cinder-quobyte-d3a99dac-fbd6-4bdb-b2aa-9b94c94b87bc" released by "delete_volume" :: held 1.016s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:02:28 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-60e2e808-bc92-4e38-b2f7-504d2fb5f7a5 tempest-VolumesSnapshotTestJSON-1988768782 None] Created reservations ['74853e17-100b-4dda-a217-a2b6f2990882', '3d43edaa-b382-4a97-a47a-6289e1e7177d', '558af107-7606-4511-a81f-3c922625c898', '09e9dfb1-5847-4cce-86c5-1b9e78da4b06'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:02:28 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-60e2e808-bc92-4e38-b2f7-504d2fb5f7a5 tempest-VolumesSnapshotTestJSON-1988768782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:02:28 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-60e2e808-bc92-4e38-b2f7-504d2fb5f7a5 tempest-VolumesSnapshotTestJSON-1988768782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:02:28 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-60e2e808-bc92-4e38-b2f7-504d2fb5f7a5 tempest-VolumesSnapshotTestJSON-1988768782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:02:28 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-60e2e808-bc92-4e38-b2f7-504d2fb5f7a5 tempest-VolumesSnapshotTestJSON-1988768782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:02:28 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-60e2e808-bc92-4e38-b2f7-504d2fb5f7a5 tempest-VolumesSnapshotTestJSON-1988768782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:02:28 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-60e2e808-bc92-4e38-b2f7-504d2fb5f7a5 tempest-VolumesSnapshotTestJSON-1988768782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:02:28 devstack sudo[99152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:02:28 devstack sudo[99152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:02:28 devstack sudo[99152]: pam_unix(sudo:session): session closed for user root Aug 10 16:02:28 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-60e2e808-bc92-4e38-b2f7-504d2fb5f7a5 tempest-VolumesSnapshotTestJSON-1988768782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.263s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:02:28 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-60e2e808-bc92-4e38-b2f7-504d2fb5f7a5 tempest-VolumesSnapshotTestJSON-1988768782 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:02:28 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-60e2e808-bc92-4e38-b2f7-504d2fb5f7a5 tempest-VolumesSnapshotTestJSON-1988768782 None] Deleted volume successfully. Aug 10 16:02:28 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-60e2e808-bc92-4e38-b2f7-504d2fb5f7a5 tempest-VolumesSnapshotTestJSON-1988768782 None] Lock "cinder-d3a99dac-fbd6-4bdb-b2aa-9b94c94b87bc-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:02:29 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-e8ac4eb5-5688-4b96-aac7-9639f6bf958b tempest-VolumesSnapshotTestJSON-1988768782 None] Acquiring lock "cinder-49e06805-d9a5-43ab-bef5-70b59b973297-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:02:29 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-e8ac4eb5-5688-4b96-aac7-9639f6bf958b tempest-VolumesSnapshotTestJSON-1988768782 None] Lock "cinder-49e06805-d9a5-43ab-bef5-70b59b973297-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:02:29 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-e8ac4eb5-5688-4b96-aac7-9639f6bf958b tempest-VolumesSnapshotTestJSON-1988768782 None] Acquiring lock "cinder-quobyte-49e06805-d9a5-43ab-bef5-70b59b973297" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:02:29 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-e8ac4eb5-5688-4b96-aac7-9639f6bf958b tempest-VolumesSnapshotTestJSON-1988768782 None] Lock "cinder-quobyte-49e06805-d9a5-43ab-bef5-70b59b973297" acquired by "delete_volume" :: waited 0.020s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:02:29 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ee776b-a61b-497c-96a1-6337583ce7a3]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:02:29 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e8ac4eb5-5688-4b96-aac7-9639f6bf958b tempest-VolumesSnapshotTestJSON-1988768782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-49e06805-d9a5-43ab-bef5-70b59b973297 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:02:29 devstack sudo[99159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-49e06805-d9a5-43ab-bef5-70b59b973297 Aug 10 16:02:29 devstack sudo[99159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:02:30 devstack sudo[99159]: pam_unix(sudo:session): session closed for user root Aug 10 16:02:30 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e8ac4eb5-5688-4b96-aac7-9639f6bf958b tempest-VolumesSnapshotTestJSON-1988768782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-49e06805-d9a5-43ab-bef5-70b59b973297" returned: 0 in 0.445s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:02:30 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e8ac4eb5-5688-4b96-aac7-9639f6bf958b tempest-VolumesSnapshotTestJSON-1988768782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-49e06805-d9a5-43ab-bef5-70b59b973297 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:02:30 devstack sudo[99167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-49e06805-d9a5-43ab-bef5-70b59b973297 Aug 10 16:02:30 devstack sudo[99167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:02:30 devstack sudo[99167]: pam_unix(sudo:session): session closed for user root Aug 10 16:02:30 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e8ac4eb5-5688-4b96-aac7-9639f6bf958b tempest-VolumesSnapshotTestJSON-1988768782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-49e06805-d9a5-43ab-bef5-70b59b973297" returned: 0 in 0.310s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:02:30 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-e8ac4eb5-5688-4b96-aac7-9639f6bf958b tempest-VolumesSnapshotTestJSON-1988768782 None] Lock "cinder-quobyte-49e06805-d9a5-43ab-bef5-70b59b973297" released by "delete_volume" :: held 0.876s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:02:30 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-e8ac4eb5-5688-4b96-aac7-9639f6bf958b tempest-VolumesSnapshotTestJSON-1988768782 None] Created reservations ['532b995b-8151-458e-b45c-97a775b5c3dd', 'fe5004eb-8ba9-41a4-b80f-270804c018e6', '7d0000d2-bfe2-4620-b931-9cd25f223e6a', '6492cd5a-d8a5-41d1-9b4a-597be7774a33'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:02:30 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-e8ac4eb5-5688-4b96-aac7-9639f6bf958b tempest-VolumesSnapshotTestJSON-1988768782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:02:30 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-e8ac4eb5-5688-4b96-aac7-9639f6bf958b tempest-VolumesSnapshotTestJSON-1988768782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:02:30 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-e8ac4eb5-5688-4b96-aac7-9639f6bf958b tempest-VolumesSnapshotTestJSON-1988768782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:02:30 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-e8ac4eb5-5688-4b96-aac7-9639f6bf958b tempest-VolumesSnapshotTestJSON-1988768782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:02:30 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-e8ac4eb5-5688-4b96-aac7-9639f6bf958b tempest-VolumesSnapshotTestJSON-1988768782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:02:30 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e8ac4eb5-5688-4b96-aac7-9639f6bf958b tempest-VolumesSnapshotTestJSON-1988768782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:02:30 devstack sudo[99180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:02:30 devstack sudo[99180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:02:31 devstack sudo[99180]: pam_unix(sudo:session): session closed for user root Aug 10 16:02:31 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e8ac4eb5-5688-4b96-aac7-9639f6bf958b tempest-VolumesSnapshotTestJSON-1988768782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.333s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:02:31 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-e8ac4eb5-5688-4b96-aac7-9639f6bf958b tempest-VolumesSnapshotTestJSON-1988768782 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:02:31 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-e8ac4eb5-5688-4b96-aac7-9639f6bf958b tempest-VolumesSnapshotTestJSON-1988768782 None] Deleted volume successfully. Aug 10 16:02:31 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-e8ac4eb5-5688-4b96-aac7-9639f6bf958b tempest-VolumesSnapshotTestJSON-1988768782 None] Lock "cinder-49e06805-d9a5-43ab-bef5-70b59b973297-delete_volume" released by "delete_volume" :: held 1.557s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:02:34 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8442b3e-6f3f-4747-9500-e168af30406b tempest-AttachVolumeTestJSON-1986652723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:02:34 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-e8442b3e-6f3f-4747-9500-e168af30406b tempest-AttachVolumeTestJSON-1986652723 None] Flow 'volume_create_manager' (241441dd-0240-4936-baf8-a56d37330a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:02:34 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-e8442b3e-6f3f-4747-9500-e168af30406b tempest-AttachVolumeTestJSON-1986652723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0062140-5dca-4eef-b364-045e675e9c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:02:34 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-e8442b3e-6f3f-4747-9500-e168af30406b tempest-AttachVolumeTestJSON-1986652723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0062140-5dca-4eef-b364-045e675e9c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:02:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-372952831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=914dbc04-6c7c-4d80-bd5a-e5c2e3eaf787,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc33fe4b7ee34471b4438bd107c7a225',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:02:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:02:35Z,use_quota=True,user_id='daca380af8ab42918d1d1f5815ed4f3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:02:34 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-e8442b3e-6f3f-4747-9500-e168af30406b tempest-AttachVolumeTestJSON-1986652723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88cc45d3-e22d-47e6-9ee8-c452d2e635cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:02:34 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-e8442b3e-6f3f-4747-9500-e168af30406b tempest-AttachVolumeTestJSON-1986652723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88cc45d3-e22d-47e6-9ee8-c452d2e635cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:02:34 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-e8442b3e-6f3f-4747-9500-e168af30406b tempest-AttachVolumeTestJSON-1986652723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbc8ed4b-57e6-4777-bb15-ec54bf5a8bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:02:34 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-e8442b3e-6f3f-4747-9500-e168af30406b tempest-AttachVolumeTestJSON-1986652723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbc8ed4b-57e6-4777-bb15-ec54bf5a8bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '914dbc04-6c7c-4d80-bd5a-e5c2e3eaf787', 'volume_name': 'volume-914dbc04-6c7c-4d80-bd5a-e5c2e3eaf787', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:02:34 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-e8442b3e-6f3f-4747-9500-e168af30406b tempest-AttachVolumeTestJSON-1986652723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b174109b-e439-4290-8eff-d11bb6d0e72c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:02:34 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-e8442b3e-6f3f-4747-9500-e168af30406b tempest-AttachVolumeTestJSON-1986652723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b174109b-e439-4290-8eff-d11bb6d0e72c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:02:34 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-e8442b3e-6f3f-4747-9500-e168af30406b tempest-AttachVolumeTestJSON-1986652723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (256deff7-b87c-4507-b9be-fd3d8dbdd9f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:02:34 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-e8442b3e-6f3f-4747-9500-e168af30406b tempest-AttachVolumeTestJSON-1986652723 None] Volume 914dbc04-6c7c-4d80-bd5a-e5c2e3eaf787: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-914dbc04-6c7c-4d80-bd5a-e5c2e3eaf787', 'volume_size': 1} Aug 10 16:02:34 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-e8442b3e-6f3f-4747-9500-e168af30406b tempest-AttachVolumeTestJSON-1986652723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:02:34 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-e8442b3e-6f3f-4747-9500-e168af30406b tempest-AttachVolumeTestJSON-1986652723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:02:34 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-e8442b3e-6f3f-4747-9500-e168af30406b tempest-AttachVolumeTestJSON-1986652723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:02:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-372952831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=914dbc04-6c7c-4d80-bd5a-e5c2e3eaf787,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc33fe4b7ee34471b4438bd107c7a225',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:02:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:02:35Z,use_quota=True,user_id='daca380af8ab42918d1d1f5815ed4f3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:02:34 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-e8442b3e-6f3f-4747-9500-e168af30406b tempest-AttachVolumeTestJSON-1986652723 None] Creating volume 914dbc04-6c7c-4d80-bd5a-e5c2e3eaf787 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:02:34 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-e8442b3e-6f3f-4747-9500-e168af30406b tempest-AttachVolumeTestJSON-1986652723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:02:34 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-e8442b3e-6f3f-4747-9500-e168af30406b tempest-AttachVolumeTestJSON-1986652723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:02:34 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-e8442b3e-6f3f-4747-9500-e168af30406b tempest-AttachVolumeTestJSON-1986652723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:02:34 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-e8442b3e-6f3f-4747-9500-e168af30406b tempest-AttachVolumeTestJSON-1986652723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:02:34 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-e8442b3e-6f3f-4747-9500-e168af30406b tempest-AttachVolumeTestJSON-1986652723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:02:34 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-e8442b3e-6f3f-4747-9500-e168af30406b tempest-AttachVolumeTestJSON-1986652723 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:02:34 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-e8442b3e-6f3f-4747-9500-e168af30406b tempest-AttachVolumeTestJSON-1986652723 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:02:34 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e8442b3e-6f3f-4747-9500-e168af30406b tempest-AttachVolumeTestJSON-1986652723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-914dbc04-6c7c-4d80-bd5a-e5c2e3eaf787 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:02:34 devstack sudo[99200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-914dbc04-6c7c-4d80-bd5a-e5c2e3eaf787 1073741824 Aug 10 16:02:34 devstack sudo[99200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:02:35 devstack sudo[99200]: pam_unix(sudo:session): session closed for user root Aug 10 16:02:35 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e8442b3e-6f3f-4747-9500-e168af30406b tempest-AttachVolumeTestJSON-1986652723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-914dbc04-6c7c-4d80-bd5a-e5c2e3eaf787 1073741824" returned: 0 in 0.506s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:02:35 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e8442b3e-6f3f-4747-9500-e168af30406b tempest-AttachVolumeTestJSON-1986652723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-914dbc04-6c7c-4d80-bd5a-e5c2e3eaf787 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:02:35 devstack sudo[99205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-914dbc04-6c7c-4d80-bd5a-e5c2e3eaf787 Aug 10 16:02:35 devstack sudo[99205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:02:35 devstack sudo[99205]: pam_unix(sudo:session): session closed for user root Aug 10 16:02:35 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e8442b3e-6f3f-4747-9500-e168af30406b tempest-AttachVolumeTestJSON-1986652723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-914dbc04-6c7c-4d80-bd5a-e5c2e3eaf787" returned: 0 in 0.374s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:02:35 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-e8442b3e-6f3f-4747-9500-e168af30406b tempest-AttachVolumeTestJSON-1986652723 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:02:35 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-e8442b3e-6f3f-4747-9500-e168af30406b tempest-AttachVolumeTestJSON-1986652723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:02:35 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-e8442b3e-6f3f-4747-9500-e168af30406b tempest-AttachVolumeTestJSON-1986652723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (256deff7-b87c-4507-b9be-fd3d8dbdd9f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-914dbc04-6c7c-4d80-bd5a-e5c2e3eaf787', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:02:35 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-e8442b3e-6f3f-4747-9500-e168af30406b tempest-AttachVolumeTestJSON-1986652723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c47f699-43ea-4127-95c3-a894b1230d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:02:35 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-e8442b3e-6f3f-4747-9500-e168af30406b tempest-AttachVolumeTestJSON-1986652723 None] Volume volume-914dbc04-6c7c-4d80-bd5a-e5c2e3eaf787 (914dbc04-6c7c-4d80-bd5a-e5c2e3eaf787): created successfully Aug 10 16:02:35 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-e8442b3e-6f3f-4747-9500-e168af30406b tempest-AttachVolumeTestJSON-1986652723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c47f699-43ea-4127-95c3-a894b1230d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:02:35 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-e8442b3e-6f3f-4747-9500-e168af30406b tempest-AttachVolumeTestJSON-1986652723 None] Flow 'volume_create_manager' (241441dd-0240-4936-baf8-a56d37330a52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:02:35 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-e8442b3e-6f3f-4747-9500-e168af30406b tempest-AttachVolumeTestJSON-1986652723 None] Created volume successfully. Aug 10 16:02:36 devstack cinder-volume[88641]: DEBUG oslo_service.periodic_task [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Running periodic task VolumeManager._thread_info {{(pid=88641) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 16:02:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] thread count: 28 {{(pid=88641) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 10 16:02:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] thread info: [<_MainThread(MainThread, started 127361545748608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88641) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 10 16:02:36 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-c75196ad-b885-4d76-8b9a-fb1265d3f72d tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:02:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c75196ad-b885-4d76-8b9a-fb1265d3f72d tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] Flow 'volume_create_manager' (0b55491d-1fc1-4f98-9582-9a5ef39301b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:02:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c75196ad-b885-4d76-8b9a-fb1265d3f72d tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e53dc86-bff9-4265-87a0-fdd97fe46544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:02:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c75196ad-b885-4d76-8b9a-fb1265d3f72d tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e53dc86-bff9-4265-87a0-fdd97fe46544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:02:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-914219393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b10b204-bd8e-4cf3-9a8a-4a23a4acce04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='818d8f8837e74324ab43174f73c398f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:02:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:02:37Z,use_quota=True,user_id='18c74d8ca66b416997d330f3e8d2b2fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:02:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c75196ad-b885-4d76-8b9a-fb1265d3f72d tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af821624-c6b9-48f8-805c-b947686afeb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:02:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c75196ad-b885-4d76-8b9a-fb1265d3f72d tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af821624-c6b9-48f8-805c-b947686afeb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:02:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c75196ad-b885-4d76-8b9a-fb1265d3f72d tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (deb792b8-189f-4db4-b418-15f98a6a5078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:02:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c75196ad-b885-4d76-8b9a-fb1265d3f72d tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (deb792b8-189f-4db4-b418-15f98a6a5078) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b10b204-bd8e-4cf3-9a8a-4a23a4acce04', 'volume_name': 'volume-9b10b204-bd8e-4cf3-9a8a-4a23a4acce04', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:02:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c75196ad-b885-4d76-8b9a-fb1265d3f72d tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b666bc1-8248-404e-ad37-be52a4e0ea6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:02:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c75196ad-b885-4d76-8b9a-fb1265d3f72d tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b666bc1-8248-404e-ad37-be52a4e0ea6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:02:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c75196ad-b885-4d76-8b9a-fb1265d3f72d tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77461041-bc65-400c-a8a4-1598272013d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:02:36 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-c75196ad-b885-4d76-8b9a-fb1265d3f72d tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] Volume 9b10b204-bd8e-4cf3-9a8a-4a23a4acce04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b10b204-bd8e-4cf3-9a8a-4a23a4acce04', 'volume_size': 1} Aug 10 16:02:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-c75196ad-b885-4d76-8b9a-fb1265d3f72d tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:02:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-c75196ad-b885-4d76-8b9a-fb1265d3f72d tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:02:36 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-c75196ad-b885-4d76-8b9a-fb1265d3f72d tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:02:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-914219393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b10b204-bd8e-4cf3-9a8a-4a23a4acce04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='818d8f8837e74324ab43174f73c398f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:02:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:02:37Z,use_quota=True,user_id='18c74d8ca66b416997d330f3e8d2b2fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:02:36 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-c75196ad-b885-4d76-8b9a-fb1265d3f72d tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] Creating volume 9b10b204-bd8e-4cf3-9a8a-4a23a4acce04 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:02:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-c75196ad-b885-4d76-8b9a-fb1265d3f72d tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:02:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-c75196ad-b885-4d76-8b9a-fb1265d3f72d tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:02:36 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-c75196ad-b885-4d76-8b9a-fb1265d3f72d tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:02:36 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-c75196ad-b885-4d76-8b9a-fb1265d3f72d tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:02:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-c75196ad-b885-4d76-8b9a-fb1265d3f72d tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:02:36 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-c75196ad-b885-4d76-8b9a-fb1265d3f72d tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:02:36 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-c75196ad-b885-4d76-8b9a-fb1265d3f72d tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:02:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c75196ad-b885-4d76-8b9a-fb1265d3f72d tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9b10b204-bd8e-4cf3-9a8a-4a23a4acce04 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:02:36 devstack sudo[99209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9b10b204-bd8e-4cf3-9a8a-4a23a4acce04 1073741824 Aug 10 16:02:36 devstack sudo[99209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:02:37 devstack sudo[99209]: pam_unix(sudo:session): session closed for user root Aug 10 16:02:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c75196ad-b885-4d76-8b9a-fb1265d3f72d tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9b10b204-bd8e-4cf3-9a8a-4a23a4acce04 1073741824" returned: 0 in 0.499s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:02:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c75196ad-b885-4d76-8b9a-fb1265d3f72d tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9b10b204-bd8e-4cf3-9a8a-4a23a4acce04 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:02:37 devstack sudo[99223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9b10b204-bd8e-4cf3-9a8a-4a23a4acce04 Aug 10 16:02:37 devstack sudo[99223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:02:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-690f6b55-d80a-4304-8c0d-d568c8d4512f req-5752e5d7-1435-4fce-84a6-ca3e2342a3e9 tempest-AttachVolumeTestJSON-1986652723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:02:37 devstack sudo[99223]: pam_unix(sudo:session): session closed for user root Aug 10 16:02:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c75196ad-b885-4d76-8b9a-fb1265d3f72d tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9b10b204-bd8e-4cf3-9a8a-4a23a4acce04" returned: 0 in 0.270s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:02:37 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-c75196ad-b885-4d76-8b9a-fb1265d3f72d tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:02:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-c75196ad-b885-4d76-8b9a-fb1265d3f72d tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:02:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-690f6b55-d80a-4304-8c0d-d568c8d4512f req-5752e5d7-1435-4fce-84a6-ca3e2342a3e9 tempest-AttachVolumeTestJSON-1986652723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.051s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:02:37 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c75196ad-b885-4d76-8b9a-fb1265d3f72d tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77461041-bc65-400c-a8a4-1598272013d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b10b204-bd8e-4cf3-9a8a-4a23a4acce04', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:02:37 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c75196ad-b885-4d76-8b9a-fb1265d3f72d tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2f21757-f390-46e3-8d23-9fa29c30be83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:02:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-690f6b55-d80a-4304-8c0d-d568c8d4512f req-5752e5d7-1435-4fce-84a6-ca3e2342a3e9 tempest-AttachVolumeTestJSON-1986652723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:02:37 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-c75196ad-b885-4d76-8b9a-fb1265d3f72d tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] Volume volume-9b10b204-bd8e-4cf3-9a8a-4a23a4acce04 (9b10b204-bd8e-4cf3-9a8a-4a23a4acce04): created successfully Aug 10 16:02:37 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c75196ad-b885-4d76-8b9a-fb1265d3f72d tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2f21757-f390-46e3-8d23-9fa29c30be83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:02:37 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c75196ad-b885-4d76-8b9a-fb1265d3f72d tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] Flow 'volume_create_manager' (0b55491d-1fc1-4f98-9582-9a5ef39301b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:02:37 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-c75196ad-b885-4d76-8b9a-fb1265d3f72d tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] Created volume successfully. Aug 10 16:02:37 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [req-690f6b55-d80a-4304-8c0d-d568c8d4512f req-5752e5d7-1435-4fce-84a6-ca3e2342a3e9 tempest-AttachVolumeTestJSON-1986652723 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc', 'name': 'volume-914dbc04-6c7c-4d80-bd5a-e5c2e3eaf787', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e820eb4f-936f-4fa1-a6d4-aef90646bef7', 'enforce_multipath': True} {{(pid=88641) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 10 16:02:37 devstack cinder-volume[88641]: INFO cinder.volume.manager [req-690f6b55-d80a-4304-8c0d-d568c8d4512f req-5752e5d7-1435-4fce-84a6-ca3e2342a3e9 tempest-AttachVolumeTestJSON-1986652723 None] attachment_update completed successfully. Aug 10 16:02:39 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-e18ba761-0134-43b0-9c39-c7bc47bb64f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:02:39 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-e18ba761-0134-43b0-9c39-c7bc47bb64f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:02:39 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-e18ba761-0134-43b0-9c39-c7bc47bb64f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] Creating offline snapshot 31cb9c6b-97fd-4477-adf1-b68cab7ddf43 of volume 9b10b204-bd8e-4cf3-9a8a-4a23a4acce04 {{(pid=88641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 16:02:39 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c9aeaf-3787-40bd-bf92-8b6b4dc5669a]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:02:39 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e18ba761-0134-43b0-9c39-c7bc47bb64f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9b10b204-bd8e-4cf3-9a8a-4a23a4acce04 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:02:39 devstack sudo[99234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9b10b204-bd8e-4cf3-9a8a-4a23a4acce04 Aug 10 16:02:39 devstack sudo[99234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:02:39 devstack sudo[99234]: pam_unix(sudo:session): session closed for user root Aug 10 16:02:39 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e18ba761-0134-43b0-9c39-c7bc47bb64f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9b10b204-bd8e-4cf3-9a8a-4a23a4acce04" returned: 0 in 0.507s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:02:39 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e18ba761-0134-43b0-9c39-c7bc47bb64f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9b10b204-bd8e-4cf3-9a8a-4a23a4acce04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9b10b204-bd8e-4cf3-9a8a-4a23a4acce04.31cb9c6b-97fd-4477-adf1-b68cab7ddf43 1G {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:02:39 devstack sudo[99239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9b10b204-bd8e-4cf3-9a8a-4a23a4acce04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9b10b204-bd8e-4cf3-9a8a-4a23a4acce04.31cb9c6b-97fd-4477-adf1-b68cab7ddf43 1G Aug 10 16:02:39 devstack sudo[99239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:02:40 devstack sudo[99239]: pam_unix(sudo:session): session closed for user root Aug 10 16:02:40 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e18ba761-0134-43b0-9c39-c7bc47bb64f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9b10b204-bd8e-4cf3-9a8a-4a23a4acce04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9b10b204-bd8e-4cf3-9a8a-4a23a4acce04.31cb9c6b-97fd-4477-adf1-b68cab7ddf43 1G" returned: 0 in 0.589s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:02:40 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e18ba761-0134-43b0-9c39-c7bc47bb64f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b10b204-bd8e-4cf3-9a8a-4a23a4acce04 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9b10b204-bd8e-4cf3-9a8a-4a23a4acce04.31cb9c6b-97fd-4477-adf1-b68cab7ddf43 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:02:40 devstack sudo[99250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b10b204-bd8e-4cf3-9a8a-4a23a4acce04 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9b10b204-bd8e-4cf3-9a8a-4a23a4acce04.31cb9c6b-97fd-4477-adf1-b68cab7ddf43 Aug 10 16:02:40 devstack sudo[99250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:02:40 devstack sudo[99250]: pam_unix(sudo:session): session closed for user root Aug 10 16:02:40 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e18ba761-0134-43b0-9c39-c7bc47bb64f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b10b204-bd8e-4cf3-9a8a-4a23a4acce04 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9b10b204-bd8e-4cf3-9a8a-4a23a4acce04.31cb9c6b-97fd-4477-adf1-b68cab7ddf43" returned: 0 in 0.452s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:02:40 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-e18ba761-0134-43b0-9c39-c7bc47bb64f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9b10b204-bd8e-4cf3-9a8a-4a23a4acce04.31cb9c6b-97fd-4477-adf1-b68cab7ddf43 is being set with open permissions: ugo+rw Aug 10 16:02:40 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e18ba761-0134-43b0-9c39-c7bc47bb64f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9b10b204-bd8e-4cf3-9a8a-4a23a4acce04.31cb9c6b-97fd-4477-adf1-b68cab7ddf43 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:02:40 devstack sudo[99260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9b10b204-bd8e-4cf3-9a8a-4a23a4acce04.31cb9c6b-97fd-4477-adf1-b68cab7ddf43 Aug 10 16:02:40 devstack sudo[99260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:02:41 devstack sudo[99260]: pam_unix(sudo:session): session closed for user root Aug 10 16:02:41 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e18ba761-0134-43b0-9c39-c7bc47bb64f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9b10b204-bd8e-4cf3-9a8a-4a23a4acce04.31cb9c6b-97fd-4477-adf1-b68cab7ddf43" returned: 0 in 0.301s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:02:41 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e18ba761-0134-43b0-9c39-c7bc47bb64f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9b10b204-bd8e-4cf3-9a8a-4a23a4acce04.info {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:02:41 devstack sudo[99263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9b10b204-bd8e-4cf3-9a8a-4a23a4acce04.info Aug 10 16:02:41 devstack sudo[99263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:02:41 devstack sudo[99263]: pam_unix(sudo:session): session closed for user root Aug 10 16:02:41 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e18ba761-0134-43b0-9c39-c7bc47bb64f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9b10b204-bd8e-4cf3-9a8a-4a23a4acce04.info" returned: 0 in 0.272s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:02:41 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-e18ba761-0134-43b0-9c39-c7bc47bb64f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9b10b204-bd8e-4cf3-9a8a-4a23a4acce04.info is being set with open permissions: ugo+rw Aug 10 16:02:41 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e18ba761-0134-43b0-9c39-c7bc47bb64f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9b10b204-bd8e-4cf3-9a8a-4a23a4acce04.info {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:02:41 devstack sudo[99266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9b10b204-bd8e-4cf3-9a8a-4a23a4acce04.info Aug 10 16:02:41 devstack sudo[99266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:02:41 devstack sudo[99266]: pam_unix(sudo:session): session closed for user root Aug 10 16:02:41 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e18ba761-0134-43b0-9c39-c7bc47bb64f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9b10b204-bd8e-4cf3-9a8a-4a23a4acce04.info" returned: 0 in 0.334s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:02:41 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-e18ba761-0134-43b0-9c39-c7bc47bb64f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.558s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:02:41 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-e18ba761-0134-43b0-9c39-c7bc47bb64f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] Create snapshot completed successfully Aug 10 16:02:43 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-4c2c0313-11c8-48ba-a9c7-3e40a2f85d96 tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] Acquiring lock "cinder-31cb9c6b-97fd-4477-adf1-b68cab7ddf43-delete_snapshot" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:02:43 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-4c2c0313-11c8-48ba-a9c7-3e40a2f85d96 tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] Lock "cinder-31cb9c6b-97fd-4477-adf1-b68cab7ddf43-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:02:43 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-4c2c0313-11c8-48ba-a9c7-3e40a2f85d96 tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] Acquiring lock "cinder-quobyte-9b10b204-bd8e-4cf3-9a8a-4a23a4acce04" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:02:43 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-4c2c0313-11c8-48ba-a9c7-3e40a2f85d96 tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] Lock "cinder-quobyte-9b10b204-bd8e-4cf3-9a8a-4a23a4acce04" acquired by "delete_snapshot" :: waited 0.037s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:02:43 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-4c2c0313-11c8-48ba-a9c7-3e40a2f85d96 tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] Acquiring lock "cinder-quobyte-31cb9c6b-97fd-4477-adf1-b68cab7ddf43" by "_delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:02:43 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-8cac74fe-1da9-4259-8290-dc594b15da27 req-113f049f-274c-4a42-afca-ce0ba6d4b1df tempest-TestInstancesWithCinderVolumes-1565760524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:02:43 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-8cac74fe-1da9-4259-8290-dc594b15da27 req-113f049f-274c-4a42-afca-ce0ba6d4b1df tempest-TestInstancesWithCinderVolumes-1565760524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:02:43 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-4c2c0313-11c8-48ba-a9c7-3e40a2f85d96 tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] Lock "cinder-quobyte-31cb9c6b-97fd-4477-adf1-b68cab7ddf43" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:02:43 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-4c2c0313-11c8-48ba-a9c7-3e40a2f85d96 tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] Deleting offline snapshot 31cb9c6b-97fd-4477-adf1-b68cab7ddf43 of volume 9b10b204-bd8e-4cf3-9a8a-4a23a4acce04 {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 16:02:43 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-4c2c0313-11c8-48ba-a9c7-3e40a2f85d96 tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] snapshot_file for this snap is: volume-9b10b204-bd8e-4cf3-9a8a-4a23a4acce04.31cb9c6b-97fd-4477-adf1-b68cab7ddf43 {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 16:02:43 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-8cac74fe-1da9-4259-8290-dc594b15da27 req-113f049f-274c-4a42-afca-ce0ba6d4b1df tempest-TestInstancesWithCinderVolumes-1565760524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.100s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:02:43 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b951de6-3651-4ea6-9526-d351d9b4e468]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:02:43 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4c2c0313-11c8-48ba-a9c7-3e40a2f85d96 tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9b10b204-bd8e-4cf3-9a8a-4a23a4acce04.31cb9c6b-97fd-4477-adf1-b68cab7ddf43 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:02:43 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [req-8cac74fe-1da9-4259-8290-dc594b15da27 req-113f049f-274c-4a42-afca-ce0ba6d4b1df tempest-TestInstancesWithCinderVolumes-1565760524 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc', 'name': 'volume-747d5a1a-3ea0-4b60-985b-7355a3fa56d9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dfc4c3a4-8153-4f5f-9c19-1d150ab343e0', 'enforce_multipath': True} {{(pid=88641) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 10 16:02:43 devstack cinder-volume[88641]: INFO cinder.volume.manager [req-8cac74fe-1da9-4259-8290-dc594b15da27 req-113f049f-274c-4a42-afca-ce0ba6d4b1df tempest-TestInstancesWithCinderVolumes-1565760524 None] attachment_update completed successfully. Aug 10 16:02:43 devstack sudo[99303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9b10b204-bd8e-4cf3-9a8a-4a23a4acce04.31cb9c6b-97fd-4477-adf1-b68cab7ddf43 Aug 10 16:02:43 devstack sudo[99303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:02:44 devstack sudo[99303]: pam_unix(sudo:session): session closed for user root Aug 10 16:02:44 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4c2c0313-11c8-48ba-a9c7-3e40a2f85d96 tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9b10b204-bd8e-4cf3-9a8a-4a23a4acce04.31cb9c6b-97fd-4477-adf1-b68cab7ddf43" returned: 0 in 0.765s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:02:44 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-4c2c0313-11c8-48ba-a9c7-3e40a2f85d96 tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b10b204-bd8e-4cf3-9a8a-4a23a4acce04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 16:02:44 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[f57d5308-ff1c-4e32-a558-48be08254b88]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:02:44 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4c2c0313-11c8-48ba-a9c7-3e40a2f85d96 tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9b10b204-bd8e-4cf3-9a8a-4a23a4acce04 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:02:44 devstack sudo[99326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9b10b204-bd8e-4cf3-9a8a-4a23a4acce04 Aug 10 16:02:44 devstack sudo[99326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:02:44 devstack sudo[99326]: pam_unix(sudo:session): session closed for user root Aug 10 16:02:44 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4c2c0313-11c8-48ba-a9c7-3e40a2f85d96 tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9b10b204-bd8e-4cf3-9a8a-4a23a4acce04" returned: 0 in 0.794s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:02:44 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4c2c0313-11c8-48ba-a9c7-3e40a2f85d96 tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9b10b204-bd8e-4cf3-9a8a-4a23a4acce04.31cb9c6b-97fd-4477-adf1-b68cab7ddf43 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:02:44 devstack sudo[99370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9b10b204-bd8e-4cf3-9a8a-4a23a4acce04.31cb9c6b-97fd-4477-adf1-b68cab7ddf43 Aug 10 16:02:44 devstack sudo[99370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:02:45 devstack sudo[99370]: pam_unix(sudo:session): session closed for user root Aug 10 16:02:45 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4c2c0313-11c8-48ba-a9c7-3e40a2f85d96 tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9b10b204-bd8e-4cf3-9a8a-4a23a4acce04.31cb9c6b-97fd-4477-adf1-b68cab7ddf43" returned: 0 in 0.590s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:02:45 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4c2c0313-11c8-48ba-a9c7-3e40a2f85d96 tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9b10b204-bd8e-4cf3-9a8a-4a23a4acce04.31cb9c6b-97fd-4477-adf1-b68cab7ddf43 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:02:45 devstack sudo[99394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9b10b204-bd8e-4cf3-9a8a-4a23a4acce04.31cb9c6b-97fd-4477-adf1-b68cab7ddf43 Aug 10 16:02:45 devstack sudo[99394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:02:45 devstack sudo[99394]: pam_unix(sudo:session): session closed for user root Aug 10 16:02:45 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4c2c0313-11c8-48ba-a9c7-3e40a2f85d96 tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9b10b204-bd8e-4cf3-9a8a-4a23a4acce04.31cb9c6b-97fd-4477-adf1-b68cab7ddf43" returned: 0 in 0.349s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:02:45 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-4c2c0313-11c8-48ba-a9c7-3e40a2f85d96 tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] Lock "cinder-quobyte-31cb9c6b-97fd-4477-adf1-b68cab7ddf43" released by "_delete_snapshot" :: held 2.677s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:02:45 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-4c2c0313-11c8-48ba-a9c7-3e40a2f85d96 tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] Lock "cinder-quobyte-9b10b204-bd8e-4cf3-9a8a-4a23a4acce04" released by "delete_snapshot" :: held 2.728s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:02:46 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-4c2c0313-11c8-48ba-a9c7-3e40a2f85d96 tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] Created reservations ['45d89c79-9940-40cd-af77-33a0048acafa', '43d977c9-9b2c-4530-b97e-cb6c3af6740b', '98882e23-821c-4b7d-af00-3299e1987c22', 'c4a76840-8407-40cf-85ee-d6206ad1885f'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:02:46 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-4c2c0313-11c8-48ba-a9c7-3e40a2f85d96 tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] Delete snapshot completed successfully. Aug 10 16:02:46 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-4c2c0313-11c8-48ba-a9c7-3e40a2f85d96 tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] Lock "cinder-31cb9c6b-97fd-4477-adf1-b68cab7ddf43-delete_snapshot" released by "delete_snapshot" :: held 2.954s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:02:46 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-69710b22-a11a-41e6-94b9-bf95569f2b00 tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] Acquiring lock "cinder-9b10b204-bd8e-4cf3-9a8a-4a23a4acce04-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:02:46 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-69710b22-a11a-41e6-94b9-bf95569f2b00 tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] Lock "cinder-9b10b204-bd8e-4cf3-9a8a-4a23a4acce04-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:02:46 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-69710b22-a11a-41e6-94b9-bf95569f2b00 tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] Acquiring lock "cinder-quobyte-9b10b204-bd8e-4cf3-9a8a-4a23a4acce04" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:02:46 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-69710b22-a11a-41e6-94b9-bf95569f2b00 tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] Lock "cinder-quobyte-9b10b204-bd8e-4cf3-9a8a-4a23a4acce04" acquired by "delete_volume" :: waited 0.031s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:02:46 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[cacd121a-e007-4ec2-9c77-2b6e2bf1c4a2]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:02:46 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-69710b22-a11a-41e6-94b9-bf95569f2b00 tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9b10b204-bd8e-4cf3-9a8a-4a23a4acce04 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:02:46 devstack sudo[99429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9b10b204-bd8e-4cf3-9a8a-4a23a4acce04 Aug 10 16:02:46 devstack sudo[99429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:02:47 devstack sudo[99429]: pam_unix(sudo:session): session closed for user root Aug 10 16:02:47 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-69710b22-a11a-41e6-94b9-bf95569f2b00 tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9b10b204-bd8e-4cf3-9a8a-4a23a4acce04" returned: 0 in 0.610s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:02:47 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-69710b22-a11a-41e6-94b9-bf95569f2b00 tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9b10b204-bd8e-4cf3-9a8a-4a23a4acce04 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:02:47 devstack sudo[99439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9b10b204-bd8e-4cf3-9a8a-4a23a4acce04 Aug 10 16:02:47 devstack sudo[99439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:02:47 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-d2eb72d4-62e9-4c59-991e-ba6e0ead32db req-36de289f-7750-40c7-a2a8-6d94cb3c202e tempest-TestInstancesWithCinderVolumes-1565760524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:02:47 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-d2eb72d4-62e9-4c59-991e-ba6e0ead32db req-36de289f-7750-40c7-a2a8-6d94cb3c202e tempest-TestInstancesWithCinderVolumes-1565760524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:02:47 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-d2eb72d4-62e9-4c59-991e-ba6e0ead32db req-36de289f-7750-40c7-a2a8-6d94cb3c202e tempest-TestInstancesWithCinderVolumes-1565760524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:02:47 devstack sudo[99439]: pam_unix(sudo:session): session closed for user root Aug 10 16:02:48 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-69710b22-a11a-41e6-94b9-bf95569f2b00 tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9b10b204-bd8e-4cf3-9a8a-4a23a4acce04" returned: 0 in 0.633s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:02:48 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-69710b22-a11a-41e6-94b9-bf95569f2b00 tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] Lock "cinder-quobyte-9b10b204-bd8e-4cf3-9a8a-4a23a4acce04" released by "delete_volume" :: held 1.376s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:02:48 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [req-d2eb72d4-62e9-4c59-991e-ba6e0ead32db req-36de289f-7750-40c7-a2a8-6d94cb3c202e tempest-TestInstancesWithCinderVolumes-1565760524 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc', 'name': 'volume-0a0bed7f-488d-422c-8637-0ec030277f91', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd599f8d7-2672-4fe3-ac58-cc5045c332a4', 'enforce_multipath': True} {{(pid=88641) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 10 16:02:48 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-69710b22-a11a-41e6-94b9-bf95569f2b00 tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] Created reservations ['c5c64395-838b-40e5-8482-f981bd732088', '54a60734-d095-4079-8ce1-290a9d10f721', '3340e24f-bbfe-463f-ab10-a81089957a22', '09f5b3ca-8ba1-4ca3-b2c9-eccb0b9f266b'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:02:48 devstack cinder-volume[88641]: INFO cinder.volume.manager [req-d2eb72d4-62e9-4c59-991e-ba6e0ead32db req-36de289f-7750-40c7-a2a8-6d94cb3c202e tempest-TestInstancesWithCinderVolumes-1565760524 None] attachment_update completed successfully. Aug 10 16:02:48 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-69710b22-a11a-41e6-94b9-bf95569f2b00 tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:02:48 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-69710b22-a11a-41e6-94b9-bf95569f2b00 tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:02:48 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-69710b22-a11a-41e6-94b9-bf95569f2b00 tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:02:48 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-69710b22-a11a-41e6-94b9-bf95569f2b00 tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:02:48 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-69710b22-a11a-41e6-94b9-bf95569f2b00 tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:02:48 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-69710b22-a11a-41e6-94b9-bf95569f2b00 tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:02:48 devstack sudo[99451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:02:48 devstack sudo[99451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:02:48 devstack sudo[99451]: pam_unix(sudo:session): session closed for user root Aug 10 16:02:48 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-69710b22-a11a-41e6-94b9-bf95569f2b00 tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.405s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:02:48 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-69710b22-a11a-41e6-94b9-bf95569f2b00 tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:02:48 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-69710b22-a11a-41e6-94b9-bf95569f2b00 tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] Deleted volume successfully. Aug 10 16:02:48 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-69710b22-a11a-41e6-94b9-bf95569f2b00 tempest-VolumeSnapshotQuotasNegativeTestJSON-954085857 None] Lock "cinder-9b10b204-bd8e-4cf3-9a8a-4a23a4acce04-delete_volume" released by "delete_volume" :: held 2.229s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:02:55 devstack cinder-volume[88641]: DEBUG dbcounter [-] [88641] Writing DB stats cinder:UPDATE=137,cinder:SELECT=118,cinder:INSERT=34,cinder:DELETE=9 {{(pid=88641) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 16:02:55 devstack cinder-volume[88641]: DEBUG dbcounter [-] [88641] Writing DB stats cinder:SELECT=149,cinder:INSERT=36,cinder:UPDATE=132,cinder:DELETE=8 {{(pid=88641) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 16:02:55 devstack cinder-volume[88641]: INFO cinder.volume.manager [req-b384c78e-f1f0-47cf-9e79-deaa8a93d31c req-64506c26-16c0-436a-9690-2072847408c0 tempest-TestInstancesWithCinderVolumes-1565760524 None] Terminate volume connection completed successfully. Aug 10 16:02:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [req-b384c78e-f1f0-47cf-9e79-deaa8a93d31c req-64506c26-16c0-436a-9690-2072847408c0 tempest-TestInstancesWithCinderVolumes-1565760524 None] Deleting attachment dfc4c3a4-8153-4f5f-9c19-1d150ab343e0. {{(pid=88641) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 10 16:02:55 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-b79fbe47-2638-420a-b289-4aea0d23d8f1 tempest-TestInstancesWithCinderVolumes-1565760524 None] Acquiring lock "cinder-747d5a1a-3ea0-4b60-985b-7355a3fa56d9-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:02:55 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-b79fbe47-2638-420a-b289-4aea0d23d8f1 tempest-TestInstancesWithCinderVolumes-1565760524 None] Lock "cinder-747d5a1a-3ea0-4b60-985b-7355a3fa56d9-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:02:55 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-b79fbe47-2638-420a-b289-4aea0d23d8f1 tempest-TestInstancesWithCinderVolumes-1565760524 None] Acquiring lock "cinder-quobyte-747d5a1a-3ea0-4b60-985b-7355a3fa56d9" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:02:55 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-b79fbe47-2638-420a-b289-4aea0d23d8f1 tempest-TestInstancesWithCinderVolumes-1565760524 None] Lock "cinder-quobyte-747d5a1a-3ea0-4b60-985b-7355a3fa56d9" acquired by "delete_volume" :: waited 0.026s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:02:55 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae86be80-f823-44aa-8f99-4e2690bee70e]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:02:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b79fbe47-2638-420a-b289-4aea0d23d8f1 tempest-TestInstancesWithCinderVolumes-1565760524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-747d5a1a-3ea0-4b60-985b-7355a3fa56d9 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:02:56 devstack sudo[99538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-747d5a1a-3ea0-4b60-985b-7355a3fa56d9 Aug 10 16:02:56 devstack sudo[99538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:02:56 devstack sudo[99538]: pam_unix(sudo:session): session closed for user root Aug 10 16:02:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b79fbe47-2638-420a-b289-4aea0d23d8f1 tempest-TestInstancesWithCinderVolumes-1565760524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-747d5a1a-3ea0-4b60-985b-7355a3fa56d9" returned: 0 in 0.680s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:02:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b79fbe47-2638-420a-b289-4aea0d23d8f1 tempest-TestInstancesWithCinderVolumes-1565760524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-747d5a1a-3ea0-4b60-985b-7355a3fa56d9 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:02:56 devstack sudo[99544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-747d5a1a-3ea0-4b60-985b-7355a3fa56d9 Aug 10 16:02:56 devstack sudo[99544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:02:56 devstack sudo[99544]: pam_unix(sudo:session): session closed for user root Aug 10 16:02:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b79fbe47-2638-420a-b289-4aea0d23d8f1 tempest-TestInstancesWithCinderVolumes-1565760524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-747d5a1a-3ea0-4b60-985b-7355a3fa56d9" returned: 0 in 0.417s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:02:56 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-b79fbe47-2638-420a-b289-4aea0d23d8f1 tempest-TestInstancesWithCinderVolumes-1565760524 None] Lock "cinder-quobyte-747d5a1a-3ea0-4b60-985b-7355a3fa56d9" released by "delete_volume" :: held 1.163s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:02:56 devstack cinder-volume[88641]: WARNING cinder.quota [None req-b79fbe47-2638-420a-b289-4aea0d23d8f1 tempest-TestInstancesWithCinderVolumes-1565760524 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-419709294-2004836192 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-419709294-2004836192, it is now deprecated. Please use the default quota class for default quota. Aug 10 16:02:56 devstack cinder-volume[88641]: WARNING cinder.quota [None req-b79fbe47-2638-420a-b289-4aea0d23d8f1 tempest-TestInstancesWithCinderVolumes-1565760524 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-419709294-2004836192 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-419709294-2004836192, it is now deprecated. Please use the default quota class for default quota. Aug 10 16:02:57 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-b79fbe47-2638-420a-b289-4aea0d23d8f1 tempest-TestInstancesWithCinderVolumes-1565760524 None] Created reservations ['7581ee15-8d00-4227-84d3-65d32716163f', '9221f393-9a86-43f1-8101-197e4a847fb0', 'bb265b96-c3d1-477d-9898-4fc9a753ce33', '9cfc644f-26e2-43b6-88ad-d3d4b61aa52f'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:02:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-b79fbe47-2638-420a-b289-4aea0d23d8f1 tempest-TestInstancesWithCinderVolumes-1565760524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:02:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-b79fbe47-2638-420a-b289-4aea0d23d8f1 tempest-TestInstancesWithCinderVolumes-1565760524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:02:57 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-b79fbe47-2638-420a-b289-4aea0d23d8f1 tempest-TestInstancesWithCinderVolumes-1565760524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:02:57 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-b79fbe47-2638-420a-b289-4aea0d23d8f1 tempest-TestInstancesWithCinderVolumes-1565760524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:02:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-b79fbe47-2638-420a-b289-4aea0d23d8f1 tempest-TestInstancesWithCinderVolumes-1565760524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:02:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b79fbe47-2638-420a-b289-4aea0d23d8f1 tempest-TestInstancesWithCinderVolumes-1565760524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:02:57 devstack sudo[99547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:02:57 devstack sudo[99547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:02:57 devstack sudo[99547]: pam_unix(sudo:session): session closed for user root Aug 10 16:02:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b79fbe47-2638-420a-b289-4aea0d23d8f1 tempest-TestInstancesWithCinderVolumes-1565760524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.572s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:02:57 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-b79fbe47-2638-420a-b289-4aea0d23d8f1 tempest-TestInstancesWithCinderVolumes-1565760524 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:02:57 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-b79fbe47-2638-420a-b289-4aea0d23d8f1 tempest-TestInstancesWithCinderVolumes-1565760524 None] Deleted volume successfully. Aug 10 16:02:57 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-b79fbe47-2638-420a-b289-4aea0d23d8f1 tempest-TestInstancesWithCinderVolumes-1565760524 None] Lock "cinder-747d5a1a-3ea0-4b60-985b-7355a3fa56d9-delete_volume" released by "delete_volume" :: held 2.109s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:03:01 devstack cinder-volume[88641]: INFO cinder.volume.manager [req-62f72e46-83ec-46a3-902c-80e57984ff67 req-ed5c0538-d861-405e-af21-0fc433480d2a tempest-TestInstancesWithCinderVolumes-1565760524 None] Terminate volume connection completed successfully. Aug 10 16:03:01 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [req-62f72e46-83ec-46a3-902c-80e57984ff67 req-ed5c0538-d861-405e-af21-0fc433480d2a tempest-TestInstancesWithCinderVolumes-1565760524 None] Deleting attachment d599f8d7-2672-4fe3-ac58-cc5045c332a4. {{(pid=88641) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 10 16:03:01 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-32d32448-cabd-4469-a723-221fc111184e tempest-TestInstancesWithCinderVolumes-1565760524 None] Acquiring lock "cinder-0a0bed7f-488d-422c-8637-0ec030277f91-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:03:01 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-32d32448-cabd-4469-a723-221fc111184e tempest-TestInstancesWithCinderVolumes-1565760524 None] Lock "cinder-0a0bed7f-488d-422c-8637-0ec030277f91-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:03:01 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-32d32448-cabd-4469-a723-221fc111184e tempest-TestInstancesWithCinderVolumes-1565760524 None] Acquiring lock "cinder-quobyte-0a0bed7f-488d-422c-8637-0ec030277f91" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:03:01 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-32d32448-cabd-4469-a723-221fc111184e tempest-TestInstancesWithCinderVolumes-1565760524 None] Lock "cinder-quobyte-0a0bed7f-488d-422c-8637-0ec030277f91" acquired by "delete_volume" :: waited 0.016s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:03:01 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[22740227-43c6-4bd1-8d71-ce3f42e13c45]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:03:01 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-32d32448-cabd-4469-a723-221fc111184e tempest-TestInstancesWithCinderVolumes-1565760524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-0a0bed7f-488d-422c-8637-0ec030277f91 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:03:01 devstack sudo[99577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-0a0bed7f-488d-422c-8637-0ec030277f91 Aug 10 16:03:01 devstack sudo[99577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:03:02 devstack sudo[99577]: pam_unix(sudo:session): session closed for user root Aug 10 16:03:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-32d32448-cabd-4469-a723-221fc111184e tempest-TestInstancesWithCinderVolumes-1565760524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-0a0bed7f-488d-422c-8637-0ec030277f91" returned: 0 in 0.542s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:03:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-32d32448-cabd-4469-a723-221fc111184e tempest-TestInstancesWithCinderVolumes-1565760524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-0a0bed7f-488d-422c-8637-0ec030277f91 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:03:02 devstack sudo[99584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-0a0bed7f-488d-422c-8637-0ec030277f91 Aug 10 16:03:02 devstack sudo[99584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:03:02 devstack sudo[99584]: pam_unix(sudo:session): session closed for user root Aug 10 16:03:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-32d32448-cabd-4469-a723-221fc111184e tempest-TestInstancesWithCinderVolumes-1565760524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-0a0bed7f-488d-422c-8637-0ec030277f91" returned: 0 in 0.354s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:03:02 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-32d32448-cabd-4469-a723-221fc111184e tempest-TestInstancesWithCinderVolumes-1565760524 None] Lock "cinder-quobyte-0a0bed7f-488d-422c-8637-0ec030277f91" released by "delete_volume" :: held 0.963s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:03:02 devstack cinder-volume[88641]: WARNING cinder.quota [None req-32d32448-cabd-4469-a723-221fc111184e tempest-TestInstancesWithCinderVolumes-1565760524 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-71964195-136848291 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-71964195-136848291, it is now deprecated. Please use the default quota class for default quota. Aug 10 16:03:02 devstack cinder-volume[88641]: WARNING cinder.quota [None req-32d32448-cabd-4469-a723-221fc111184e tempest-TestInstancesWithCinderVolumes-1565760524 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-71964195-136848291 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-71964195-136848291, it is now deprecated. Please use the default quota class for default quota. Aug 10 16:03:02 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-32d32448-cabd-4469-a723-221fc111184e tempest-TestInstancesWithCinderVolumes-1565760524 None] Created reservations ['a372ed88-8e2a-4c97-ad47-748dadbaffa0', '990be2de-9af6-40d5-9e5b-ba7daacaa37a', '13b3dcbb-093b-4eb6-8743-05701982c881', '7aee1d85-2cff-4182-8018-43a4def896b9'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:03:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-32d32448-cabd-4469-a723-221fc111184e tempest-TestInstancesWithCinderVolumes-1565760524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:03:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-32d32448-cabd-4469-a723-221fc111184e tempest-TestInstancesWithCinderVolumes-1565760524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:03:02 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-32d32448-cabd-4469-a723-221fc111184e tempest-TestInstancesWithCinderVolumes-1565760524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:03:02 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-32d32448-cabd-4469-a723-221fc111184e tempest-TestInstancesWithCinderVolumes-1565760524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:03:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-32d32448-cabd-4469-a723-221fc111184e tempest-TestInstancesWithCinderVolumes-1565760524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:03:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-32d32448-cabd-4469-a723-221fc111184e tempest-TestInstancesWithCinderVolumes-1565760524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:03:02 devstack sudo[99587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:03:02 devstack sudo[99587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:03:03 devstack sudo[99587]: pam_unix(sudo:session): session closed for user root Aug 10 16:03:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-32d32448-cabd-4469-a723-221fc111184e tempest-TestInstancesWithCinderVolumes-1565760524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.381s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:03:03 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-32d32448-cabd-4469-a723-221fc111184e tempest-TestInstancesWithCinderVolumes-1565760524 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:03:03 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-32d32448-cabd-4469-a723-221fc111184e tempest-TestInstancesWithCinderVolumes-1565760524 None] Deleted volume successfully. Aug 10 16:03:03 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-32d32448-cabd-4469-a723-221fc111184e tempest-TestInstancesWithCinderVolumes-1565760524 None] Lock "cinder-0a0bed7f-488d-422c-8637-0ec030277f91-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:03:03 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-efce1db7-5b94-41b2-9f22-7462ceb0dc13 tempest-SnapshotMetadataTestJSON-1815515952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:03:03 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-efce1db7-5b94-41b2-9f22-7462ceb0dc13 tempest-SnapshotMetadataTestJSON-1815515952 None] Flow 'volume_create_manager' (0bdcd3c7-16ac-447a-8c94-ad207f5615c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:03:03 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-efce1db7-5b94-41b2-9f22-7462ceb0dc13 tempest-SnapshotMetadataTestJSON-1815515952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fb363c4-c600-4454-acee-7f803c33ad5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:03:03 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-efce1db7-5b94-41b2-9f22-7462ceb0dc13 tempest-SnapshotMetadataTestJSON-1815515952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fb363c4-c600-4454-acee-7f803c33ad5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:03:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-506844268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c821be47-311a-46b9-b361-832e4af5f3f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71515bb67d6148248f2490539163d621',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:03:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:03:03Z,use_quota=True,user_id='47de7a3e05124b03a207285ab07f599f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:03:03 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-efce1db7-5b94-41b2-9f22-7462ceb0dc13 tempest-SnapshotMetadataTestJSON-1815515952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39bfa221-991e-450d-9368-5988ec849226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:03:03 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-efce1db7-5b94-41b2-9f22-7462ceb0dc13 tempest-SnapshotMetadataTestJSON-1815515952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39bfa221-991e-450d-9368-5988ec849226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:03:03 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-efce1db7-5b94-41b2-9f22-7462ceb0dc13 tempest-SnapshotMetadataTestJSON-1815515952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8ca84a6-112c-41b7-b7a0-3cf7199db411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:03:03 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-efce1db7-5b94-41b2-9f22-7462ceb0dc13 tempest-SnapshotMetadataTestJSON-1815515952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8ca84a6-112c-41b7-b7a0-3cf7199db411) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c821be47-311a-46b9-b361-832e4af5f3f2', 'volume_name': 'volume-c821be47-311a-46b9-b361-832e4af5f3f2', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:03:03 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-efce1db7-5b94-41b2-9f22-7462ceb0dc13 tempest-SnapshotMetadataTestJSON-1815515952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (383a58e1-6476-40df-806d-3e0ae69bb94d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:03:03 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-efce1db7-5b94-41b2-9f22-7462ceb0dc13 tempest-SnapshotMetadataTestJSON-1815515952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (383a58e1-6476-40df-806d-3e0ae69bb94d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:03:03 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-efce1db7-5b94-41b2-9f22-7462ceb0dc13 tempest-SnapshotMetadataTestJSON-1815515952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cabc8249-2c5d-4340-9242-c5e9aad41629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:03:03 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-efce1db7-5b94-41b2-9f22-7462ceb0dc13 tempest-SnapshotMetadataTestJSON-1815515952 None] Volume c821be47-311a-46b9-b361-832e4af5f3f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c821be47-311a-46b9-b361-832e4af5f3f2', 'volume_size': 1} Aug 10 16:03:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-efce1db7-5b94-41b2-9f22-7462ceb0dc13 tempest-SnapshotMetadataTestJSON-1815515952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:03:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-efce1db7-5b94-41b2-9f22-7462ceb0dc13 tempest-SnapshotMetadataTestJSON-1815515952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:03:03 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-efce1db7-5b94-41b2-9f22-7462ceb0dc13 tempest-SnapshotMetadataTestJSON-1815515952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:03:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-506844268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c821be47-311a-46b9-b361-832e4af5f3f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71515bb67d6148248f2490539163d621',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:03:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:03:03Z,use_quota=True,user_id='47de7a3e05124b03a207285ab07f599f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:03:03 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-efce1db7-5b94-41b2-9f22-7462ceb0dc13 tempest-SnapshotMetadataTestJSON-1815515952 None] Creating volume c821be47-311a-46b9-b361-832e4af5f3f2 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:03:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-efce1db7-5b94-41b2-9f22-7462ceb0dc13 tempest-SnapshotMetadataTestJSON-1815515952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:03:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-efce1db7-5b94-41b2-9f22-7462ceb0dc13 tempest-SnapshotMetadataTestJSON-1815515952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:03:03 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-efce1db7-5b94-41b2-9f22-7462ceb0dc13 tempest-SnapshotMetadataTestJSON-1815515952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:03:03 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-efce1db7-5b94-41b2-9f22-7462ceb0dc13 tempest-SnapshotMetadataTestJSON-1815515952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:03:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-efce1db7-5b94-41b2-9f22-7462ceb0dc13 tempest-SnapshotMetadataTestJSON-1815515952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:03:03 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-efce1db7-5b94-41b2-9f22-7462ceb0dc13 tempest-SnapshotMetadataTestJSON-1815515952 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:03:03 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-efce1db7-5b94-41b2-9f22-7462ceb0dc13 tempest-SnapshotMetadataTestJSON-1815515952 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:03:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-efce1db7-5b94-41b2-9f22-7462ceb0dc13 tempest-SnapshotMetadataTestJSON-1815515952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c821be47-311a-46b9-b361-832e4af5f3f2 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:03:03 devstack sudo[99591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c821be47-311a-46b9-b361-832e4af5f3f2 1073741824 Aug 10 16:03:03 devstack sudo[99591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:03:04 devstack sudo[99591]: pam_unix(sudo:session): session closed for user root Aug 10 16:03:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-efce1db7-5b94-41b2-9f22-7462ceb0dc13 tempest-SnapshotMetadataTestJSON-1815515952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c821be47-311a-46b9-b361-832e4af5f3f2 1073741824" returned: 0 in 0.543s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:03:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-efce1db7-5b94-41b2-9f22-7462ceb0dc13 tempest-SnapshotMetadataTestJSON-1815515952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c821be47-311a-46b9-b361-832e4af5f3f2 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:03:04 devstack sudo[99597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c821be47-311a-46b9-b361-832e4af5f3f2 Aug 10 16:03:04 devstack sudo[99597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:03:04 devstack sudo[99597]: pam_unix(sudo:session): session closed for user root Aug 10 16:03:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-efce1db7-5b94-41b2-9f22-7462ceb0dc13 tempest-SnapshotMetadataTestJSON-1815515952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c821be47-311a-46b9-b361-832e4af5f3f2" returned: 0 in 0.316s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:03:04 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-efce1db7-5b94-41b2-9f22-7462ceb0dc13 tempest-SnapshotMetadataTestJSON-1815515952 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:03:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-efce1db7-5b94-41b2-9f22-7462ceb0dc13 tempest-SnapshotMetadataTestJSON-1815515952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:03:04 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-efce1db7-5b94-41b2-9f22-7462ceb0dc13 tempest-SnapshotMetadataTestJSON-1815515952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cabc8249-2c5d-4340-9242-c5e9aad41629) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c821be47-311a-46b9-b361-832e4af5f3f2', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:03:04 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-efce1db7-5b94-41b2-9f22-7462ceb0dc13 tempest-SnapshotMetadataTestJSON-1815515952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1adcb6fb-4902-4e64-8927-4b74c3d1b20d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:03:04 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-efce1db7-5b94-41b2-9f22-7462ceb0dc13 tempest-SnapshotMetadataTestJSON-1815515952 None] Volume volume-c821be47-311a-46b9-b361-832e4af5f3f2 (c821be47-311a-46b9-b361-832e4af5f3f2): created successfully Aug 10 16:03:04 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-efce1db7-5b94-41b2-9f22-7462ceb0dc13 tempest-SnapshotMetadataTestJSON-1815515952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1adcb6fb-4902-4e64-8927-4b74c3d1b20d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:03:04 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-efce1db7-5b94-41b2-9f22-7462ceb0dc13 tempest-SnapshotMetadataTestJSON-1815515952 None] Flow 'volume_create_manager' (0bdcd3c7-16ac-447a-8c94-ad207f5615c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:03:04 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-efce1db7-5b94-41b2-9f22-7462ceb0dc13 tempest-SnapshotMetadataTestJSON-1815515952 None] Created volume successfully. Aug 10 16:03:06 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-d7cfebdc-951c-44d8-bf74-261fd0065d0b tempest-SnapshotMetadataTestJSON-1815515952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:03:06 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-d7cfebdc-951c-44d8-bf74-261fd0065d0b tempest-SnapshotMetadataTestJSON-1815515952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:03:06 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-d7cfebdc-951c-44d8-bf74-261fd0065d0b tempest-SnapshotMetadataTestJSON-1815515952 None] Creating offline snapshot 1a5bfd01-7a3d-4261-a16b-a9e395394b98 of volume c821be47-311a-46b9-b361-832e4af5f3f2 {{(pid=88641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 16:03:06 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[be3da461-257e-48e0-8d8d-8dcfe9a3589a]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:03:06 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d7cfebdc-951c-44d8-bf74-261fd0065d0b tempest-SnapshotMetadataTestJSON-1815515952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c821be47-311a-46b9-b361-832e4af5f3f2 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:03:06 devstack sudo[99631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c821be47-311a-46b9-b361-832e4af5f3f2 Aug 10 16:03:06 devstack sudo[99631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:03:06 devstack cinder-volume[88641]: INFO cinder.volume.manager [req-396e3a7d-2e09-48f4-aa2f-c616539a1664 req-44773fc6-f792-4ada-9ec9-4d584caaef56 tempest-TestInstancesWithCinderVolumes-1565760524 None] Terminate volume connection completed successfully. Aug 10 16:03:06 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [req-396e3a7d-2e09-48f4-aa2f-c616539a1664 req-44773fc6-f792-4ada-9ec9-4d584caaef56 tempest-TestInstancesWithCinderVolumes-1565760524 None] Deleting attachment 1bf4c195-a554-4bc1-9171-c56ef5fbd62a. {{(pid=88641) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 10 16:03:06 devstack sudo[99631]: pam_unix(sudo:session): session closed for user root Aug 10 16:03:06 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d7cfebdc-951c-44d8-bf74-261fd0065d0b tempest-SnapshotMetadataTestJSON-1815515952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c821be47-311a-46b9-b361-832e4af5f3f2" returned: 0 in 0.598s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:03:06 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d7cfebdc-951c-44d8-bf74-261fd0065d0b tempest-SnapshotMetadataTestJSON-1815515952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c821be47-311a-46b9-b361-832e4af5f3f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c821be47-311a-46b9-b361-832e4af5f3f2.1a5bfd01-7a3d-4261-a16b-a9e395394b98 1G {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:03:06 devstack sudo[99637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c821be47-311a-46b9-b361-832e4af5f3f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c821be47-311a-46b9-b361-832e4af5f3f2.1a5bfd01-7a3d-4261-a16b-a9e395394b98 1G Aug 10 16:03:06 devstack sudo[99637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:03:07 devstack sudo[99637]: pam_unix(sudo:session): session closed for user root Aug 10 16:03:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d7cfebdc-951c-44d8-bf74-261fd0065d0b tempest-SnapshotMetadataTestJSON-1815515952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c821be47-311a-46b9-b361-832e4af5f3f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c821be47-311a-46b9-b361-832e4af5f3f2.1a5bfd01-7a3d-4261-a16b-a9e395394b98 1G" returned: 0 in 0.569s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:03:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d7cfebdc-951c-44d8-bf74-261fd0065d0b tempest-SnapshotMetadataTestJSON-1815515952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c821be47-311a-46b9-b361-832e4af5f3f2 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c821be47-311a-46b9-b361-832e4af5f3f2.1a5bfd01-7a3d-4261-a16b-a9e395394b98 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:03:07 devstack sudo[99644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c821be47-311a-46b9-b361-832e4af5f3f2 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c821be47-311a-46b9-b361-832e4af5f3f2.1a5bfd01-7a3d-4261-a16b-a9e395394b98 Aug 10 16:03:07 devstack sudo[99644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:03:07 devstack sudo[99644]: pam_unix(sudo:session): session closed for user root Aug 10 16:03:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d7cfebdc-951c-44d8-bf74-261fd0065d0b tempest-SnapshotMetadataTestJSON-1815515952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c821be47-311a-46b9-b361-832e4af5f3f2 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c821be47-311a-46b9-b361-832e4af5f3f2.1a5bfd01-7a3d-4261-a16b-a9e395394b98" returned: 0 in 0.403s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:03:07 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-d7cfebdc-951c-44d8-bf74-261fd0065d0b tempest-SnapshotMetadataTestJSON-1815515952 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c821be47-311a-46b9-b361-832e4af5f3f2.1a5bfd01-7a3d-4261-a16b-a9e395394b98 is being set with open permissions: ugo+rw Aug 10 16:03:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d7cfebdc-951c-44d8-bf74-261fd0065d0b tempest-SnapshotMetadataTestJSON-1815515952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c821be47-311a-46b9-b361-832e4af5f3f2.1a5bfd01-7a3d-4261-a16b-a9e395394b98 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:03:07 devstack sudo[99649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c821be47-311a-46b9-b361-832e4af5f3f2.1a5bfd01-7a3d-4261-a16b-a9e395394b98 Aug 10 16:03:07 devstack sudo[99649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:03:07 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-74a05a80-176d-4a14-ad49-030670b7b884 tempest-TestInstancesWithCinderVolumes-1565760524 None] Acquiring lock "cinder-a36b2e78-b3cd-4dd3-81dd-0b0d72f07b15-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:03:07 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-74a05a80-176d-4a14-ad49-030670b7b884 tempest-TestInstancesWithCinderVolumes-1565760524 None] Lock "cinder-a36b2e78-b3cd-4dd3-81dd-0b0d72f07b15-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:03:07 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-74a05a80-176d-4a14-ad49-030670b7b884 tempest-TestInstancesWithCinderVolumes-1565760524 None] Acquiring lock "cinder-quobyte-a36b2e78-b3cd-4dd3-81dd-0b0d72f07b15" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:03:08 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-74a05a80-176d-4a14-ad49-030670b7b884 tempest-TestInstancesWithCinderVolumes-1565760524 None] Lock "cinder-quobyte-a36b2e78-b3cd-4dd3-81dd-0b0d72f07b15" acquired by "delete_volume" :: waited 0.024s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:03:08 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c55833-b656-45ca-9a25-1588e83d2e66]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:03:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-74a05a80-176d-4a14-ad49-030670b7b884 tempest-TestInstancesWithCinderVolumes-1565760524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a36b2e78-b3cd-4dd3-81dd-0b0d72f07b15 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:03:08 devstack sudo[99649]: pam_unix(sudo:session): session closed for user root Aug 10 16:03:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d7cfebdc-951c-44d8-bf74-261fd0065d0b tempest-SnapshotMetadataTestJSON-1815515952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c821be47-311a-46b9-b361-832e4af5f3f2.1a5bfd01-7a3d-4261-a16b-a9e395394b98" returned: 0 in 0.430s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:03:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d7cfebdc-951c-44d8-bf74-261fd0065d0b tempest-SnapshotMetadataTestJSON-1815515952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c821be47-311a-46b9-b361-832e4af5f3f2.info {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:03:08 devstack sudo[99653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c821be47-311a-46b9-b361-832e4af5f3f2.info Aug 10 16:03:08 devstack sudo[99653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:03:08 devstack sudo[99652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a36b2e78-b3cd-4dd3-81dd-0b0d72f07b15 Aug 10 16:03:08 devstack sudo[99652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:03:08 devstack sudo[99653]: pam_unix(sudo:session): session closed for user root Aug 10 16:03:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d7cfebdc-951c-44d8-bf74-261fd0065d0b tempest-SnapshotMetadataTestJSON-1815515952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c821be47-311a-46b9-b361-832e4af5f3f2.info" returned: 0 in 0.298s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:03:08 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-d7cfebdc-951c-44d8-bf74-261fd0065d0b tempest-SnapshotMetadataTestJSON-1815515952 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c821be47-311a-46b9-b361-832e4af5f3f2.info is being set with open permissions: ugo+rw Aug 10 16:03:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d7cfebdc-951c-44d8-bf74-261fd0065d0b tempest-SnapshotMetadataTestJSON-1815515952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c821be47-311a-46b9-b361-832e4af5f3f2.info {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:03:08 devstack sudo[99657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c821be47-311a-46b9-b361-832e4af5f3f2.info Aug 10 16:03:08 devstack sudo[99657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:03:08 devstack sudo[99652]: pam_unix(sudo:session): session closed for user root Aug 10 16:03:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-74a05a80-176d-4a14-ad49-030670b7b884 tempest-TestInstancesWithCinderVolumes-1565760524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a36b2e78-b3cd-4dd3-81dd-0b0d72f07b15" returned: 0 in 0.579s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:03:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-74a05a80-176d-4a14-ad49-030670b7b884 tempest-TestInstancesWithCinderVolumes-1565760524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a36b2e78-b3cd-4dd3-81dd-0b0d72f07b15 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:03:08 devstack sudo[99663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a36b2e78-b3cd-4dd3-81dd-0b0d72f07b15 Aug 10 16:03:08 devstack sudo[99663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:03:08 devstack sudo[99657]: pam_unix(sudo:session): session closed for user root Aug 10 16:03:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d7cfebdc-951c-44d8-bf74-261fd0065d0b tempest-SnapshotMetadataTestJSON-1815515952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c821be47-311a-46b9-b361-832e4af5f3f2.info" returned: 0 in 0.283s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:03:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-d7cfebdc-951c-44d8-bf74-261fd0065d0b tempest-SnapshotMetadataTestJSON-1815515952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.716s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:03:08 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-d7cfebdc-951c-44d8-bf74-261fd0065d0b tempest-SnapshotMetadataTestJSON-1815515952 None] Create snapshot completed successfully Aug 10 16:03:08 devstack sudo[99663]: pam_unix(sudo:session): session closed for user root Aug 10 16:03:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-74a05a80-176d-4a14-ad49-030670b7b884 tempest-TestInstancesWithCinderVolumes-1565760524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a36b2e78-b3cd-4dd3-81dd-0b0d72f07b15" returned: 0 in 0.265s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:03:08 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-74a05a80-176d-4a14-ad49-030670b7b884 tempest-TestInstancesWithCinderVolumes-1565760524 None] Lock "cinder-quobyte-a36b2e78-b3cd-4dd3-81dd-0b0d72f07b15" released by "delete_volume" :: held 0.898s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:03:08 devstack cinder-volume[88641]: WARNING cinder.quota [None req-74a05a80-176d-4a14-ad49-030670b7b884 tempest-TestInstancesWithCinderVolumes-1565760524 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1021649711-1579087415 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1021649711-1579087415, it is now deprecated. Please use the default quota class for default quota. Aug 10 16:03:08 devstack cinder-volume[88641]: WARNING cinder.quota [None req-74a05a80-176d-4a14-ad49-030670b7b884 tempest-TestInstancesWithCinderVolumes-1565760524 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1021649711-1579087415 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1021649711-1579087415, it is now deprecated. Please use the default quota class for default quota. Aug 10 16:03:08 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-74a05a80-176d-4a14-ad49-030670b7b884 tempest-TestInstancesWithCinderVolumes-1565760524 None] Created reservations ['d7f278c1-d4f8-44e1-9bc7-6f3936243b27', '25bd0665-6a25-48a5-89b2-a3d46acf50b8', '9bc6c529-b5ee-4613-9509-9a51523d047b', '797795bc-d052-48d4-bebd-2c60db623b39'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:03:09 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-74a05a80-176d-4a14-ad49-030670b7b884 tempest-TestInstancesWithCinderVolumes-1565760524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:03:09 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-74a05a80-176d-4a14-ad49-030670b7b884 tempest-TestInstancesWithCinderVolumes-1565760524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:03:09 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-74a05a80-176d-4a14-ad49-030670b7b884 tempest-TestInstancesWithCinderVolumes-1565760524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:03:09 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-74a05a80-176d-4a14-ad49-030670b7b884 tempest-TestInstancesWithCinderVolumes-1565760524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:03:09 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-74a05a80-176d-4a14-ad49-030670b7b884 tempest-TestInstancesWithCinderVolumes-1565760524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:03:09 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-74a05a80-176d-4a14-ad49-030670b7b884 tempest-TestInstancesWithCinderVolumes-1565760524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:03:09 devstack sudo[99667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:03:09 devstack sudo[99667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:03:09 devstack sudo[99667]: pam_unix(sudo:session): session closed for user root Aug 10 16:03:09 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-74a05a80-176d-4a14-ad49-030670b7b884 tempest-TestInstancesWithCinderVolumes-1565760524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.251s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:03:09 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-74a05a80-176d-4a14-ad49-030670b7b884 tempest-TestInstancesWithCinderVolumes-1565760524 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:03:09 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-74a05a80-176d-4a14-ad49-030670b7b884 tempest-TestInstancesWithCinderVolumes-1565760524 None] Deleted volume successfully. Aug 10 16:03:09 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-74a05a80-176d-4a14-ad49-030670b7b884 tempest-TestInstancesWithCinderVolumes-1565760524 None] Lock "cinder-a36b2e78-b3cd-4dd3-81dd-0b0d72f07b15-delete_volume" released by "delete_volume" :: held 1.439s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:03:10 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-326a84a1-7154-4398-8fc2-cf7af58bf557 tempest-SnapshotMetadataTestJSON-1815515952 None] Acquiring lock "cinder-1a5bfd01-7a3d-4261-a16b-a9e395394b98-delete_snapshot" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:03:10 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-326a84a1-7154-4398-8fc2-cf7af58bf557 tempest-SnapshotMetadataTestJSON-1815515952 None] Lock "cinder-1a5bfd01-7a3d-4261-a16b-a9e395394b98-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:03:10 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-326a84a1-7154-4398-8fc2-cf7af58bf557 tempest-SnapshotMetadataTestJSON-1815515952 None] Acquiring lock "cinder-quobyte-c821be47-311a-46b9-b361-832e4af5f3f2" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:03:10 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-326a84a1-7154-4398-8fc2-cf7af58bf557 tempest-SnapshotMetadataTestJSON-1815515952 None] Lock "cinder-quobyte-c821be47-311a-46b9-b361-832e4af5f3f2" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:03:10 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-326a84a1-7154-4398-8fc2-cf7af58bf557 tempest-SnapshotMetadataTestJSON-1815515952 None] Acquiring lock "cinder-quobyte-1a5bfd01-7a3d-4261-a16b-a9e395394b98" by "_delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:03:10 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-326a84a1-7154-4398-8fc2-cf7af58bf557 tempest-SnapshotMetadataTestJSON-1815515952 None] Lock "cinder-quobyte-1a5bfd01-7a3d-4261-a16b-a9e395394b98" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:03:10 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-326a84a1-7154-4398-8fc2-cf7af58bf557 tempest-SnapshotMetadataTestJSON-1815515952 None] Deleting offline snapshot 1a5bfd01-7a3d-4261-a16b-a9e395394b98 of volume c821be47-311a-46b9-b361-832e4af5f3f2 {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 16:03:10 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-326a84a1-7154-4398-8fc2-cf7af58bf557 tempest-SnapshotMetadataTestJSON-1815515952 None] snapshot_file for this snap is: volume-c821be47-311a-46b9-b361-832e4af5f3f2.1a5bfd01-7a3d-4261-a16b-a9e395394b98 {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 16:03:10 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce8cc80-2700-46a3-8dee-6b165cb83fac]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:03:10 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-326a84a1-7154-4398-8fc2-cf7af58bf557 tempest-SnapshotMetadataTestJSON-1815515952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c821be47-311a-46b9-b361-832e4af5f3f2.1a5bfd01-7a3d-4261-a16b-a9e395394b98 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:03:10 devstack sudo[99675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c821be47-311a-46b9-b361-832e4af5f3f2.1a5bfd01-7a3d-4261-a16b-a9e395394b98 Aug 10 16:03:10 devstack sudo[99675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:03:10 devstack cinder-volume[88641]: INFO cinder.volume.manager [req-de17c00d-7cc7-4ca9-9405-3c2c4f23e047 req-a8c3b450-a835-4d3a-9c2c-88de7ca234eb tempest-AttachVolumeTestJSON-1986652723 None] Terminate volume connection completed successfully. Aug 10 16:03:10 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [req-de17c00d-7cc7-4ca9-9405-3c2c4f23e047 req-a8c3b450-a835-4d3a-9c2c-88de7ca234eb tempest-AttachVolumeTestJSON-1986652723 None] Deleting attachment e820eb4f-936f-4fa1-a6d4-aef90646bef7. {{(pid=88641) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 10 16:03:11 devstack sudo[99675]: pam_unix(sudo:session): session closed for user root Aug 10 16:03:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-326a84a1-7154-4398-8fc2-cf7af58bf557 tempest-SnapshotMetadataTestJSON-1815515952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c821be47-311a-46b9-b361-832e4af5f3f2.1a5bfd01-7a3d-4261-a16b-a9e395394b98" returned: 0 in 0.680s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:03:11 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-326a84a1-7154-4398-8fc2-cf7af58bf557 tempest-SnapshotMetadataTestJSON-1815515952 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c821be47-311a-46b9-b361-832e4af5f3f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 16:03:11 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa2c609-b16c-4498-8b08-9ce40831bc0b]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:03:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-326a84a1-7154-4398-8fc2-cf7af58bf557 tempest-SnapshotMetadataTestJSON-1815515952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c821be47-311a-46b9-b361-832e4af5f3f2 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:03:11 devstack sudo[99683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c821be47-311a-46b9-b361-832e4af5f3f2 Aug 10 16:03:11 devstack sudo[99683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:03:11 devstack sudo[99683]: pam_unix(sudo:session): session closed for user root Aug 10 16:03:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-326a84a1-7154-4398-8fc2-cf7af58bf557 tempest-SnapshotMetadataTestJSON-1815515952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c821be47-311a-46b9-b361-832e4af5f3f2" returned: 0 in 0.619s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:03:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-326a84a1-7154-4398-8fc2-cf7af58bf557 tempest-SnapshotMetadataTestJSON-1815515952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c821be47-311a-46b9-b361-832e4af5f3f2.1a5bfd01-7a3d-4261-a16b-a9e395394b98 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:03:11 devstack sudo[99692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c821be47-311a-46b9-b361-832e4af5f3f2.1a5bfd01-7a3d-4261-a16b-a9e395394b98 Aug 10 16:03:11 devstack sudo[99692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:03:11 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcc22b3d-bb52-4f12-822a-c70184a895d7 tempest-TestImageHashVerification-1876444560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:03:11 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-fcc22b3d-bb52-4f12-822a-c70184a895d7 tempest-TestImageHashVerification-1876444560 None] Flow 'volume_create_manager' (13451224-6923-43a2-a678-58ec669a123d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:03:11 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-fcc22b3d-bb52-4f12-822a-c70184a895d7 tempest-TestImageHashVerification-1876444560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cec41fa6-495f-414f-913c-c8ebef8f76a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:03:11 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-fcc22b3d-bb52-4f12-822a-c70184a895d7 tempest-TestImageHashVerification-1876444560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cec41fa6-495f-414f-913c-c8ebef8f76a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:03:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-774848899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b939ff4-fbd0-453f-9a46-72b96d6df711,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8a79b3e974e4899a88207b973455eba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:03:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:03:12Z,use_quota=True,user_id='2ede4be21c0440a995193fc2dd8a0a07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:03:11 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-fcc22b3d-bb52-4f12-822a-c70184a895d7 tempest-TestImageHashVerification-1876444560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17f56af0-7752-49db-bbbd-248d387d026e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:03:11 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-fcc22b3d-bb52-4f12-822a-c70184a895d7 tempest-TestImageHashVerification-1876444560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17f56af0-7752-49db-bbbd-248d387d026e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:03:11 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-fcc22b3d-bb52-4f12-822a-c70184a895d7 tempest-TestImageHashVerification-1876444560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (206477b1-c086-47c0-9796-b5b0e8668cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:03:11 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-fcc22b3d-bb52-4f12-822a-c70184a895d7 tempest-TestImageHashVerification-1876444560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (206477b1-c086-47c0-9796-b5b0e8668cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b939ff4-fbd0-453f-9a46-72b96d6df711', 'volume_name': 'volume-7b939ff4-fbd0-453f-9a46-72b96d6df711', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:03:11 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-fcc22b3d-bb52-4f12-822a-c70184a895d7 tempest-TestImageHashVerification-1876444560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb70ec2b-b931-44cb-a730-3d9e31ea39d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:03:11 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-fcc22b3d-bb52-4f12-822a-c70184a895d7 tempest-TestImageHashVerification-1876444560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb70ec2b-b931-44cb-a730-3d9e31ea39d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:03:11 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-fcc22b3d-bb52-4f12-822a-c70184a895d7 tempest-TestImageHashVerification-1876444560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d70bee2-c3f1-4f1e-8821-04647897b176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:03:11 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-fcc22b3d-bb52-4f12-822a-c70184a895d7 tempest-TestImageHashVerification-1876444560 None] Volume 7b939ff4-fbd0-453f-9a46-72b96d6df711: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b939ff4-fbd0-453f-9a46-72b96d6df711', 'volume_size': 1} Aug 10 16:03:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-fcc22b3d-bb52-4f12-822a-c70184a895d7 tempest-TestImageHashVerification-1876444560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:03:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-fcc22b3d-bb52-4f12-822a-c70184a895d7 tempest-TestImageHashVerification-1876444560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:03:11 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-fcc22b3d-bb52-4f12-822a-c70184a895d7 tempest-TestImageHashVerification-1876444560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:03:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-774848899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b939ff4-fbd0-453f-9a46-72b96d6df711,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8a79b3e974e4899a88207b973455eba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:03:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:03:12Z,use_quota=True,user_id='2ede4be21c0440a995193fc2dd8a0a07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:03:11 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-fcc22b3d-bb52-4f12-822a-c70184a895d7 tempest-TestImageHashVerification-1876444560 None] Creating volume 7b939ff4-fbd0-453f-9a46-72b96d6df711 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:03:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-fcc22b3d-bb52-4f12-822a-c70184a895d7 tempest-TestImageHashVerification-1876444560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:03:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-fcc22b3d-bb52-4f12-822a-c70184a895d7 tempest-TestImageHashVerification-1876444560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:03:11 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-fcc22b3d-bb52-4f12-822a-c70184a895d7 tempest-TestImageHashVerification-1876444560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:03:11 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-fcc22b3d-bb52-4f12-822a-c70184a895d7 tempest-TestImageHashVerification-1876444560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:03:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-fcc22b3d-bb52-4f12-822a-c70184a895d7 tempest-TestImageHashVerification-1876444560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:03:11 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-fcc22b3d-bb52-4f12-822a-c70184a895d7 tempest-TestImageHashVerification-1876444560 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:03:11 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-fcc22b3d-bb52-4f12-822a-c70184a895d7 tempest-TestImageHashVerification-1876444560 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:03:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fcc22b3d-bb52-4f12-822a-c70184a895d7 tempest-TestImageHashVerification-1876444560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-7b939ff4-fbd0-453f-9a46-72b96d6df711 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:03:11 devstack sudo[99700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-7b939ff4-fbd0-453f-9a46-72b96d6df711 1073741824 Aug 10 16:03:11 devstack sudo[99700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:03:12 devstack sudo[99692]: pam_unix(sudo:session): session closed for user root Aug 10 16:03:12 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-326a84a1-7154-4398-8fc2-cf7af58bf557 tempest-SnapshotMetadataTestJSON-1815515952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c821be47-311a-46b9-b361-832e4af5f3f2.1a5bfd01-7a3d-4261-a16b-a9e395394b98" returned: 0 in 0.411s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:03:12 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-326a84a1-7154-4398-8fc2-cf7af58bf557 tempest-SnapshotMetadataTestJSON-1815515952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c821be47-311a-46b9-b361-832e4af5f3f2.1a5bfd01-7a3d-4261-a16b-a9e395394b98 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:03:12 devstack sudo[99703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c821be47-311a-46b9-b361-832e4af5f3f2.1a5bfd01-7a3d-4261-a16b-a9e395394b98 Aug 10 16:03:12 devstack sudo[99703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:03:12 devstack sudo[99703]: pam_unix(sudo:session): session closed for user root Aug 10 16:03:12 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-326a84a1-7154-4398-8fc2-cf7af58bf557 tempest-SnapshotMetadataTestJSON-1815515952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c821be47-311a-46b9-b361-832e4af5f3f2.1a5bfd01-7a3d-4261-a16b-a9e395394b98" returned: 0 in 0.297s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:03:12 devstack sudo[99700]: pam_unix(sudo:session): session closed for user root Aug 10 16:03:12 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fcc22b3d-bb52-4f12-822a-c70184a895d7 tempest-TestImageHashVerification-1876444560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-7b939ff4-fbd0-453f-9a46-72b96d6df711 1073741824" returned: 0 in 0.492s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:03:12 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-326a84a1-7154-4398-8fc2-cf7af58bf557 tempest-SnapshotMetadataTestJSON-1815515952 None] Lock "cinder-quobyte-1a5bfd01-7a3d-4261-a16b-a9e395394b98" released by "_delete_snapshot" :: held 2.164s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:03:12 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-326a84a1-7154-4398-8fc2-cf7af58bf557 tempest-SnapshotMetadataTestJSON-1815515952 None] Lock "cinder-quobyte-c821be47-311a-46b9-b361-832e4af5f3f2" released by "delete_snapshot" :: held 2.196s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:03:12 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fcc22b3d-bb52-4f12-822a-c70184a895d7 tempest-TestImageHashVerification-1876444560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-7b939ff4-fbd0-453f-9a46-72b96d6df711 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:03:12 devstack sudo[99710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-7b939ff4-fbd0-453f-9a46-72b96d6df711 Aug 10 16:03:12 devstack sudo[99710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:03:12 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-326a84a1-7154-4398-8fc2-cf7af58bf557 tempest-SnapshotMetadataTestJSON-1815515952 None] Created reservations ['93a3011b-0d90-4757-ac0e-1ecf342bf0df', '2352f3dc-fac4-4d8d-86d8-1e79777d5a25', 'e59ba957-f171-4a2b-9dee-7361889b0f32', '1f38cb06-a0b4-443d-9069-4ca542f5d449'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:03:12 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-326a84a1-7154-4398-8fc2-cf7af58bf557 tempest-SnapshotMetadataTestJSON-1815515952 None] Delete snapshot completed successfully. Aug 10 16:03:12 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-326a84a1-7154-4398-8fc2-cf7af58bf557 tempest-SnapshotMetadataTestJSON-1815515952 None] Lock "cinder-1a5bfd01-7a3d-4261-a16b-a9e395394b98-delete_snapshot" released by "delete_snapshot" :: held 2.387s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:03:12 devstack sudo[99710]: pam_unix(sudo:session): session closed for user root Aug 10 16:03:12 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fcc22b3d-bb52-4f12-822a-c70184a895d7 tempest-TestImageHashVerification-1876444560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-7b939ff4-fbd0-453f-9a46-72b96d6df711" returned: 0 in 0.308s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:03:12 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-fcc22b3d-bb52-4f12-822a-c70184a895d7 tempest-TestImageHashVerification-1876444560 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:03:12 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-fcc22b3d-bb52-4f12-822a-c70184a895d7 tempest-TestImageHashVerification-1876444560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:03:12 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-fcc22b3d-bb52-4f12-822a-c70184a895d7 tempest-TestImageHashVerification-1876444560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d70bee2-c3f1-4f1e-8821-04647897b176) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b939ff4-fbd0-453f-9a46-72b96d6df711', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:03:12 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-fcc22b3d-bb52-4f12-822a-c70184a895d7 tempest-TestImageHashVerification-1876444560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a8809a4-295e-41b3-af02-475757ce0149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:03:12 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-fcc22b3d-bb52-4f12-822a-c70184a895d7 tempest-TestImageHashVerification-1876444560 None] Volume volume-7b939ff4-fbd0-453f-9a46-72b96d6df711 (7b939ff4-fbd0-453f-9a46-72b96d6df711): created successfully Aug 10 16:03:12 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-fcc22b3d-bb52-4f12-822a-c70184a895d7 tempest-TestImageHashVerification-1876444560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a8809a4-295e-41b3-af02-475757ce0149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:03:12 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-fcc22b3d-bb52-4f12-822a-c70184a895d7 tempest-TestImageHashVerification-1876444560 None] Flow 'volume_create_manager' (13451224-6923-43a2-a678-58ec669a123d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:03:12 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-fcc22b3d-bb52-4f12-822a-c70184a895d7 tempest-TestImageHashVerification-1876444560 None] Created volume successfully. Aug 10 16:03:13 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-c62685f3-2d4d-44dc-84ec-63a5bb6d591b tempest-SnapshotMetadataTestJSON-1815515952 None] Acquiring lock "cinder-c821be47-311a-46b9-b361-832e4af5f3f2-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:03:13 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-c62685f3-2d4d-44dc-84ec-63a5bb6d591b tempest-SnapshotMetadataTestJSON-1815515952 None] Lock "cinder-c821be47-311a-46b9-b361-832e4af5f3f2-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:03:13 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-c62685f3-2d4d-44dc-84ec-63a5bb6d591b tempest-SnapshotMetadataTestJSON-1815515952 None] Acquiring lock "cinder-quobyte-c821be47-311a-46b9-b361-832e4af5f3f2" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:03:13 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-c62685f3-2d4d-44dc-84ec-63a5bb6d591b tempest-SnapshotMetadataTestJSON-1815515952 None] Lock "cinder-quobyte-c821be47-311a-46b9-b361-832e4af5f3f2" acquired by "delete_volume" :: waited 0.019s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:03:13 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[c528e814-facb-4f1f-8f33-26ceb2b9264f]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:03:13 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c62685f3-2d4d-44dc-84ec-63a5bb6d591b tempest-SnapshotMetadataTestJSON-1815515952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c821be47-311a-46b9-b361-832e4af5f3f2 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:03:13 devstack sudo[99714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c821be47-311a-46b9-b361-832e4af5f3f2 Aug 10 16:03:13 devstack sudo[99714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:03:14 devstack sudo[99714]: pam_unix(sudo:session): session closed for user root Aug 10 16:03:14 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c62685f3-2d4d-44dc-84ec-63a5bb6d591b tempest-SnapshotMetadataTestJSON-1815515952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c821be47-311a-46b9-b361-832e4af5f3f2" returned: 0 in 0.607s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:03:14 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c62685f3-2d4d-44dc-84ec-63a5bb6d591b tempest-SnapshotMetadataTestJSON-1815515952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c821be47-311a-46b9-b361-832e4af5f3f2 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:03:14 devstack sudo[99734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c821be47-311a-46b9-b361-832e4af5f3f2 Aug 10 16:03:14 devstack sudo[99734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:03:14 devstack sudo[99734]: pam_unix(sudo:session): session closed for user root Aug 10 16:03:14 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c62685f3-2d4d-44dc-84ec-63a5bb6d591b tempest-SnapshotMetadataTestJSON-1815515952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c821be47-311a-46b9-b361-832e4af5f3f2" returned: 0 in 0.545s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:03:14 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-c62685f3-2d4d-44dc-84ec-63a5bb6d591b tempest-SnapshotMetadataTestJSON-1815515952 None] Lock "cinder-quobyte-c821be47-311a-46b9-b361-832e4af5f3f2" released by "delete_volume" :: held 1.233s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:03:14 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-c62685f3-2d4d-44dc-84ec-63a5bb6d591b tempest-SnapshotMetadataTestJSON-1815515952 None] Created reservations ['2a88d3c7-b9fd-4a9d-a78a-6ea86f705e57', '48bda4d0-ab67-45fc-b6f5-7c6f541fd122', 'f6fcdde8-e7ec-4321-9472-765ff89c9b1a', 'd08af553-2489-4486-80c2-e6f60659a836'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:03:14 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-c62685f3-2d4d-44dc-84ec-63a5bb6d591b tempest-SnapshotMetadataTestJSON-1815515952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:03:14 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-c62685f3-2d4d-44dc-84ec-63a5bb6d591b tempest-SnapshotMetadataTestJSON-1815515952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:03:14 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-c62685f3-2d4d-44dc-84ec-63a5bb6d591b tempest-SnapshotMetadataTestJSON-1815515952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:03:14 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-c62685f3-2d4d-44dc-84ec-63a5bb6d591b tempest-SnapshotMetadataTestJSON-1815515952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:03:14 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-c62685f3-2d4d-44dc-84ec-63a5bb6d591b tempest-SnapshotMetadataTestJSON-1815515952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:03:14 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c62685f3-2d4d-44dc-84ec-63a5bb6d591b tempest-SnapshotMetadataTestJSON-1815515952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:03:15 devstack sudo[99750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:03:15 devstack sudo[99750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:03:15 devstack sudo[99750]: pam_unix(sudo:session): session closed for user root Aug 10 16:03:15 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c62685f3-2d4d-44dc-84ec-63a5bb6d591b tempest-SnapshotMetadataTestJSON-1815515952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.482s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:03:15 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-c62685f3-2d4d-44dc-84ec-63a5bb6d591b tempest-SnapshotMetadataTestJSON-1815515952 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:03:15 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-b7734b3c-a20b-4a0e-aab6-221388fc6e44 tempest-TestImageHashVerification-1876444560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:03:15 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-b7734b3c-a20b-4a0e-aab6-221388fc6e44 tempest-TestImageHashVerification-1876444560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:03:15 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-c62685f3-2d4d-44dc-84ec-63a5bb6d591b tempest-SnapshotMetadataTestJSON-1815515952 None] Deleted volume successfully. Aug 10 16:03:15 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb093c7-c763-47c1-aa62-8fc54be1f118]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:03:15 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b7734b3c-a20b-4a0e-aab6-221388fc6e44 tempest-TestImageHashVerification-1876444560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-7b939ff4-fbd0-453f-9a46-72b96d6df711 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:03:15 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-c62685f3-2d4d-44dc-84ec-63a5bb6d591b tempest-SnapshotMetadataTestJSON-1815515952 None] Lock "cinder-c821be47-311a-46b9-b361-832e4af5f3f2-delete_volume" released by "delete_volume" :: held 2.069s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:03:15 devstack sudo[99793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-7b939ff4-fbd0-453f-9a46-72b96d6df711 Aug 10 16:03:15 devstack sudo[99793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:03:16 devstack sudo[99793]: pam_unix(sudo:session): session closed for user root Aug 10 16:03:16 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b7734b3c-a20b-4a0e-aab6-221388fc6e44 tempest-TestImageHashVerification-1876444560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-7b939ff4-fbd0-453f-9a46-72b96d6df711" returned: 0 in 0.615s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:03:16 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[43eb7eed-de05-4d56-84af-f2cf21532976]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:03:16 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b7734b3c-a20b-4a0e-aab6-221388fc6e44 tempest-TestImageHashVerification-1876444560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-7b939ff4-fbd0-453f-9a46-72b96d6df711 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:03:16 devstack sudo[99820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-7b939ff4-fbd0-453f-9a46-72b96d6df711 Aug 10 16:03:16 devstack sudo[99820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:03:16 devstack sudo[99820]: pam_unix(sudo:session): session closed for user root Aug 10 16:03:16 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b7734b3c-a20b-4a0e-aab6-221388fc6e44 tempest-TestImageHashVerification-1876444560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-7b939ff4-fbd0-453f-9a46-72b96d6df711" returned: 0 in 0.669s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:03:16 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b7734b3c-a20b-4a0e-aab6-221388fc6e44 tempest-TestImageHashVerification-1876444560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-7b939ff4-fbd0-453f-9a46-72b96d6df711 /opt/stack/data/cinder/conversion/7b939ff4-fbd0-453f-9a46-72b96d6df711.temp_image.0cf7d73d-827d-41d0-9edb-d37f246b438d6wz7wu07.img {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:03:16 devstack sudo[99845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-7b939ff4-fbd0-453f-9a46-72b96d6df711 /opt/stack/data/cinder/conversion/7b939ff4-fbd0-453f-9a46-72b96d6df711.temp_image.0cf7d73d-827d-41d0-9edb-d37f246b438d6wz7wu07.img Aug 10 16:03:16 devstack sudo[99845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:03:24 devstack sudo[99845]: pam_unix(sudo:session): session closed for user root Aug 10 16:03:24 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b7734b3c-a20b-4a0e-aab6-221388fc6e44 tempest-TestImageHashVerification-1876444560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-7b939ff4-fbd0-453f-9a46-72b96d6df711 /opt/stack/data/cinder/conversion/7b939ff4-fbd0-453f-9a46-72b96d6df711.temp_image.0cf7d73d-827d-41d0-9edb-d37f246b438d6wz7wu07.img" returned: 0 in 7.422s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:03:24 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e365e7-2cdd-47d1-a42c-196fc5ebe48d]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:03:24 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b7734b3c-a20b-4a0e-aab6-221388fc6e44 tempest-TestImageHashVerification-1876444560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-7b939ff4-fbd0-453f-9a46-72b96d6df711 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:03:24 devstack sudo[99872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-7b939ff4-fbd0-453f-9a46-72b96d6df711 Aug 10 16:03:24 devstack sudo[99872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:03:24 devstack sudo[99872]: pam_unix(sudo:session): session closed for user root Aug 10 16:03:24 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b7734b3c-a20b-4a0e-aab6-221388fc6e44 tempest-TestImageHashVerification-1876444560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-7b939ff4-fbd0-453f-9a46-72b96d6df711" returned: 0 in 0.635s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:03:24 devstack cinder-volume[88641]: DEBUG cinder.image.image_utils [None req-b7734b3c-a20b-4a0e-aab6-221388fc6e44 tempest-TestImageHashVerification-1876444560 None] Image conversion details: src /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-7b939ff4-fbd0-453f-9a46-72b96d6df711, size 1024.00 MB, duration 7.43 sec, destination /opt/stack/data/cinder/conversion/7b939ff4-fbd0-453f-9a46-72b96d6df711.temp_image.0cf7d73d-827d-41d0-9edb-d37f246b438d6wz7wu07.img {{(pid=88641) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 10 16:03:24 devstack cinder-volume[88641]: INFO cinder.image.image_utils [None req-b7734b3c-a20b-4a0e-aab6-221388fc6e44 tempest-TestImageHashVerification-1876444560 None] Converted 1024.00 MB image at 137.89 MB/s Aug 10 16:03:24 devstack cinder-volume[88641]: DEBUG dbcounter [-] [88641] Writing DB stats cinder:SELECT=34,cinder:UPDATE=44,cinder:INSERT=14,cinder:DELETE=4 {{(pid=88641) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 16:03:24 devstack cinder-volume[88641]: DEBUG cinder.image.image_utils [None req-b7734b3c-a20b-4a0e-aab6-221388fc6e44 tempest-TestImageHashVerification-1876444560 None] 0cf7d73d-827d-41d0-9edb-d37f246b438d was raw, no need to convert to raw {{(pid=88641) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Aug 10 16:03:26 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-52eb8d27-5af5-4d76-8e4e-52fa2a54f47a tempest-VolumesTransfersTest-1256603816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:03:26 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-52eb8d27-5af5-4d76-8e4e-52fa2a54f47a tempest-VolumesTransfersTest-1256603816 None] Flow 'volume_create_manager' (ca46862d-ce45-40eb-a011-28805e998109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:03:26 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-52eb8d27-5af5-4d76-8e4e-52fa2a54f47a tempest-VolumesTransfersTest-1256603816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b1a2668-3e9d-4c06-98cd-5e90c3064ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:03:26 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-52eb8d27-5af5-4d76-8e4e-52fa2a54f47a tempest-VolumesTransfersTest-1256603816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b1a2668-3e9d-4c06-98cd-5e90c3064ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:03:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-137338083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3114a985-9eab-4d4c-a619-0977d8c99bf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05ff7bd06aa043f89bdf1907a58ad944',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:03:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:03:27Z,use_quota=True,user_id='7a50e9f9a41c409c9f41cd798bdbb6a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:03:26 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-52eb8d27-5af5-4d76-8e4e-52fa2a54f47a tempest-VolumesTransfersTest-1256603816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee8e6b0f-7596-40a0-9e23-c0ea3191ef66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:03:26 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-52eb8d27-5af5-4d76-8e4e-52fa2a54f47a tempest-VolumesTransfersTest-1256603816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee8e6b0f-7596-40a0-9e23-c0ea3191ef66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:03:27 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-52eb8d27-5af5-4d76-8e4e-52fa2a54f47a tempest-VolumesTransfersTest-1256603816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a517500f-bd25-42ff-a49b-c57ebee513a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:03:27 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-52eb8d27-5af5-4d76-8e4e-52fa2a54f47a tempest-VolumesTransfersTest-1256603816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a517500f-bd25-42ff-a49b-c57ebee513a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3114a985-9eab-4d4c-a619-0977d8c99bf4', 'volume_name': 'volume-3114a985-9eab-4d4c-a619-0977d8c99bf4', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:03:27 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-52eb8d27-5af5-4d76-8e4e-52fa2a54f47a tempest-VolumesTransfersTest-1256603816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76070a34-5bea-42c4-9404-f868d1353ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:03:27 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-52eb8d27-5af5-4d76-8e4e-52fa2a54f47a tempest-VolumesTransfersTest-1256603816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76070a34-5bea-42c4-9404-f868d1353ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:03:27 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-52eb8d27-5af5-4d76-8e4e-52fa2a54f47a tempest-VolumesTransfersTest-1256603816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2c6346f-170a-4abb-a7b1-c76fe1651543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:03:27 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-52eb8d27-5af5-4d76-8e4e-52fa2a54f47a tempest-VolumesTransfersTest-1256603816 None] Volume 3114a985-9eab-4d4c-a619-0977d8c99bf4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3114a985-9eab-4d4c-a619-0977d8c99bf4', 'volume_size': 1} Aug 10 16:03:27 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-52eb8d27-5af5-4d76-8e4e-52fa2a54f47a tempest-VolumesTransfersTest-1256603816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:03:36 devstack cinder-volume[88641]: DEBUG oslo_service.periodic_task [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88641) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 16:03:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:03:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:03:36 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:03:36 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:03:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:03:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:03:36 devstack sudo[99895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:03:36 devstack sudo[99895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:03:36 devstack sudo[99895]: pam_unix(sudo:session): session closed for user root Aug 10 16:03:36 devstack cinder-volume[88641]: DEBUG dbcounter [-] [88641] Writing DB stats cinder:SELECT=1 {{(pid=88641) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 16:03:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.331s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:03:36 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:03:36 devstack cinder-volume[88641]: DEBUG oslo_service.periodic_task [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Running periodic task VolumeManager._thread_info {{(pid=88641) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 16:03:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] thread count: 28 {{(pid=88641) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 10 16:03:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] thread info: [<_MainThread(MainThread, started 127361545748608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88641) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 10 16:03:39 devstack cinder-volume[88641]: DEBUG dbcounter [-] [88641] Writing DB stats cinder:SELECT=43,cinder:INSERT=9,cinder:UPDATE=48,cinder:DELETE=3 {{(pid=88641) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 16:03:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-b7734b3c-a20b-4a0e-aab6-221388fc6e44 tempest-TestImageHashVerification-1876444560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 34.540s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:03:50 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b7734b3c-a20b-4a0e-aab6-221388fc6e44 tempest-TestImageHashVerification-1876444560 None] Uploaded volume to glance image-id: 0cf7d73d-827d-41d0-9edb-d37f246b438d. {{(pid=88641) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 10 16:03:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-52eb8d27-5af5-4d76-8e4e-52fa2a54f47a tempest-VolumesTransfersTest-1256603816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 22.924s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:03:50 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-52eb8d27-5af5-4d76-8e4e-52fa2a54f47a tempest-VolumesTransfersTest-1256603816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:03:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-137338083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3114a985-9eab-4d4c-a619-0977d8c99bf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05ff7bd06aa043f89bdf1907a58ad944',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:03:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:03:27Z,use_quota=True,user_id='7a50e9f9a41c409c9f41cd798bdbb6a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:03:50 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-52eb8d27-5af5-4d76-8e4e-52fa2a54f47a tempest-VolumesTransfersTest-1256603816 None] Creating volume 3114a985-9eab-4d4c-a619-0977d8c99bf4 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:03:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-52eb8d27-5af5-4d76-8e4e-52fa2a54f47a tempest-VolumesTransfersTest-1256603816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:03:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-52eb8d27-5af5-4d76-8e4e-52fa2a54f47a tempest-VolumesTransfersTest-1256603816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:03:50 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-52eb8d27-5af5-4d76-8e4e-52fa2a54f47a tempest-VolumesTransfersTest-1256603816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:03:50 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-52eb8d27-5af5-4d76-8e4e-52fa2a54f47a tempest-VolumesTransfersTest-1256603816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:03:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-52eb8d27-5af5-4d76-8e4e-52fa2a54f47a tempest-VolumesTransfersTest-1256603816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:03:50 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-52eb8d27-5af5-4d76-8e4e-52fa2a54f47a tempest-VolumesTransfersTest-1256603816 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:03:50 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-52eb8d27-5af5-4d76-8e4e-52fa2a54f47a tempest-VolumesTransfersTest-1256603816 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:03:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-52eb8d27-5af5-4d76-8e4e-52fa2a54f47a tempest-VolumesTransfersTest-1256603816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3114a985-9eab-4d4c-a619-0977d8c99bf4 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:03:50 devstack sudo[99934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3114a985-9eab-4d4c-a619-0977d8c99bf4 1073741824 Aug 10 16:03:50 devstack sudo[99934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:03:50 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-b7734b3c-a20b-4a0e-aab6-221388fc6e44 tempest-TestImageHashVerification-1876444560 None] Copy volume to image completed successfully. Aug 10 16:03:50 devstack sudo[99934]: pam_unix(sudo:session): session closed for user root Aug 10 16:03:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-52eb8d27-5af5-4d76-8e4e-52fa2a54f47a tempest-VolumesTransfersTest-1256603816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3114a985-9eab-4d4c-a619-0977d8c99bf4 1073741824" returned: 0 in 0.592s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:03:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-52eb8d27-5af5-4d76-8e4e-52fa2a54f47a tempest-VolumesTransfersTest-1256603816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3114a985-9eab-4d4c-a619-0977d8c99bf4 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:03:50 devstack sudo[99940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3114a985-9eab-4d4c-a619-0977d8c99bf4 Aug 10 16:03:50 devstack sudo[99940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:03:51 devstack sudo[99940]: pam_unix(sudo:session): session closed for user root Aug 10 16:03:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-52eb8d27-5af5-4d76-8e4e-52fa2a54f47a tempest-VolumesTransfersTest-1256603816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3114a985-9eab-4d4c-a619-0977d8c99bf4" returned: 0 in 0.321s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:03:51 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-52eb8d27-5af5-4d76-8e4e-52fa2a54f47a tempest-VolumesTransfersTest-1256603816 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:03:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-52eb8d27-5af5-4d76-8e4e-52fa2a54f47a tempest-VolumesTransfersTest-1256603816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:03:51 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-52eb8d27-5af5-4d76-8e4e-52fa2a54f47a tempest-VolumesTransfersTest-1256603816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2c6346f-170a-4abb-a7b1-c76fe1651543) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3114a985-9eab-4d4c-a619-0977d8c99bf4', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:03:51 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-52eb8d27-5af5-4d76-8e4e-52fa2a54f47a tempest-VolumesTransfersTest-1256603816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ec20ce1-c76c-4b76-bfb9-1bacda5b7758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:03:51 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-52eb8d27-5af5-4d76-8e4e-52fa2a54f47a tempest-VolumesTransfersTest-1256603816 None] Volume volume-3114a985-9eab-4d4c-a619-0977d8c99bf4 (3114a985-9eab-4d4c-a619-0977d8c99bf4): created successfully Aug 10 16:03:51 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-52eb8d27-5af5-4d76-8e4e-52fa2a54f47a tempest-VolumesTransfersTest-1256603816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ec20ce1-c76c-4b76-bfb9-1bacda5b7758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:03:51 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-52eb8d27-5af5-4d76-8e4e-52fa2a54f47a tempest-VolumesTransfersTest-1256603816 None] Flow 'volume_create_manager' (ca46862d-ce45-40eb-a011-28805e998109) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:03:51 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-52eb8d27-5af5-4d76-8e4e-52fa2a54f47a tempest-VolumesTransfersTest-1256603816 None] Created volume successfully. Aug 10 16:03:51 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-b5cd60fa-0dc2-4e03-a0c9-c82840e8b312 tempest-TestImageHashVerification-1876444560 None] Acquiring lock "cinder-7b939ff4-fbd0-453f-9a46-72b96d6df711-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:03:51 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-b5cd60fa-0dc2-4e03-a0c9-c82840e8b312 tempest-TestImageHashVerification-1876444560 None] Lock "cinder-7b939ff4-fbd0-453f-9a46-72b96d6df711-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:03:51 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-b5cd60fa-0dc2-4e03-a0c9-c82840e8b312 tempest-TestImageHashVerification-1876444560 None] Acquiring lock "cinder-quobyte-7b939ff4-fbd0-453f-9a46-72b96d6df711" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:03:51 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-b5cd60fa-0dc2-4e03-a0c9-c82840e8b312 tempest-TestImageHashVerification-1876444560 None] Lock "cinder-quobyte-7b939ff4-fbd0-453f-9a46-72b96d6df711" acquired by "delete_volume" :: waited 0.023s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:03:51 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[89fd70c5-cf46-4845-9606-89038d60d664]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:03:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b5cd60fa-0dc2-4e03-a0c9-c82840e8b312 tempest-TestImageHashVerification-1876444560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-7b939ff4-fbd0-453f-9a46-72b96d6df711 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:03:51 devstack sudo[99945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-7b939ff4-fbd0-453f-9a46-72b96d6df711 Aug 10 16:03:51 devstack sudo[99945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:03:52 devstack sudo[99945]: pam_unix(sudo:session): session closed for user root Aug 10 16:03:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b5cd60fa-0dc2-4e03-a0c9-c82840e8b312 tempest-TestImageHashVerification-1876444560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-7b939ff4-fbd0-453f-9a46-72b96d6df711" returned: 0 in 0.738s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:03:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b5cd60fa-0dc2-4e03-a0c9-c82840e8b312 tempest-TestImageHashVerification-1876444560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-7b939ff4-fbd0-453f-9a46-72b96d6df711 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:03:52 devstack sudo[99999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-7b939ff4-fbd0-453f-9a46-72b96d6df711 Aug 10 16:03:52 devstack sudo[99999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:03:52 devstack sudo[99999]: pam_unix(sudo:session): session closed for user root Aug 10 16:03:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b5cd60fa-0dc2-4e03-a0c9-c82840e8b312 tempest-TestImageHashVerification-1876444560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-7b939ff4-fbd0-453f-9a46-72b96d6df711" returned: 0 in 0.577s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:03:52 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-b5cd60fa-0dc2-4e03-a0c9-c82840e8b312 tempest-TestImageHashVerification-1876444560 None] Lock "cinder-quobyte-7b939ff4-fbd0-453f-9a46-72b96d6df711" released by "delete_volume" :: held 1.392s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:03:53 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-b5cd60fa-0dc2-4e03-a0c9-c82840e8b312 tempest-TestImageHashVerification-1876444560 None] Created reservations ['ff116a19-4422-4602-a88e-72fdeba368ae', '1d55a691-f0df-4b16-be7e-4a4abdae9de7', '04f64789-2c63-4d3e-a04f-e614b2057f7f', '166c319b-0835-4a14-9c4b-52fa5662a948'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:03:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-b5cd60fa-0dc2-4e03-a0c9-c82840e8b312 tempest-TestImageHashVerification-1876444560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:03:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-b5cd60fa-0dc2-4e03-a0c9-c82840e8b312 tempest-TestImageHashVerification-1876444560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:03:53 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-b5cd60fa-0dc2-4e03-a0c9-c82840e8b312 tempest-TestImageHashVerification-1876444560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:03:53 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-b5cd60fa-0dc2-4e03-a0c9-c82840e8b312 tempest-TestImageHashVerification-1876444560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:03:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-b5cd60fa-0dc2-4e03-a0c9-c82840e8b312 tempest-TestImageHashVerification-1876444560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:03:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b5cd60fa-0dc2-4e03-a0c9-c82840e8b312 tempest-TestImageHashVerification-1876444560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:03:53 devstack sudo[100006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:03:53 devstack sudo[100006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:03:53 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-3c1a5c97-a5f9-451c-84a5-017d7d6a5dfa tempest-VolumesTransfersTest-228552338 None] Transfer volume completed successfully. Aug 10 16:03:53 devstack sudo[100006]: pam_unix(sudo:session): session closed for user root Aug 10 16:03:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b5cd60fa-0dc2-4e03-a0c9-c82840e8b312 tempest-TestImageHashVerification-1876444560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.375s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:03:53 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-b5cd60fa-0dc2-4e03-a0c9-c82840e8b312 tempest-TestImageHashVerification-1876444560 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:03:53 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-b5cd60fa-0dc2-4e03-a0c9-c82840e8b312 tempest-TestImageHashVerification-1876444560 None] Deleted volume successfully. Aug 10 16:03:53 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-b5cd60fa-0dc2-4e03-a0c9-c82840e8b312 tempest-TestImageHashVerification-1876444560 None] Lock "cinder-7b939ff4-fbd0-453f-9a46-72b96d6df711-delete_volume" released by "delete_volume" :: held 2.108s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:03:54 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-8612e3c5-7dfc-4428-9b82-a64af5f838b3 tempest-VolumesTransfersTest-1870555800 None] Acquiring lock "cinder-3114a985-9eab-4d4c-a619-0977d8c99bf4-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:03:54 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-8612e3c5-7dfc-4428-9b82-a64af5f838b3 tempest-VolumesTransfersTest-1870555800 None] Lock "cinder-3114a985-9eab-4d4c-a619-0977d8c99bf4-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:03:54 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-8612e3c5-7dfc-4428-9b82-a64af5f838b3 tempest-VolumesTransfersTest-1870555800 None] Acquiring lock "cinder-quobyte-3114a985-9eab-4d4c-a619-0977d8c99bf4" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:03:54 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-8612e3c5-7dfc-4428-9b82-a64af5f838b3 tempest-VolumesTransfersTest-1870555800 None] Lock "cinder-quobyte-3114a985-9eab-4d4c-a619-0977d8c99bf4" acquired by "delete_volume" :: waited 0.017s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:03:54 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ddd3c2-6df3-4cab-99f1-4db99fda8d66]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:03:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-8612e3c5-7dfc-4428-9b82-a64af5f838b3 tempest-VolumesTransfersTest-1870555800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3114a985-9eab-4d4c-a619-0977d8c99bf4 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:03:54 devstack sudo[100010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3114a985-9eab-4d4c-a619-0977d8c99bf4 Aug 10 16:03:54 devstack sudo[100010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:03:54 devstack sudo[100010]: pam_unix(sudo:session): session closed for user root Aug 10 16:03:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-8612e3c5-7dfc-4428-9b82-a64af5f838b3 tempest-VolumesTransfersTest-1870555800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3114a985-9eab-4d4c-a619-0977d8c99bf4" returned: 0 in 0.412s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:03:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-8612e3c5-7dfc-4428-9b82-a64af5f838b3 tempest-VolumesTransfersTest-1870555800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3114a985-9eab-4d4c-a619-0977d8c99bf4 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:03:54 devstack sudo[100015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3114a985-9eab-4d4c-a619-0977d8c99bf4 Aug 10 16:03:54 devstack sudo[100015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:03:54 devstack sudo[100015]: pam_unix(sudo:session): session closed for user root Aug 10 16:03:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-8612e3c5-7dfc-4428-9b82-a64af5f838b3 tempest-VolumesTransfersTest-1870555800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3114a985-9eab-4d4c-a619-0977d8c99bf4" returned: 0 in 0.286s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:03:54 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-8612e3c5-7dfc-4428-9b82-a64af5f838b3 tempest-VolumesTransfersTest-1870555800 None] Lock "cinder-quobyte-3114a985-9eab-4d4c-a619-0977d8c99bf4" released by "delete_volume" :: held 0.748s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:03:54 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-8612e3c5-7dfc-4428-9b82-a64af5f838b3 tempest-VolumesTransfersTest-1870555800 None] Created reservations ['9d557d8a-1774-4db0-8d27-842fa142a782', '871b06e7-ad57-405f-8c71-3d21407013c4', '2b3d1d07-7fb1-4ba0-8c99-417c37b1aa38', '7b7de703-0f5f-4cd1-b8d7-6d3332b7dcc1'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:03:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-8612e3c5-7dfc-4428-9b82-a64af5f838b3 tempest-VolumesTransfersTest-1870555800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:03:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-8612e3c5-7dfc-4428-9b82-a64af5f838b3 tempest-VolumesTransfersTest-1870555800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:03:55 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-8612e3c5-7dfc-4428-9b82-a64af5f838b3 tempest-VolumesTransfersTest-1870555800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:03:55 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-8612e3c5-7dfc-4428-9b82-a64af5f838b3 tempest-VolumesTransfersTest-1870555800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:03:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-8612e3c5-7dfc-4428-9b82-a64af5f838b3 tempest-VolumesTransfersTest-1870555800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:03:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-8612e3c5-7dfc-4428-9b82-a64af5f838b3 tempest-VolumesTransfersTest-1870555800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:03:55 devstack sudo[100018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:03:55 devstack sudo[100018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:03:55 devstack sudo[100018]: pam_unix(sudo:session): session closed for user root Aug 10 16:03:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-8612e3c5-7dfc-4428-9b82-a64af5f838b3 tempest-VolumesTransfersTest-1870555800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.341s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:03:55 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-8612e3c5-7dfc-4428-9b82-a64af5f838b3 tempest-VolumesTransfersTest-1870555800 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:03:55 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-8612e3c5-7dfc-4428-9b82-a64af5f838b3 tempest-VolumesTransfersTest-1870555800 None] Deleted volume successfully. Aug 10 16:03:55 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-8612e3c5-7dfc-4428-9b82-a64af5f838b3 tempest-VolumesTransfersTest-1870555800 None] Lock "cinder-3114a985-9eab-4d4c-a619-0977d8c99bf4-delete_volume" released by "delete_volume" :: held 1.339s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:03:55 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdc47be4-c75f-411e-8fe9-b7afd6f97fa1 tempest-VolumesTransfersTest-1256603816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:03:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-fdc47be4-c75f-411e-8fe9-b7afd6f97fa1 tempest-VolumesTransfersTest-1256603816 None] Flow 'volume_create_manager' (f746c772-4512-4ff5-bcfa-131049ed3c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:03:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-fdc47be4-c75f-411e-8fe9-b7afd6f97fa1 tempest-VolumesTransfersTest-1256603816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa1f706a-b727-4944-8f4e-e5c92f1c1618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:03:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-fdc47be4-c75f-411e-8fe9-b7afd6f97fa1 tempest-VolumesTransfersTest-1256603816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa1f706a-b727-4944-8f4e-e5c92f1c1618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:03:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-67718915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d43e0bf-19d8-4f77-bd0b-80125179617c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05ff7bd06aa043f89bdf1907a58ad944',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:03:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:03:56Z,use_quota=True,user_id='7a50e9f9a41c409c9f41cd798bdbb6a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:03:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-fdc47be4-c75f-411e-8fe9-b7afd6f97fa1 tempest-VolumesTransfersTest-1256603816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbf27fdb-97a5-4090-871e-7d5056c50405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:03:56 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-fdc47be4-c75f-411e-8fe9-b7afd6f97fa1 tempest-VolumesTransfersTest-1256603816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbf27fdb-97a5-4090-871e-7d5056c50405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:03:56 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-fdc47be4-c75f-411e-8fe9-b7afd6f97fa1 tempest-VolumesTransfersTest-1256603816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef313ce9-4f42-4d5d-be31-844d07f7e6ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:03:56 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-fdc47be4-c75f-411e-8fe9-b7afd6f97fa1 tempest-VolumesTransfersTest-1256603816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef313ce9-4f42-4d5d-be31-844d07f7e6ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d43e0bf-19d8-4f77-bd0b-80125179617c', 'volume_name': 'volume-4d43e0bf-19d8-4f77-bd0b-80125179617c', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:03:56 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-fdc47be4-c75f-411e-8fe9-b7afd6f97fa1 tempest-VolumesTransfersTest-1256603816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1905dcb-8442-478b-aa79-0a904198d498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:03:56 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-fdc47be4-c75f-411e-8fe9-b7afd6f97fa1 tempest-VolumesTransfersTest-1256603816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1905dcb-8442-478b-aa79-0a904198d498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:03:56 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-fdc47be4-c75f-411e-8fe9-b7afd6f97fa1 tempest-VolumesTransfersTest-1256603816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71045b56-d6df-4b10-b149-693a02f99921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:03:56 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-fdc47be4-c75f-411e-8fe9-b7afd6f97fa1 tempest-VolumesTransfersTest-1256603816 None] Volume 4d43e0bf-19d8-4f77-bd0b-80125179617c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d43e0bf-19d8-4f77-bd0b-80125179617c', 'volume_size': 1} Aug 10 16:03:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-fdc47be4-c75f-411e-8fe9-b7afd6f97fa1 tempest-VolumesTransfersTest-1256603816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:03:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-fdc47be4-c75f-411e-8fe9-b7afd6f97fa1 tempest-VolumesTransfersTest-1256603816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:03:56 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-fdc47be4-c75f-411e-8fe9-b7afd6f97fa1 tempest-VolumesTransfersTest-1256603816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:03:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-67718915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d43e0bf-19d8-4f77-bd0b-80125179617c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05ff7bd06aa043f89bdf1907a58ad944',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:03:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:03:56Z,use_quota=True,user_id='7a50e9f9a41c409c9f41cd798bdbb6a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:03:56 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-fdc47be4-c75f-411e-8fe9-b7afd6f97fa1 tempest-VolumesTransfersTest-1256603816 None] Creating volume 4d43e0bf-19d8-4f77-bd0b-80125179617c {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:03:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-fdc47be4-c75f-411e-8fe9-b7afd6f97fa1 tempest-VolumesTransfersTest-1256603816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:03:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-fdc47be4-c75f-411e-8fe9-b7afd6f97fa1 tempest-VolumesTransfersTest-1256603816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:03:56 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-fdc47be4-c75f-411e-8fe9-b7afd6f97fa1 tempest-VolumesTransfersTest-1256603816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:03:56 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-fdc47be4-c75f-411e-8fe9-b7afd6f97fa1 tempest-VolumesTransfersTest-1256603816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:03:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-fdc47be4-c75f-411e-8fe9-b7afd6f97fa1 tempest-VolumesTransfersTest-1256603816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:03:56 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-fdc47be4-c75f-411e-8fe9-b7afd6f97fa1 tempest-VolumesTransfersTest-1256603816 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:03:56 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-fdc47be4-c75f-411e-8fe9-b7afd6f97fa1 tempest-VolumesTransfersTest-1256603816 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:03:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fdc47be4-c75f-411e-8fe9-b7afd6f97fa1 tempest-VolumesTransfersTest-1256603816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4d43e0bf-19d8-4f77-bd0b-80125179617c 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:03:56 devstack sudo[100022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4d43e0bf-19d8-4f77-bd0b-80125179617c 1073741824 Aug 10 16:03:56 devstack sudo[100022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:03:56 devstack sudo[100022]: pam_unix(sudo:session): session closed for user root Aug 10 16:03:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fdc47be4-c75f-411e-8fe9-b7afd6f97fa1 tempest-VolumesTransfersTest-1256603816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4d43e0bf-19d8-4f77-bd0b-80125179617c 1073741824" returned: 0 in 0.572s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:03:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fdc47be4-c75f-411e-8fe9-b7afd6f97fa1 tempest-VolumesTransfersTest-1256603816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4d43e0bf-19d8-4f77-bd0b-80125179617c {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:03:56 devstack sudo[100028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4d43e0bf-19d8-4f77-bd0b-80125179617c Aug 10 16:03:56 devstack sudo[100028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:03:56 devstack sudo[100028]: pam_unix(sudo:session): session closed for user root Aug 10 16:03:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fdc47be4-c75f-411e-8fe9-b7afd6f97fa1 tempest-VolumesTransfersTest-1256603816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4d43e0bf-19d8-4f77-bd0b-80125179617c" returned: 0 in 0.316s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:03:56 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-fdc47be4-c75f-411e-8fe9-b7afd6f97fa1 tempest-VolumesTransfersTest-1256603816 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:03:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-fdc47be4-c75f-411e-8fe9-b7afd6f97fa1 tempest-VolumesTransfersTest-1256603816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:03:57 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-fdc47be4-c75f-411e-8fe9-b7afd6f97fa1 tempest-VolumesTransfersTest-1256603816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71045b56-d6df-4b10-b149-693a02f99921) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d43e0bf-19d8-4f77-bd0b-80125179617c', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:03:57 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-fdc47be4-c75f-411e-8fe9-b7afd6f97fa1 tempest-VolumesTransfersTest-1256603816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5a1c6f4-7489-4442-9975-cfa27d86abf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:03:57 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-fdc47be4-c75f-411e-8fe9-b7afd6f97fa1 tempest-VolumesTransfersTest-1256603816 None] Volume volume-4d43e0bf-19d8-4f77-bd0b-80125179617c (4d43e0bf-19d8-4f77-bd0b-80125179617c): created successfully Aug 10 16:03:57 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-fdc47be4-c75f-411e-8fe9-b7afd6f97fa1 tempest-VolumesTransfersTest-1256603816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5a1c6f4-7489-4442-9975-cfa27d86abf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:03:57 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-fdc47be4-c75f-411e-8fe9-b7afd6f97fa1 tempest-VolumesTransfersTest-1256603816 None] Flow 'volume_create_manager' (f746c772-4512-4ff5-bcfa-131049ed3c5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:03:57 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-fdc47be4-c75f-411e-8fe9-b7afd6f97fa1 tempest-VolumesTransfersTest-1256603816 None] Created volume successfully. Aug 10 16:03:58 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-1b3c40e5-404a-4435-b77a-79ed91e61a94 tempest-VolumesTransfersTest-1870555800 None] Acquiring lock "cinder-4d43e0bf-19d8-4f77-bd0b-80125179617c-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:03:58 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-1b3c40e5-404a-4435-b77a-79ed91e61a94 tempest-VolumesTransfersTest-1870555800 None] Lock "cinder-4d43e0bf-19d8-4f77-bd0b-80125179617c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:03:58 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-1b3c40e5-404a-4435-b77a-79ed91e61a94 tempest-VolumesTransfersTest-1870555800 None] Acquiring lock "cinder-quobyte-4d43e0bf-19d8-4f77-bd0b-80125179617c" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:03:58 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-1b3c40e5-404a-4435-b77a-79ed91e61a94 tempest-VolumesTransfersTest-1870555800 None] Lock "cinder-quobyte-4d43e0bf-19d8-4f77-bd0b-80125179617c" acquired by "delete_volume" :: waited 0.027s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:03:58 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[40de0417-b3fb-454a-9046-7de73c6ef9e7]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:03:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-1b3c40e5-404a-4435-b77a-79ed91e61a94 tempest-VolumesTransfersTest-1870555800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4d43e0bf-19d8-4f77-bd0b-80125179617c {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:03:58 devstack sudo[100032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4d43e0bf-19d8-4f77-bd0b-80125179617c Aug 10 16:03:58 devstack sudo[100032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:03:58 devstack sudo[100032]: pam_unix(sudo:session): session closed for user root Aug 10 16:03:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-1b3c40e5-404a-4435-b77a-79ed91e61a94 tempest-VolumesTransfersTest-1870555800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4d43e0bf-19d8-4f77-bd0b-80125179617c" returned: 0 in 0.422s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:03:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-1b3c40e5-404a-4435-b77a-79ed91e61a94 tempest-VolumesTransfersTest-1870555800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4d43e0bf-19d8-4f77-bd0b-80125179617c {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:03:59 devstack sudo[100037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4d43e0bf-19d8-4f77-bd0b-80125179617c Aug 10 16:03:59 devstack sudo[100037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:03:59 devstack sudo[100037]: pam_unix(sudo:session): session closed for user root Aug 10 16:03:59 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-1b3c40e5-404a-4435-b77a-79ed91e61a94 tempest-VolumesTransfersTest-1870555800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4d43e0bf-19d8-4f77-bd0b-80125179617c" returned: 0 in 0.308s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:03:59 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-1b3c40e5-404a-4435-b77a-79ed91e61a94 tempest-VolumesTransfersTest-1870555800 None] Lock "cinder-quobyte-4d43e0bf-19d8-4f77-bd0b-80125179617c" released by "delete_volume" :: held 0.808s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:03:59 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-1b3c40e5-404a-4435-b77a-79ed91e61a94 tempest-VolumesTransfersTest-1870555800 None] Created reservations ['6951c6df-6fb3-4cee-93ce-3b87c915e71e', '91f21aa8-f0ae-4bd1-9a7e-7546866a438b', '08663d93-233b-48cd-9853-f14467fb6cbe', '4681e449-8e02-4c89-bfcc-69778bf85762'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:03:59 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-1b3c40e5-404a-4435-b77a-79ed91e61a94 tempest-VolumesTransfersTest-1870555800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:03:59 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-1b3c40e5-404a-4435-b77a-79ed91e61a94 tempest-VolumesTransfersTest-1870555800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:03:59 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-1b3c40e5-404a-4435-b77a-79ed91e61a94 tempest-VolumesTransfersTest-1870555800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:03:59 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-1b3c40e5-404a-4435-b77a-79ed91e61a94 tempest-VolumesTransfersTest-1870555800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:03:59 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-1b3c40e5-404a-4435-b77a-79ed91e61a94 tempest-VolumesTransfersTest-1870555800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:03:59 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-1b3c40e5-404a-4435-b77a-79ed91e61a94 tempest-VolumesTransfersTest-1870555800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:03:59 devstack sudo[100040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:03:59 devstack sudo[100040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:03:59 devstack sudo[100040]: pam_unix(sudo:session): session closed for user root Aug 10 16:03:59 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-1b3c40e5-404a-4435-b77a-79ed91e61a94 tempest-VolumesTransfersTest-1870555800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.440s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:03:59 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-1b3c40e5-404a-4435-b77a-79ed91e61a94 tempest-VolumesTransfersTest-1870555800 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:03:59 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-1b3c40e5-404a-4435-b77a-79ed91e61a94 tempest-VolumesTransfersTest-1870555800 None] Deleted volume successfully. Aug 10 16:03:59 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-1b3c40e5-404a-4435-b77a-79ed91e61a94 tempest-VolumesTransfersTest-1870555800 None] Lock "cinder-4d43e0bf-19d8-4f77-bd0b-80125179617c-delete_volume" released by "delete_volume" :: held 1.531s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:04:09 devstack cinder-volume[88641]: DEBUG dbcounter [-] [88641] Writing DB stats cinder:SELECT=23,cinder:UPDATE=31,cinder:DELETE=3,cinder:INSERT=6 {{(pid=88641) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 16:04:09 devstack cinder-volume[88641]: DEBUG dbcounter [-] [88641] Writing DB stats cinder:UPDATE=29,cinder:INSERT=8,cinder:SELECT=15,cinder:DELETE=2 {{(pid=88641) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 16:04:10 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2befcf3-687d-4c6b-864d-1ade5095c1ba tempest-TestShelveInstance-1958992432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:04:10 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b2befcf3-687d-4c6b-864d-1ade5095c1ba tempest-TestShelveInstance-1958992432 None] Flow 'volume_create_manager' (a531fcc1-f17e-49e0-8e02-7959bd6394cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:04:10 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b2befcf3-687d-4c6b-864d-1ade5095c1ba tempest-TestShelveInstance-1958992432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a475aca4-f38b-42ea-b21f-87f67a362d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:10 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b2befcf3-687d-4c6b-864d-1ade5095c1ba tempest-TestShelveInstance-1958992432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a475aca4-f38b-42ea-b21f-87f67a362d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:04:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1264641022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=240f4272-f60e-42a3-9240-e677fd927ddc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='353efb40c95740ae9a4ff48e64caece6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:04:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:04:10Z,use_quota=True,user_id='895746ac56444c10b17a290156d17c5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:10 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b2befcf3-687d-4c6b-864d-1ade5095c1ba tempest-TestShelveInstance-1958992432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15a703b4-5629-4dc5-81c5-172be02f2c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:10 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b2befcf3-687d-4c6b-864d-1ade5095c1ba tempest-TestShelveInstance-1958992432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15a703b4-5629-4dc5-81c5-172be02f2c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:10 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b2befcf3-687d-4c6b-864d-1ade5095c1ba tempest-TestShelveInstance-1958992432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72617a9b-87e9-4977-a835-861a9cc7efb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:10 devstack cinder-volume[88641]: DEBUG cinder.image.glance [None req-b2befcf3-687d-4c6b-864d-1ade5095c1ba tempest-TestShelveInstance-1958992432 None] Creating Keystone auth plugin from conf {{(pid=88641) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 10 16:04:11 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b2befcf3-687d-4c6b-864d-1ade5095c1ba tempest-TestShelveInstance-1958992432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72617a9b-87e9-4977-a835-861a9cc7efb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '240f4272-f60e-42a3-9240-e677fd927ddc', 'volume_name': 'volume-240f4272-f60e-42a3-9240-e677fd927ddc', 'volume_size': 1, 'image_id': '94d8702e-9652-4319-94ff-fc0294ea1b4b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/94d8702e-9652-4319-94ff-fc0294ea1b4b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9e18d747214f4822be3dc7f3bd0a3775', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '94d8702e-9652-4319-94ff-fc0294ea1b4b', 'created_at': datetime.datetime(2026, 8, 10, 13, 48, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 10, 13, 48, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/94d8702e-9652-4319-94ff-fc0294ea1b4b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:11 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b2befcf3-687d-4c6b-864d-1ade5095c1ba tempest-TestShelveInstance-1958992432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c31f9547-392a-43db-909a-bcbb89faea62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:11 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b2befcf3-687d-4c6b-864d-1ade5095c1ba tempest-TestShelveInstance-1958992432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c31f9547-392a-43db-909a-bcbb89faea62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:11 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b2befcf3-687d-4c6b-864d-1ade5095c1ba tempest-TestShelveInstance-1958992432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc36cced-c041-462c-a966-8be591b6216a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:11 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-b2befcf3-687d-4c6b-864d-1ade5095c1ba tempest-TestShelveInstance-1958992432 None] Volume 240f4272-f60e-42a3-9240-e677fd927ddc: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-240f4272-f60e-42a3-9240-e677fd927ddc', 'volume_size': 1, 'image_id': '94d8702e-9652-4319-94ff-fc0294ea1b4b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/94d8702e-9652-4319-94ff-fc0294ea1b4b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9e18d747214f4822be3dc7f3bd0a3775', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '94d8702e-9652-4319-94ff-fc0294ea1b4b', 'created_at': datetime.datetime(2026, 8, 10, 13, 48, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 10, 13, 48, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/94d8702e-9652-4319-94ff-fc0294ea1b4b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 10 16:04:11 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2befcf3-687d-4c6b-864d-1ade5095c1ba tempest-TestShelveInstance-1958992432 None] Trying to clone 240f4272-f60e-42a3-9240-e677fd927ddc from image 94d8702e-9652-4319-94ff-fc0294ea1b4b at location (None, [{'url': 'file:///opt/stack/data/glance/images/94d8702e-9652-4319-94ff-fc0294ea1b4b', 'metadata': {}}]). {{(pid=88641) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 10 16:04:11 devstack cinder-volume[88641]: DEBUG cinder.image.image_utils [None req-b2befcf3-687d-4c6b-864d-1ade5095c1ba tempest-TestShelveInstance-1958992432 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_94d8702e-9652-4319-94ff-fc0294ea1b4b_z0q0j1iidevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88641) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 10 16:04:11 devstack cinder-volume[88641]: INFO cinder.image.image_utils [None req-b2befcf3-687d-4c6b-864d-1ade5095c1ba tempest-TestShelveInstance-1958992432 None] Image download 20.69 MB at 20.69 MB/s Aug 10 16:04:12 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[26af6bae-b141-46db-b03b-a3add1f747e1]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:04:12 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b2befcf3-687d-4c6b-864d-1ade5095c1ba tempest-TestShelveInstance-1958992432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94d8702e-9652-4319-94ff-fc0294ea1b4b_z0q0j1iidevstack@QuobyteHD {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:12 devstack sudo[100140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94d8702e-9652-4319-94ff-fc0294ea1b4b_z0q0j1iidevstack@QuobyteHD Aug 10 16:04:12 devstack sudo[100140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:12 devstack sudo[100140]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:12 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b2befcf3-687d-4c6b-864d-1ade5095c1ba tempest-TestShelveInstance-1958992432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94d8702e-9652-4319-94ff-fc0294ea1b4b_z0q0j1iidevstack@QuobyteHD" returned: 0 in 0.425s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:12 devstack cinder-volume[88641]: DEBUG cinder.image.image_utils [None req-b2befcf3-687d-4c6b-864d-1ade5095c1ba tempest-TestShelveInstance-1958992432 None] Temporary image 94d8702e-9652-4319-94ff-fc0294ea1b4b is fetched for user 895746ac56444c10b17a290156d17c5f. {{(pid=88641) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 10 16:04:12 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb956711-0cd3-4f9f-9784-ea99bc309ce4]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:04:12 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b2befcf3-687d-4c6b-864d-1ade5095c1ba tempest-TestShelveInstance-1958992432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94d8702e-9652-4319-94ff-fc0294ea1b4b_z0q0j1iidevstack@QuobyteHD {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:12 devstack sudo[100146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94d8702e-9652-4319-94ff-fc0294ea1b4b_z0q0j1iidevstack@QuobyteHD Aug 10 16:04:12 devstack sudo[100146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:13 devstack sudo[100146]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:13 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b2befcf3-687d-4c6b-864d-1ade5095c1ba tempest-TestShelveInstance-1958992432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94d8702e-9652-4319-94ff-fc0294ea1b4b_z0q0j1iidevstack@QuobyteHD" returned: 0 in 0.426s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:13 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-b2befcf3-687d-4c6b-864d-1ade5095c1ba tempest-TestShelveInstance-1958992432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:04:13 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-b2befcf3-687d-4c6b-864d-1ade5095c1ba tempest-TestShelveInstance-1958992432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:04:13 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-b2befcf3-687d-4c6b-864d-1ade5095c1ba tempest-TestShelveInstance-1958992432 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:04:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1264641022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=240f4272-f60e-42a3-9240-e677fd927ddc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='353efb40c95740ae9a4ff48e64caece6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:04:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:04:10Z,use_quota=True,user_id='895746ac56444c10b17a290156d17c5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:04:13 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-b2befcf3-687d-4c6b-864d-1ade5095c1ba tempest-TestShelveInstance-1958992432 None] Creating volume 240f4272-f60e-42a3-9240-e677fd927ddc {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:04:13 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-b2befcf3-687d-4c6b-864d-1ade5095c1ba tempest-TestShelveInstance-1958992432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:04:13 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-b2befcf3-687d-4c6b-864d-1ade5095c1ba tempest-TestShelveInstance-1958992432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:04:13 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-b2befcf3-687d-4c6b-864d-1ade5095c1ba tempest-TestShelveInstance-1958992432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:04:13 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-b2befcf3-687d-4c6b-864d-1ade5095c1ba tempest-TestShelveInstance-1958992432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:04:13 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-b2befcf3-687d-4c6b-864d-1ade5095c1ba tempest-TestShelveInstance-1958992432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:04:13 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-b2befcf3-687d-4c6b-864d-1ade5095c1ba tempest-TestShelveInstance-1958992432 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:04:13 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-b2befcf3-687d-4c6b-864d-1ade5095c1ba tempest-TestShelveInstance-1958992432 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:04:13 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b2befcf3-687d-4c6b-864d-1ade5095c1ba tempest-TestShelveInstance-1958992432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-240f4272-f60e-42a3-9240-e677fd927ddc 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:13 devstack sudo[100152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-240f4272-f60e-42a3-9240-e677fd927ddc 1073741824 Aug 10 16:04:13 devstack sudo[100152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:13 devstack sudo[100152]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:13 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b2befcf3-687d-4c6b-864d-1ade5095c1ba tempest-TestShelveInstance-1958992432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-240f4272-f60e-42a3-9240-e677fd927ddc 1073741824" returned: 0 in 0.490s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:13 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b2befcf3-687d-4c6b-864d-1ade5095c1ba tempest-TestShelveInstance-1958992432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-240f4272-f60e-42a3-9240-e677fd927ddc {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:13 devstack sudo[100158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-240f4272-f60e-42a3-9240-e677fd927ddc Aug 10 16:04:13 devstack sudo[100158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:13 devstack sudo[100158]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:13 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b2befcf3-687d-4c6b-864d-1ade5095c1ba tempest-TestShelveInstance-1958992432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-240f4272-f60e-42a3-9240-e677fd927ddc" returned: 0 in 0.324s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:13 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-b2befcf3-687d-4c6b-864d-1ade5095c1ba tempest-TestShelveInstance-1958992432 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:04:13 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-b2befcf3-687d-4c6b-864d-1ade5095c1ba tempest-TestShelveInstance-1958992432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:04:14 devstack cinder-volume[88641]: DEBUG cinder.volume.volume_utils [None req-b2befcf3-687d-4c6b-864d-1ade5095c1ba tempest-TestShelveInstance-1958992432 None] Attempting download of 94d8702e-9652-4319-94ff-fc0294ea1b4b ((None, [{'url': 'file:///opt/stack/data/glance/images/94d8702e-9652-4319-94ff-fc0294ea1b4b', 'metadata': {}}])) to volume 240f4272-f60e-42a3-9240-e677fd927ddc. {{(pid=88641) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 10 16:04:14 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a766f1d-bac2-4cf8-87fa-bb00e0db616d]: (4, 'raw') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:04:14 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b2befcf3-687d-4c6b-864d-1ade5095c1ba tempest-TestShelveInstance-1958992432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_94d8702e-9652-4319-94ff-fc0294ea1b4b_dskdwdcy {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:14 devstack sudo[100161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_94d8702e-9652-4319-94ff-fc0294ea1b4b_dskdwdcy Aug 10 16:04:14 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-229fdc6d-9f25-42f8-9e6c-74feb1b66c01 tempest-CreateVolumesFromImageTest-1615511721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:04:14 devstack sudo[100161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:14 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-229fdc6d-9f25-42f8-9e6c-74feb1b66c01 tempest-CreateVolumesFromImageTest-1615511721 None] Flow 'volume_create_manager' (b65f506b-3906-4dbe-8017-87f48aa84ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:04:14 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-229fdc6d-9f25-42f8-9e6c-74feb1b66c01 tempest-CreateVolumesFromImageTest-1615511721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96767c9f-3bb0-4894-8b97-442fb64b5fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:14 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-229fdc6d-9f25-42f8-9e6c-74feb1b66c01 tempest-CreateVolumesFromImageTest-1615511721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96767c9f-3bb0-4894-8b97-442fb64b5fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:04:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-365038919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f7b8b4e-6feb-406f-bb0a-df4be7d007fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0345ba8bb994ff9a7fd9ef83d6d8391',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:04:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:04:14Z,use_quota=True,user_id='7888ddd8a5794843945f25bb5b61adf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:14 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-229fdc6d-9f25-42f8-9e6c-74feb1b66c01 tempest-CreateVolumesFromImageTest-1615511721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f18955d3-0035-4b5e-8c24-e3ddb68351a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:14 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-229fdc6d-9f25-42f8-9e6c-74feb1b66c01 tempest-CreateVolumesFromImageTest-1615511721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f18955d3-0035-4b5e-8c24-e3ddb68351a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:14 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-229fdc6d-9f25-42f8-9e6c-74feb1b66c01 tempest-CreateVolumesFromImageTest-1615511721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb983769-56e4-47b8-ba58-41618000e552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:14 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-229fdc6d-9f25-42f8-9e6c-74feb1b66c01 tempest-CreateVolumesFromImageTest-1615511721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb983769-56e4-47b8-ba58-41618000e552) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f7b8b4e-6feb-406f-bb0a-df4be7d007fe', 'volume_name': 'volume-9f7b8b4e-6feb-406f-bb0a-df4be7d007fe', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:14 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-229fdc6d-9f25-42f8-9e6c-74feb1b66c01 tempest-CreateVolumesFromImageTest-1615511721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a270923d-4986-4677-ad45-cc59fae9693a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:14 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-229fdc6d-9f25-42f8-9e6c-74feb1b66c01 tempest-CreateVolumesFromImageTest-1615511721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a270923d-4986-4677-ad45-cc59fae9693a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:14 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-229fdc6d-9f25-42f8-9e6c-74feb1b66c01 tempest-CreateVolumesFromImageTest-1615511721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (839432b8-0861-4cd7-81e5-48d8846e8562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:14 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-229fdc6d-9f25-42f8-9e6c-74feb1b66c01 tempest-CreateVolumesFromImageTest-1615511721 None] Volume 9f7b8b4e-6feb-406f-bb0a-df4be7d007fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f7b8b4e-6feb-406f-bb0a-df4be7d007fe', 'volume_size': 1} Aug 10 16:04:14 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-229fdc6d-9f25-42f8-9e6c-74feb1b66c01 tempest-CreateVolumesFromImageTest-1615511721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:04:14 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-229fdc6d-9f25-42f8-9e6c-74feb1b66c01 tempest-CreateVolumesFromImageTest-1615511721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:04:14 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-229fdc6d-9f25-42f8-9e6c-74feb1b66c01 tempest-CreateVolumesFromImageTest-1615511721 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:04:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-365038919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f7b8b4e-6feb-406f-bb0a-df4be7d007fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0345ba8bb994ff9a7fd9ef83d6d8391',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:04:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:04:14Z,use_quota=True,user_id='7888ddd8a5794843945f25bb5b61adf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:04:14 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-229fdc6d-9f25-42f8-9e6c-74feb1b66c01 tempest-CreateVolumesFromImageTest-1615511721 None] Creating volume 9f7b8b4e-6feb-406f-bb0a-df4be7d007fe {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:04:14 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-229fdc6d-9f25-42f8-9e6c-74feb1b66c01 tempest-CreateVolumesFromImageTest-1615511721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:04:14 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-229fdc6d-9f25-42f8-9e6c-74feb1b66c01 tempest-CreateVolumesFromImageTest-1615511721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:04:14 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-229fdc6d-9f25-42f8-9e6c-74feb1b66c01 tempest-CreateVolumesFromImageTest-1615511721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:04:14 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-229fdc6d-9f25-42f8-9e6c-74feb1b66c01 tempest-CreateVolumesFromImageTest-1615511721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:04:14 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-229fdc6d-9f25-42f8-9e6c-74feb1b66c01 tempest-CreateVolumesFromImageTest-1615511721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:04:14 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-229fdc6d-9f25-42f8-9e6c-74feb1b66c01 tempest-CreateVolumesFromImageTest-1615511721 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:04:14 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-229fdc6d-9f25-42f8-9e6c-74feb1b66c01 tempest-CreateVolumesFromImageTest-1615511721 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:04:14 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-229fdc6d-9f25-42f8-9e6c-74feb1b66c01 tempest-CreateVolumesFromImageTest-1615511721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9f7b8b4e-6feb-406f-bb0a-df4be7d007fe 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:14 devstack sudo[100163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9f7b8b4e-6feb-406f-bb0a-df4be7d007fe 1073741824 Aug 10 16:04:14 devstack sudo[100163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:14 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-43912130-e7c9-4ca7-900c-30e802cdb216 tempest-VolumesTransfersV355Test-1677236538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:04:14 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-43912130-e7c9-4ca7-900c-30e802cdb216 tempest-VolumesTransfersV355Test-1677236538 None] Flow 'volume_create_manager' (5f6c1c56-3884-4ad7-9cd8-7d869782d635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:04:14 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-43912130-e7c9-4ca7-900c-30e802cdb216 tempest-VolumesTransfersV355Test-1677236538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88a3a758-ca30-48c3-a14e-1bdd528559b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:14 devstack sudo[100161]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:14 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b2befcf3-687d-4c6b-864d-1ade5095c1ba tempest-TestShelveInstance-1958992432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_94d8702e-9652-4319-94ff-fc0294ea1b4b_dskdwdcy" returned: 0 in 0.690s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:14 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b2befcf3-687d-4c6b-864d-1ade5095c1ba tempest-TestShelveInstance-1958992432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_94d8702e-9652-4319-94ff-fc0294ea1b4b_dskdwdcy {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:14 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-43912130-e7c9-4ca7-900c-30e802cdb216 tempest-VolumesTransfersV355Test-1677236538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88a3a758-ca30-48c3-a14e-1bdd528559b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:04:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1569067621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d9d936c-0e3a-464e-88cc-4fe8d2da24cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='968147adb23d4e59a32f2139b9cb840b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:04:15Z,use_quota=True,user_id='97ab090a54344d9e8a7ce6e8ad6de638',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:14 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-43912130-e7c9-4ca7-900c-30e802cdb216 tempest-VolumesTransfersV355Test-1677236538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cafaed3b-781f-4d27-9eb3-e6864a888f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:14 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-43912130-e7c9-4ca7-900c-30e802cdb216 tempest-VolumesTransfersV355Test-1677236538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cafaed3b-781f-4d27-9eb3-e6864a888f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:14 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-43912130-e7c9-4ca7-900c-30e802cdb216 tempest-VolumesTransfersV355Test-1677236538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (461e9b66-d558-4155-bcad-3a91b9c094b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:14 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-43912130-e7c9-4ca7-900c-30e802cdb216 tempest-VolumesTransfersV355Test-1677236538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (461e9b66-d558-4155-bcad-3a91b9c094b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d9d936c-0e3a-464e-88cc-4fe8d2da24cc', 'volume_name': 'volume-3d9d936c-0e3a-464e-88cc-4fe8d2da24cc', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:14 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-43912130-e7c9-4ca7-900c-30e802cdb216 tempest-VolumesTransfersV355Test-1677236538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee9c3bee-a45b-4a6f-9035-3b71f1047e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:14 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-43912130-e7c9-4ca7-900c-30e802cdb216 tempest-VolumesTransfersV355Test-1677236538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee9c3bee-a45b-4a6f-9035-3b71f1047e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:14 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-43912130-e7c9-4ca7-900c-30e802cdb216 tempest-VolumesTransfersV355Test-1677236538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abd714b3-13c1-4483-8ee2-223516e72bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:14 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-43912130-e7c9-4ca7-900c-30e802cdb216 tempest-VolumesTransfersV355Test-1677236538 None] Volume 3d9d936c-0e3a-464e-88cc-4fe8d2da24cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d9d936c-0e3a-464e-88cc-4fe8d2da24cc', 'volume_size': 1} Aug 10 16:04:14 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-43912130-e7c9-4ca7-900c-30e802cdb216 tempest-VolumesTransfersV355Test-1677236538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:04:14 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-439d7643-e094-4882-8f58-c1d82e5f09e3 tempest-CreateVolumesFromImageTest-1615511721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:04:15 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-439d7643-e094-4882-8f58-c1d82e5f09e3 tempest-CreateVolumesFromImageTest-1615511721 None] Flow 'volume_create_manager' (1f7ba85b-e257-4837-8cca-ac74aa6d612b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:04:15 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-439d7643-e094-4882-8f58-c1d82e5f09e3 tempest-CreateVolumesFromImageTest-1615511721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f3e1488-d030-4078-998f-c936b1be4cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:15 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-439d7643-e094-4882-8f58-c1d82e5f09e3 tempest-CreateVolumesFromImageTest-1615511721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f3e1488-d030-4078-998f-c936b1be4cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:04:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2064927745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64454666-c100-4c85-989e-7da483a01be0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0345ba8bb994ff9a7fd9ef83d6d8391',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:04:15Z,use_quota=True,user_id='7888ddd8a5794843945f25bb5b61adf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:15 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-439d7643-e094-4882-8f58-c1d82e5f09e3 tempest-CreateVolumesFromImageTest-1615511721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ef7d8a6-84f5-41d8-8c9b-57a05413af5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:15 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-439d7643-e094-4882-8f58-c1d82e5f09e3 tempest-CreateVolumesFromImageTest-1615511721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ef7d8a6-84f5-41d8-8c9b-57a05413af5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:15 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-439d7643-e094-4882-8f58-c1d82e5f09e3 tempest-CreateVolumesFromImageTest-1615511721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d2b3bf2-426f-4a66-b4af-7b385486a1d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:15 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-439d7643-e094-4882-8f58-c1d82e5f09e3 tempest-CreateVolumesFromImageTest-1615511721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d2b3bf2-426f-4a66-b4af-7b385486a1d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64454666-c100-4c85-989e-7da483a01be0', 'volume_name': 'volume-64454666-c100-4c85-989e-7da483a01be0', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:15 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-439d7643-e094-4882-8f58-c1d82e5f09e3 tempest-CreateVolumesFromImageTest-1615511721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73a7fd2a-6177-440e-a1cb-4213f2e11c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:15 devstack sudo[100170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_94d8702e-9652-4319-94ff-fc0294ea1b4b_dskdwdcy Aug 10 16:04:15 devstack sudo[100170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:15 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-439d7643-e094-4882-8f58-c1d82e5f09e3 tempest-CreateVolumesFromImageTest-1615511721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73a7fd2a-6177-440e-a1cb-4213f2e11c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:15 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-439d7643-e094-4882-8f58-c1d82e5f09e3 tempest-CreateVolumesFromImageTest-1615511721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31d06854-6597-4949-a5b4-519a3c61b64e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:15 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-439d7643-e094-4882-8f58-c1d82e5f09e3 tempest-CreateVolumesFromImageTest-1615511721 None] Volume 64454666-c100-4c85-989e-7da483a01be0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64454666-c100-4c85-989e-7da483a01be0', 'volume_size': 1} Aug 10 16:04:15 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-439d7643-e094-4882-8f58-c1d82e5f09e3 tempest-CreateVolumesFromImageTest-1615511721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:04:15 devstack sudo[100163]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:15 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-229fdc6d-9f25-42f8-9e6c-74feb1b66c01 tempest-CreateVolumesFromImageTest-1615511721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9f7b8b4e-6feb-406f-bb0a-df4be7d007fe 1073741824" returned: 0 in 0.692s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:15 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-229fdc6d-9f25-42f8-9e6c-74feb1b66c01 tempest-CreateVolumesFromImageTest-1615511721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9f7b8b4e-6feb-406f-bb0a-df4be7d007fe {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:15 devstack sudo[100172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9f7b8b4e-6feb-406f-bb0a-df4be7d007fe Aug 10 16:04:15 devstack sudo[100172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:15 devstack sudo[100170]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:15 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b2befcf3-687d-4c6b-864d-1ade5095c1ba tempest-TestShelveInstance-1958992432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_94d8702e-9652-4319-94ff-fc0294ea1b4b_dskdwdcy" returned: 1 in 0.593s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:15 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b2befcf3-687d-4c6b-864d-1ade5095c1ba tempest-TestShelveInstance-1958992432 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_94d8702e-9652-4319-94ff-fc0294ea1b4b_dskdwdcy' failed. Not Retrying. {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 10 16:04:15 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[170d97ae-c369-4ec7-8885-a3a9285367a5]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:04:15 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b2befcf3-687d-4c6b-864d-1ade5095c1ba tempest-TestShelveInstance-1958992432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94d8702e-9652-4319-94ff-fc0294ea1b4b_z0q0j1iidevstack@QuobyteHD {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:15 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8913aac-d1d9-4db7-b603-a4747668fc24 tempest-CreateVolumesFromImageTest-1615511721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:04:15 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c8913aac-d1d9-4db7-b603-a4747668fc24 tempest-CreateVolumesFromImageTest-1615511721 None] Flow 'volume_create_manager' (3b0042a0-2d7f-4c06-afe3-c14445431ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:04:15 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c8913aac-d1d9-4db7-b603-a4747668fc24 tempest-CreateVolumesFromImageTest-1615511721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (037e7bf8-264f-4258-8dee-59fb1551dcdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:15 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c8913aac-d1d9-4db7-b603-a4747668fc24 tempest-CreateVolumesFromImageTest-1615511721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (037e7bf8-264f-4258-8dee-59fb1551dcdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:04:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1393055958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78d95808-d55a-4b93-92c3-1278f18f7975,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0345ba8bb994ff9a7fd9ef83d6d8391',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:04:15Z,use_quota=True,user_id='7888ddd8a5794843945f25bb5b61adf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:15 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c8913aac-d1d9-4db7-b603-a4747668fc24 tempest-CreateVolumesFromImageTest-1615511721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa7b2894-6a79-4a50-938d-95ec846bc877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:15 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c8913aac-d1d9-4db7-b603-a4747668fc24 tempest-CreateVolumesFromImageTest-1615511721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa7b2894-6a79-4a50-938d-95ec846bc877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:15 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c8913aac-d1d9-4db7-b603-a4747668fc24 tempest-CreateVolumesFromImageTest-1615511721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb262646-e25e-464f-b3d5-fec4d1cf0490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:15 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c8913aac-d1d9-4db7-b603-a4747668fc24 tempest-CreateVolumesFromImageTest-1615511721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb262646-e25e-464f-b3d5-fec4d1cf0490) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78d95808-d55a-4b93-92c3-1278f18f7975', 'volume_name': 'volume-78d95808-d55a-4b93-92c3-1278f18f7975', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:15 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c8913aac-d1d9-4db7-b603-a4747668fc24 tempest-CreateVolumesFromImageTest-1615511721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbd1cc39-e754-4051-b3b4-373d4e7310ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:15 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c8913aac-d1d9-4db7-b603-a4747668fc24 tempest-CreateVolumesFromImageTest-1615511721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbd1cc39-e754-4051-b3b4-373d4e7310ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:15 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c8913aac-d1d9-4db7-b603-a4747668fc24 tempest-CreateVolumesFromImageTest-1615511721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bb99fbf-a571-425b-9859-09ee1e4f21d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:15 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-c8913aac-d1d9-4db7-b603-a4747668fc24 tempest-CreateVolumesFromImageTest-1615511721 None] Volume 78d95808-d55a-4b93-92c3-1278f18f7975: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78d95808-d55a-4b93-92c3-1278f18f7975', 'volume_size': 1} Aug 10 16:04:15 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-c8913aac-d1d9-4db7-b603-a4747668fc24 tempest-CreateVolumesFromImageTest-1615511721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:04:15 devstack sudo[100176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94d8702e-9652-4319-94ff-fc0294ea1b4b_z0q0j1iidevstack@QuobyteHD Aug 10 16:04:15 devstack sudo[100176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:15 devstack sudo[100172]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:15 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-229fdc6d-9f25-42f8-9e6c-74feb1b66c01 tempest-CreateVolumesFromImageTest-1615511721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9f7b8b4e-6feb-406f-bb0a-df4be7d007fe" returned: 0 in 0.481s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:15 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-229fdc6d-9f25-42f8-9e6c-74feb1b66c01 tempest-CreateVolumesFromImageTest-1615511721 None] <== create_volume: return (1270ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:04:15 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-229fdc6d-9f25-42f8-9e6c-74feb1b66c01 tempest-CreateVolumesFromImageTest-1615511721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.275s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:04:15 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-43912130-e7c9-4ca7-900c-30e802cdb216 tempest-VolumesTransfersV355Test-1677236538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.793s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:04:15 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-43912130-e7c9-4ca7-900c-30e802cdb216 tempest-VolumesTransfersV355Test-1677236538 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:04:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1569067621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d9d936c-0e3a-464e-88cc-4fe8d2da24cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='968147adb23d4e59a32f2139b9cb840b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:04:15Z,use_quota=True,user_id='97ab090a54344d9e8a7ce6e8ad6de638',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:04:15 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-43912130-e7c9-4ca7-900c-30e802cdb216 tempest-VolumesTransfersV355Test-1677236538 None] Creating volume 3d9d936c-0e3a-464e-88cc-4fe8d2da24cc {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:04:15 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-43912130-e7c9-4ca7-900c-30e802cdb216 tempest-VolumesTransfersV355Test-1677236538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:04:15 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-43912130-e7c9-4ca7-900c-30e802cdb216 tempest-VolumesTransfersV355Test-1677236538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:04:15 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-43912130-e7c9-4ca7-900c-30e802cdb216 tempest-VolumesTransfersV355Test-1677236538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:04:15 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-43912130-e7c9-4ca7-900c-30e802cdb216 tempest-VolumesTransfersV355Test-1677236538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:04:15 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-43912130-e7c9-4ca7-900c-30e802cdb216 tempest-VolumesTransfersV355Test-1677236538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:04:15 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-43912130-e7c9-4ca7-900c-30e802cdb216 tempest-VolumesTransfersV355Test-1677236538 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:04:15 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-43912130-e7c9-4ca7-900c-30e802cdb216 tempest-VolumesTransfersV355Test-1677236538 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:04:15 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-43912130-e7c9-4ca7-900c-30e802cdb216 tempest-VolumesTransfersV355Test-1677236538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3d9d936c-0e3a-464e-88cc-4fe8d2da24cc 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:15 devstack sudo[100179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3d9d936c-0e3a-464e-88cc-4fe8d2da24cc 1073741824 Aug 10 16:04:15 devstack sudo[100179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:15 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-229fdc6d-9f25-42f8-9e6c-74feb1b66c01 tempest-CreateVolumesFromImageTest-1615511721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (839432b8-0861-4cd7-81e5-48d8846e8562) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f7b8b4e-6feb-406f-bb0a-df4be7d007fe', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:15 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-229fdc6d-9f25-42f8-9e6c-74feb1b66c01 tempest-CreateVolumesFromImageTest-1615511721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f54ed2f-f299-4119-ba3d-722eeb617c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:15 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-229fdc6d-9f25-42f8-9e6c-74feb1b66c01 tempest-CreateVolumesFromImageTest-1615511721 None] Volume volume-9f7b8b4e-6feb-406f-bb0a-df4be7d007fe (9f7b8b4e-6feb-406f-bb0a-df4be7d007fe): created successfully Aug 10 16:04:15 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-229fdc6d-9f25-42f8-9e6c-74feb1b66c01 tempest-CreateVolumesFromImageTest-1615511721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f54ed2f-f299-4119-ba3d-722eeb617c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:15 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-229fdc6d-9f25-42f8-9e6c-74feb1b66c01 tempest-CreateVolumesFromImageTest-1615511721 None] Flow 'volume_create_manager' (b65f506b-3906-4dbe-8017-87f48aa84ba3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:04:15 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-229fdc6d-9f25-42f8-9e6c-74feb1b66c01 tempest-CreateVolumesFromImageTest-1615511721 None] Created volume successfully. Aug 10 16:04:16 devstack sudo[100176]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:16 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b2befcf3-687d-4c6b-864d-1ade5095c1ba tempest-TestShelveInstance-1958992432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94d8702e-9652-4319-94ff-fc0294ea1b4b_z0q0j1iidevstack@QuobyteHD" returned: 0 in 0.624s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:16 devstack cinder-volume[88641]: DEBUG cinder.image.image_utils [None req-b2befcf3-687d-4c6b-864d-1ade5095c1ba tempest-TestShelveInstance-1958992432 None] 94d8702e-9652-4319-94ff-fc0294ea1b4b was qcow2, converting to qcow2 {{(pid=88641) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 10 16:04:16 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b2befcf3-687d-4c6b-864d-1ade5095c1ba tempest-TestShelveInstance-1958992432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_94d8702e-9652-4319-94ff-fc0294ea1b4b_z0q0j1iidevstack@QuobyteHD /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-240f4272-f60e-42a3-9240-e677fd927ddc {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:16 devstack sudo[100184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_94d8702e-9652-4319-94ff-fc0294ea1b4b_z0q0j1iidevstack@QuobyteHD /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-240f4272-f60e-42a3-9240-e677fd927ddc Aug 10 16:04:16 devstack sudo[100184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:16 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-6417d1e8-efd0-4f74-94b5-aeee2ece5ce6 tempest-CreateVolumesFromImageTest-1615511721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:04:16 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-6417d1e8-efd0-4f74-94b5-aeee2ece5ce6 tempest-CreateVolumesFromImageTest-1615511721 None] Flow 'volume_create_manager' (b3946978-efee-46a5-bc17-332fd2741bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:04:16 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-6417d1e8-efd0-4f74-94b5-aeee2ece5ce6 tempest-CreateVolumesFromImageTest-1615511721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65b5cb98-e2dd-4b65-88e4-2e040269e65e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:16 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-6417d1e8-efd0-4f74-94b5-aeee2ece5ce6 tempest-CreateVolumesFromImageTest-1615511721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65b5cb98-e2dd-4b65-88e4-2e040269e65e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:04:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2127115578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3bab69c-e24b-4cb7-8dcc-81123cac0e2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0345ba8bb994ff9a7fd9ef83d6d8391',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:04:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:04:16Z,use_quota=True,user_id='7888ddd8a5794843945f25bb5b61adf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:16 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-6417d1e8-efd0-4f74-94b5-aeee2ece5ce6 tempest-CreateVolumesFromImageTest-1615511721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af148a6d-06c2-41aa-aafa-71b82e7f1f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:16 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-6417d1e8-efd0-4f74-94b5-aeee2ece5ce6 tempest-CreateVolumesFromImageTest-1615511721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af148a6d-06c2-41aa-aafa-71b82e7f1f77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:16 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-6417d1e8-efd0-4f74-94b5-aeee2ece5ce6 tempest-CreateVolumesFromImageTest-1615511721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbc3844a-a0aa-4047-bf72-57b35cb0e038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:16 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-6417d1e8-efd0-4f74-94b5-aeee2ece5ce6 tempest-CreateVolumesFromImageTest-1615511721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbc3844a-a0aa-4047-bf72-57b35cb0e038) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3bab69c-e24b-4cb7-8dcc-81123cac0e2c', 'volume_name': 'volume-d3bab69c-e24b-4cb7-8dcc-81123cac0e2c', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:16 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-6417d1e8-efd0-4f74-94b5-aeee2ece5ce6 tempest-CreateVolumesFromImageTest-1615511721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ecb2608-3606-45d9-b341-1ce32b40af2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:16 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-6417d1e8-efd0-4f74-94b5-aeee2ece5ce6 tempest-CreateVolumesFromImageTest-1615511721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ecb2608-3606-45d9-b341-1ce32b40af2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:16 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-6417d1e8-efd0-4f74-94b5-aeee2ece5ce6 tempest-CreateVolumesFromImageTest-1615511721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3ecea34-3e56-4c59-8873-35a4c56df506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:16 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-6417d1e8-efd0-4f74-94b5-aeee2ece5ce6 tempest-CreateVolumesFromImageTest-1615511721 None] Volume d3bab69c-e24b-4cb7-8dcc-81123cac0e2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3bab69c-e24b-4cb7-8dcc-81123cac0e2c', 'volume_size': 1} Aug 10 16:04:16 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-6417d1e8-efd0-4f74-94b5-aeee2ece5ce6 tempest-CreateVolumesFromImageTest-1615511721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:04:16 devstack sudo[100179]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:16 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-43912130-e7c9-4ca7-900c-30e802cdb216 tempest-VolumesTransfersV355Test-1677236538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3d9d936c-0e3a-464e-88cc-4fe8d2da24cc 1073741824" returned: 0 in 0.785s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:16 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-43912130-e7c9-4ca7-900c-30e802cdb216 tempest-VolumesTransfersV355Test-1677236538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3d9d936c-0e3a-464e-88cc-4fe8d2da24cc {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:16 devstack sudo[100194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3d9d936c-0e3a-464e-88cc-4fe8d2da24cc Aug 10 16:04:16 devstack sudo[100194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:16 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a138b09-3815-43f3-becd-d93270829c84 tempest-CreateVolumesFromImageTest-1615511721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:04:16 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-4a138b09-3815-43f3-becd-d93270829c84 tempest-CreateVolumesFromImageTest-1615511721 None] Flow 'volume_create_manager' (fcc43676-ba7f-4d76-9277-8a528e6ae3c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:04:16 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-4a138b09-3815-43f3-becd-d93270829c84 tempest-CreateVolumesFromImageTest-1615511721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (186de849-71b8-4f16-9671-f027d3268e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:16 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-4a138b09-3815-43f3-becd-d93270829c84 tempest-CreateVolumesFromImageTest-1615511721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (186de849-71b8-4f16-9671-f027d3268e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:04:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-881052007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71d14e3c-9dfc-477a-a885-2430803cd794,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0345ba8bb994ff9a7fd9ef83d6d8391',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:04:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:04:17Z,use_quota=True,user_id='7888ddd8a5794843945f25bb5b61adf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:16 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-4a138b09-3815-43f3-becd-d93270829c84 tempest-CreateVolumesFromImageTest-1615511721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53228836-3039-4790-b108-38f32827baa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:16 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-4a138b09-3815-43f3-becd-d93270829c84 tempest-CreateVolumesFromImageTest-1615511721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53228836-3039-4790-b108-38f32827baa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:16 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-4a138b09-3815-43f3-becd-d93270829c84 tempest-CreateVolumesFromImageTest-1615511721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07cb4443-8d86-4c8b-b5d1-1aa2d9ba8461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:16 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-4a138b09-3815-43f3-becd-d93270829c84 tempest-CreateVolumesFromImageTest-1615511721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07cb4443-8d86-4c8b-b5d1-1aa2d9ba8461) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71d14e3c-9dfc-477a-a885-2430803cd794', 'volume_name': 'volume-71d14e3c-9dfc-477a-a885-2430803cd794', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:16 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-4a138b09-3815-43f3-becd-d93270829c84 tempest-CreateVolumesFromImageTest-1615511721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff5a2289-cef5-4dbf-bccf-868c4b855b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:16 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-4a138b09-3815-43f3-becd-d93270829c84 tempest-CreateVolumesFromImageTest-1615511721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff5a2289-cef5-4dbf-bccf-868c4b855b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:16 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-4a138b09-3815-43f3-becd-d93270829c84 tempest-CreateVolumesFromImageTest-1615511721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e2f70a3-0912-42f4-986b-a23f59b645b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:16 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-4a138b09-3815-43f3-becd-d93270829c84 tempest-CreateVolumesFromImageTest-1615511721 None] Volume 71d14e3c-9dfc-477a-a885-2430803cd794: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71d14e3c-9dfc-477a-a885-2430803cd794', 'volume_size': 1} Aug 10 16:04:16 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-4a138b09-3815-43f3-becd-d93270829c84 tempest-CreateVolumesFromImageTest-1615511721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:04:16 devstack sudo[100194]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:16 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-43912130-e7c9-4ca7-900c-30e802cdb216 tempest-VolumesTransfersV355Test-1677236538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3d9d936c-0e3a-464e-88cc-4fe8d2da24cc" returned: 0 in 0.327s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:16 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-43912130-e7c9-4ca7-900c-30e802cdb216 tempest-VolumesTransfersV355Test-1677236538 None] <== create_volume: return (1208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:04:16 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-43912130-e7c9-4ca7-900c-30e802cdb216 tempest-VolumesTransfersV355Test-1677236538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.212s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:04:16 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-439d7643-e094-4882-8f58-c1d82e5f09e3 tempest-CreateVolumesFromImageTest-1615511721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.861s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:04:16 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-439d7643-e094-4882-8f58-c1d82e5f09e3 tempest-CreateVolumesFromImageTest-1615511721 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:04:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2064927745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64454666-c100-4c85-989e-7da483a01be0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0345ba8bb994ff9a7fd9ef83d6d8391',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:04:15Z,use_quota=True,user_id='7888ddd8a5794843945f25bb5b61adf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:04:16 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-439d7643-e094-4882-8f58-c1d82e5f09e3 tempest-CreateVolumesFromImageTest-1615511721 None] Creating volume 64454666-c100-4c85-989e-7da483a01be0 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:04:16 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-439d7643-e094-4882-8f58-c1d82e5f09e3 tempest-CreateVolumesFromImageTest-1615511721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:04:16 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-439d7643-e094-4882-8f58-c1d82e5f09e3 tempest-CreateVolumesFromImageTest-1615511721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:04:16 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-439d7643-e094-4882-8f58-c1d82e5f09e3 tempest-CreateVolumesFromImageTest-1615511721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:04:16 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-439d7643-e094-4882-8f58-c1d82e5f09e3 tempest-CreateVolumesFromImageTest-1615511721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:04:16 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-439d7643-e094-4882-8f58-c1d82e5f09e3 tempest-CreateVolumesFromImageTest-1615511721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:04:16 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-439d7643-e094-4882-8f58-c1d82e5f09e3 tempest-CreateVolumesFromImageTest-1615511721 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:04:16 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-439d7643-e094-4882-8f58-c1d82e5f09e3 tempest-CreateVolumesFromImageTest-1615511721 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:04:16 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-439d7643-e094-4882-8f58-c1d82e5f09e3 tempest-CreateVolumesFromImageTest-1615511721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-64454666-c100-4c85-989e-7da483a01be0 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:16 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-43912130-e7c9-4ca7-900c-30e802cdb216 tempest-VolumesTransfersV355Test-1677236538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abd714b3-13c1-4483-8ee2-223516e72bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d9d936c-0e3a-464e-88cc-4fe8d2da24cc', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:16 devstack sudo[100219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-64454666-c100-4c85-989e-7da483a01be0 1073741824 Aug 10 16:04:16 devstack sudo[100219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:16 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-43912130-e7c9-4ca7-900c-30e802cdb216 tempest-VolumesTransfersV355Test-1677236538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (685975d2-846e-4dc1-b181-feac7fcf8c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:17 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-43912130-e7c9-4ca7-900c-30e802cdb216 tempest-VolumesTransfersV355Test-1677236538 None] Volume volume-3d9d936c-0e3a-464e-88cc-4fe8d2da24cc (3d9d936c-0e3a-464e-88cc-4fe8d2da24cc): created successfully Aug 10 16:04:17 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-43912130-e7c9-4ca7-900c-30e802cdb216 tempest-VolumesTransfersV355Test-1677236538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (685975d2-846e-4dc1-b181-feac7fcf8c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:17 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-43912130-e7c9-4ca7-900c-30e802cdb216 tempest-VolumesTransfersV355Test-1677236538 None] Flow 'volume_create_manager' (5f6c1c56-3884-4ad7-9cd8-7d869782d635) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:04:17 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-43912130-e7c9-4ca7-900c-30e802cdb216 tempest-VolumesTransfersV355Test-1677236538 None] Created volume successfully. Aug 10 16:04:17 devstack sudo[100219]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-439d7643-e094-4882-8f58-c1d82e5f09e3 tempest-CreateVolumesFromImageTest-1615511721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-64454666-c100-4c85-989e-7da483a01be0 1073741824" returned: 0 in 0.523s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-439d7643-e094-4882-8f58-c1d82e5f09e3 tempest-CreateVolumesFromImageTest-1615511721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-64454666-c100-4c85-989e-7da483a01be0 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:17 devstack sudo[100226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-64454666-c100-4c85-989e-7da483a01be0 Aug 10 16:04:17 devstack sudo[100226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:17 devstack sudo[100226]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-439d7643-e094-4882-8f58-c1d82e5f09e3 tempest-CreateVolumesFromImageTest-1615511721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-64454666-c100-4c85-989e-7da483a01be0" returned: 0 in 0.330s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:17 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-439d7643-e094-4882-8f58-c1d82e5f09e3 tempest-CreateVolumesFromImageTest-1615511721 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:04:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-439d7643-e094-4882-8f58-c1d82e5f09e3 tempest-CreateVolumesFromImageTest-1615511721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:04:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-c8913aac-d1d9-4db7-b603-a4747668fc24 tempest-CreateVolumesFromImageTest-1615511721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.249s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:04:17 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-c8913aac-d1d9-4db7-b603-a4747668fc24 tempest-CreateVolumesFromImageTest-1615511721 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:04:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1393055958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78d95808-d55a-4b93-92c3-1278f18f7975,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0345ba8bb994ff9a7fd9ef83d6d8391',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:04:15Z,use_quota=True,user_id='7888ddd8a5794843945f25bb5b61adf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:04:17 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-c8913aac-d1d9-4db7-b603-a4747668fc24 tempest-CreateVolumesFromImageTest-1615511721 None] Creating volume 78d95808-d55a-4b93-92c3-1278f18f7975 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:04:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-c8913aac-d1d9-4db7-b603-a4747668fc24 tempest-CreateVolumesFromImageTest-1615511721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:04:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-c8913aac-d1d9-4db7-b603-a4747668fc24 tempest-CreateVolumesFromImageTest-1615511721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:04:17 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-c8913aac-d1d9-4db7-b603-a4747668fc24 tempest-CreateVolumesFromImageTest-1615511721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:04:17 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-c8913aac-d1d9-4db7-b603-a4747668fc24 tempest-CreateVolumesFromImageTest-1615511721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:04:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-c8913aac-d1d9-4db7-b603-a4747668fc24 tempest-CreateVolumesFromImageTest-1615511721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:04:17 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-c8913aac-d1d9-4db7-b603-a4747668fc24 tempest-CreateVolumesFromImageTest-1615511721 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:04:17 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-c8913aac-d1d9-4db7-b603-a4747668fc24 tempest-CreateVolumesFromImageTest-1615511721 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:04:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c8913aac-d1d9-4db7-b603-a4747668fc24 tempest-CreateVolumesFromImageTest-1615511721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-78d95808-d55a-4b93-92c3-1278f18f7975 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:17 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-439d7643-e094-4882-8f58-c1d82e5f09e3 tempest-CreateVolumesFromImageTest-1615511721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31d06854-6597-4949-a5b4-519a3c61b64e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64454666-c100-4c85-989e-7da483a01be0', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:17 devstack sudo[100229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-78d95808-d55a-4b93-92c3-1278f18f7975 1073741824 Aug 10 16:04:17 devstack sudo[100229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:17 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-439d7643-e094-4882-8f58-c1d82e5f09e3 tempest-CreateVolumesFromImageTest-1615511721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe970efc-58da-45b6-9454-5a8ee0c18fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:17 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-439d7643-e094-4882-8f58-c1d82e5f09e3 tempest-CreateVolumesFromImageTest-1615511721 None] Volume volume-64454666-c100-4c85-989e-7da483a01be0 (64454666-c100-4c85-989e-7da483a01be0): created successfully Aug 10 16:04:17 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-439d7643-e094-4882-8f58-c1d82e5f09e3 tempest-CreateVolumesFromImageTest-1615511721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe970efc-58da-45b6-9454-5a8ee0c18fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:17 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-439d7643-e094-4882-8f58-c1d82e5f09e3 tempest-CreateVolumesFromImageTest-1615511721 None] Flow 'volume_create_manager' (1f7ba85b-e257-4837-8cca-ac74aa6d612b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:04:17 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-439d7643-e094-4882-8f58-c1d82e5f09e3 tempest-CreateVolumesFromImageTest-1615511721 None] Created volume successfully. Aug 10 16:04:18 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-ad481a74-c22d-4b57-a9d6-a9cd009c5cfd tempest-VolumesTransfersV355Test-869687926 None] Transfer volume completed successfully. Aug 10 16:04:18 devstack sudo[100184]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:18 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b2befcf3-687d-4c6b-864d-1ade5095c1ba tempest-TestShelveInstance-1958992432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_94d8702e-9652-4319-94ff-fc0294ea1b4b_z0q0j1iidevstack@QuobyteHD /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-240f4272-f60e-42a3-9240-e677fd927ddc" returned: 0 in 2.217s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:18 devstack cinder-volume[88641]: DEBUG cinder.image.image_utils [None req-b2befcf3-687d-4c6b-864d-1ade5095c1ba tempest-TestShelveInstance-1958992432 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_94d8702e-9652-4319-94ff-fc0294ea1b4b_z0q0j1iidevstack@QuobyteHD, size 112.00 MB, duration 2.22 sec, destination /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-240f4272-f60e-42a3-9240-e677fd927ddc {{(pid=88641) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 10 16:04:18 devstack cinder-volume[88641]: INFO cinder.image.image_utils [None req-b2befcf3-687d-4c6b-864d-1ade5095c1ba tempest-TestShelveInstance-1958992432 None] Converted 112.00 MB image at 50.48 MB/s Aug 10 16:04:18 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b2befcf3-687d-4c6b-864d-1ade5095c1ba tempest-TestShelveInstance-1958992432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-240f4272-f60e-42a3-9240-e677fd927ddc 1G {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:18 devstack sudo[100235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-240f4272-f60e-42a3-9240-e677fd927ddc 1G Aug 10 16:04:18 devstack sudo[100235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:18 devstack sudo[100229]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:18 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c8913aac-d1d9-4db7-b603-a4747668fc24 tempest-CreateVolumesFromImageTest-1615511721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-78d95808-d55a-4b93-92c3-1278f18f7975 1073741824" returned: 0 in 0.533s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:18 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c8913aac-d1d9-4db7-b603-a4747668fc24 tempest-CreateVolumesFromImageTest-1615511721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-78d95808-d55a-4b93-92c3-1278f18f7975 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:18 devstack sudo[100237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-78d95808-d55a-4b93-92c3-1278f18f7975 Aug 10 16:04:18 devstack sudo[100237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:18 devstack sudo[100235]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:18 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b2befcf3-687d-4c6b-864d-1ade5095c1ba tempest-TestShelveInstance-1958992432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-240f4272-f60e-42a3-9240-e677fd927ddc 1G" returned: 0 in 0.416s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:18 devstack cinder-volume[88641]: DEBUG cinder.volume.volume_utils [None req-b2befcf3-687d-4c6b-864d-1ade5095c1ba tempest-TestShelveInstance-1958992432 None] Downloaded image 94d8702e-9652-4319-94ff-fc0294ea1b4b ((None, [{'url': 'file:///opt/stack/data/glance/images/94d8702e-9652-4319-94ff-fc0294ea1b4b', 'metadata': {}}])) to volume 240f4272-f60e-42a3-9240-e677fd927ddc successfully. {{(pid=88641) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 10 16:04:18 devstack cinder-volume[88641]: DEBUG cinder.image.image_utils [None req-b2befcf3-687d-4c6b-864d-1ade5095c1ba tempest-TestShelveInstance-1958992432 None] Temporary image 94d8702e-9652-4319-94ff-fc0294ea1b4b for user 895746ac56444c10b17a290156d17c5f is deleted. {{(pid=88641) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 10 16:04:18 devstack cinder-volume[88641]: DEBUG cinder.volume.volume_utils [None req-b2befcf3-687d-4c6b-864d-1ade5095c1ba tempest-TestShelveInstance-1958992432 None] Marking volume 240f4272-f60e-42a3-9240-e677fd927ddc as bootable. {{(pid=88641) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 10 16:04:18 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2befcf3-687d-4c6b-864d-1ade5095c1ba tempest-TestShelveInstance-1958992432 None] Copying metadata from image 94d8702e-9652-4319-94ff-fc0294ea1b4b to 240f4272-f60e-42a3-9240-e677fd927ddc. {{(pid=88641) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 10 16:04:18 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2befcf3-687d-4c6b-864d-1ade5095c1ba tempest-TestShelveInstance-1958992432 None] Creating volume glance metadata for volume 240f4272-f60e-42a3-9240-e677fd927ddc backed by image 94d8702e-9652-4319-94ff-fc0294ea1b4b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '94d8702e-9652-4319-94ff-fc0294ea1b4b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88641) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 10 16:04:18 devstack sudo[100237]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:18 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-41ba1652-64e2-4587-909d-a3d5d3abcb38 tempest-VolumesTransfersV355Test-1995437605 None] Acquiring lock "cinder-3d9d936c-0e3a-464e-88cc-4fe8d2da24cc-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:04:18 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c8913aac-d1d9-4db7-b603-a4747668fc24 tempest-CreateVolumesFromImageTest-1615511721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-78d95808-d55a-4b93-92c3-1278f18f7975" returned: 0 in 0.302s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:18 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-c8913aac-d1d9-4db7-b603-a4747668fc24 tempest-CreateVolumesFromImageTest-1615511721 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:04:18 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-c8913aac-d1d9-4db7-b603-a4747668fc24 tempest-CreateVolumesFromImageTest-1615511721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:04:18 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-6417d1e8-efd0-4f74-94b5-aeee2ece5ce6 tempest-CreateVolumesFromImageTest-1615511721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.511s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:04:18 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-6417d1e8-efd0-4f74-94b5-aeee2ece5ce6 tempest-CreateVolumesFromImageTest-1615511721 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:04:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2127115578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3bab69c-e24b-4cb7-8dcc-81123cac0e2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0345ba8bb994ff9a7fd9ef83d6d8391',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:04:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:04:16Z,use_quota=True,user_id='7888ddd8a5794843945f25bb5b61adf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:04:18 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-6417d1e8-efd0-4f74-94b5-aeee2ece5ce6 tempest-CreateVolumesFromImageTest-1615511721 None] Creating volume d3bab69c-e24b-4cb7-8dcc-81123cac0e2c {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:04:18 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-6417d1e8-efd0-4f74-94b5-aeee2ece5ce6 tempest-CreateVolumesFromImageTest-1615511721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:04:18 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-6417d1e8-efd0-4f74-94b5-aeee2ece5ce6 tempest-CreateVolumesFromImageTest-1615511721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:04:18 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-6417d1e8-efd0-4f74-94b5-aeee2ece5ce6 tempest-CreateVolumesFromImageTest-1615511721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:04:18 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-6417d1e8-efd0-4f74-94b5-aeee2ece5ce6 tempest-CreateVolumesFromImageTest-1615511721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:04:18 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-6417d1e8-efd0-4f74-94b5-aeee2ece5ce6 tempest-CreateVolumesFromImageTest-1615511721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:04:18 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-6417d1e8-efd0-4f74-94b5-aeee2ece5ce6 tempest-CreateVolumesFromImageTest-1615511721 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:04:18 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-6417d1e8-efd0-4f74-94b5-aeee2ece5ce6 tempest-CreateVolumesFromImageTest-1615511721 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:04:18 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6417d1e8-efd0-4f74-94b5-aeee2ece5ce6 tempest-CreateVolumesFromImageTest-1615511721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d3bab69c-e24b-4cb7-8dcc-81123cac0e2c 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:18 devstack sudo[100244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d3bab69c-e24b-4cb7-8dcc-81123cac0e2c 1073741824 Aug 10 16:04:18 devstack sudo[100244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:18 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c8913aac-d1d9-4db7-b603-a4747668fc24 tempest-CreateVolumesFromImageTest-1615511721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bb99fbf-a571-425b-9859-09ee1e4f21d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78d95808-d55a-4b93-92c3-1278f18f7975', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:18 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c8913aac-d1d9-4db7-b603-a4747668fc24 tempest-CreateVolumesFromImageTest-1615511721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05279c74-5f19-4d17-97e3-3bb7bbae9ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:18 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-41ba1652-64e2-4587-909d-a3d5d3abcb38 tempest-VolumesTransfersV355Test-1995437605 None] Lock "cinder-3d9d936c-0e3a-464e-88cc-4fe8d2da24cc-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:04:18 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-c8913aac-d1d9-4db7-b603-a4747668fc24 tempest-CreateVolumesFromImageTest-1615511721 None] Volume volume-78d95808-d55a-4b93-92c3-1278f18f7975 (78d95808-d55a-4b93-92c3-1278f18f7975): created successfully Aug 10 16:04:18 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c8913aac-d1d9-4db7-b603-a4747668fc24 tempest-CreateVolumesFromImageTest-1615511721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05279c74-5f19-4d17-97e3-3bb7bbae9ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:18 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c8913aac-d1d9-4db7-b603-a4747668fc24 tempest-CreateVolumesFromImageTest-1615511721 None] Flow 'volume_create_manager' (3b0042a0-2d7f-4c06-afe3-c14445431ad6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:04:18 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-c8913aac-d1d9-4db7-b603-a4747668fc24 tempest-CreateVolumesFromImageTest-1615511721 None] Created volume successfully. Aug 10 16:04:18 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-41ba1652-64e2-4587-909d-a3d5d3abcb38 tempest-VolumesTransfersV355Test-1995437605 None] Acquiring lock "cinder-quobyte-3d9d936c-0e3a-464e-88cc-4fe8d2da24cc" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:04:18 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-41ba1652-64e2-4587-909d-a3d5d3abcb38 tempest-VolumesTransfersV355Test-1995437605 None] Lock "cinder-quobyte-3d9d936c-0e3a-464e-88cc-4fe8d2da24cc" acquired by "delete_volume" :: waited 0.023s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:04:18 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b2befcf3-687d-4c6b-864d-1ade5095c1ba tempest-TestShelveInstance-1958992432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc36cced-c041-462c-a966-8be591b6216a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-240f4272-f60e-42a3-9240-e677fd927ddc', 'volume_size': 1, 'image_id': '94d8702e-9652-4319-94ff-fc0294ea1b4b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/94d8702e-9652-4319-94ff-fc0294ea1b4b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9e18d747214f4822be3dc7f3bd0a3775', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '94d8702e-9652-4319-94ff-fc0294ea1b4b', 'created_at': datetime.datetime(2026, 8, 10, 13, 48, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 10, 13, 48, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/94d8702e-9652-4319-94ff-fc0294ea1b4b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:18 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b2befcf3-687d-4c6b-864d-1ade5095c1ba tempest-TestShelveInstance-1958992432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (997db1aa-1628-4da1-966f-51c1a0aab138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:18 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[31823240-b14b-42ba-a623-4e3f10a922ee]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:04:18 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-41ba1652-64e2-4587-909d-a3d5d3abcb38 tempest-VolumesTransfersV355Test-1995437605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3d9d936c-0e3a-464e-88cc-4fe8d2da24cc {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:18 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-b2befcf3-687d-4c6b-864d-1ade5095c1ba tempest-TestShelveInstance-1958992432 None] Volume volume-240f4272-f60e-42a3-9240-e677fd927ddc (240f4272-f60e-42a3-9240-e677fd927ddc): created successfully Aug 10 16:04:18 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b2befcf3-687d-4c6b-864d-1ade5095c1ba tempest-TestShelveInstance-1958992432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (997db1aa-1628-4da1-966f-51c1a0aab138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:18 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b2befcf3-687d-4c6b-864d-1ade5095c1ba tempest-TestShelveInstance-1958992432 None] Flow 'volume_create_manager' (a531fcc1-f17e-49e0-8e02-7959bd6394cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:04:19 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-b2befcf3-687d-4c6b-864d-1ade5095c1ba tempest-TestShelveInstance-1958992432 None] Created volume successfully. Aug 10 16:04:19 devstack sudo[100246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3d9d936c-0e3a-464e-88cc-4fe8d2da24cc Aug 10 16:04:19 devstack sudo[100246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:19 devstack sudo[100244]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6417d1e8-efd0-4f74-94b5-aeee2ece5ce6 tempest-CreateVolumesFromImageTest-1615511721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d3bab69c-e24b-4cb7-8dcc-81123cac0e2c 1073741824" returned: 0 in 0.441s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6417d1e8-efd0-4f74-94b5-aeee2ece5ce6 tempest-CreateVolumesFromImageTest-1615511721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d3bab69c-e24b-4cb7-8dcc-81123cac0e2c {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:19 devstack sudo[100252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d3bab69c-e24b-4cb7-8dcc-81123cac0e2c Aug 10 16:04:19 devstack sudo[100252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:19 devstack sudo[100246]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-41ba1652-64e2-4587-909d-a3d5d3abcb38 tempest-VolumesTransfersV355Test-1995437605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3d9d936c-0e3a-464e-88cc-4fe8d2da24cc" returned: 0 in 0.394s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-41ba1652-64e2-4587-909d-a3d5d3abcb38 tempest-VolumesTransfersV355Test-1995437605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3d9d936c-0e3a-464e-88cc-4fe8d2da24cc {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:19 devstack sudo[100257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3d9d936c-0e3a-464e-88cc-4fe8d2da24cc Aug 10 16:04:19 devstack sudo[100257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:19 devstack sudo[100252]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6417d1e8-efd0-4f74-94b5-aeee2ece5ce6 tempest-CreateVolumesFromImageTest-1615511721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d3bab69c-e24b-4cb7-8dcc-81123cac0e2c" returned: 0 in 0.262s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:19 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-6417d1e8-efd0-4f74-94b5-aeee2ece5ce6 tempest-CreateVolumesFromImageTest-1615511721 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:04:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-6417d1e8-efd0-4f74-94b5-aeee2ece5ce6 tempest-CreateVolumesFromImageTest-1615511721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:04:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-4a138b09-3815-43f3-becd-d93270829c84 tempest-CreateVolumesFromImageTest-1615511721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.703s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:04:19 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-4a138b09-3815-43f3-becd-d93270829c84 tempest-CreateVolumesFromImageTest-1615511721 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:04:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-881052007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71d14e3c-9dfc-477a-a885-2430803cd794,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0345ba8bb994ff9a7fd9ef83d6d8391',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:04:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:04:17Z,use_quota=True,user_id='7888ddd8a5794843945f25bb5b61adf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:04:19 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-4a138b09-3815-43f3-becd-d93270829c84 tempest-CreateVolumesFromImageTest-1615511721 None] Creating volume 71d14e3c-9dfc-477a-a885-2430803cd794 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:04:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-4a138b09-3815-43f3-becd-d93270829c84 tempest-CreateVolumesFromImageTest-1615511721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:04:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-4a138b09-3815-43f3-becd-d93270829c84 tempest-CreateVolumesFromImageTest-1615511721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:04:19 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-4a138b09-3815-43f3-becd-d93270829c84 tempest-CreateVolumesFromImageTest-1615511721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:04:19 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-4a138b09-3815-43f3-becd-d93270829c84 tempest-CreateVolumesFromImageTest-1615511721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:04:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-4a138b09-3815-43f3-becd-d93270829c84 tempest-CreateVolumesFromImageTest-1615511721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:04:19 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-4a138b09-3815-43f3-becd-d93270829c84 tempest-CreateVolumesFromImageTest-1615511721 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:04:19 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-4a138b09-3815-43f3-becd-d93270829c84 tempest-CreateVolumesFromImageTest-1615511721 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:04:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4a138b09-3815-43f3-becd-d93270829c84 tempest-CreateVolumesFromImageTest-1615511721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-71d14e3c-9dfc-477a-a885-2430803cd794 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:19 devstack sudo[100260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-71d14e3c-9dfc-477a-a885-2430803cd794 1073741824 Aug 10 16:04:19 devstack sudo[100260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:19 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-6417d1e8-efd0-4f74-94b5-aeee2ece5ce6 tempest-CreateVolumesFromImageTest-1615511721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3ecea34-3e56-4c59-8873-35a4c56df506) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3bab69c-e24b-4cb7-8dcc-81123cac0e2c', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:19 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-6417d1e8-efd0-4f74-94b5-aeee2ece5ce6 tempest-CreateVolumesFromImageTest-1615511721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43558e84-334b-444e-bb0d-1cddd0dad4d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:19 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-6417d1e8-efd0-4f74-94b5-aeee2ece5ce6 tempest-CreateVolumesFromImageTest-1615511721 None] Volume volume-d3bab69c-e24b-4cb7-8dcc-81123cac0e2c (d3bab69c-e24b-4cb7-8dcc-81123cac0e2c): created successfully Aug 10 16:04:19 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-6417d1e8-efd0-4f74-94b5-aeee2ece5ce6 tempest-CreateVolumesFromImageTest-1615511721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43558e84-334b-444e-bb0d-1cddd0dad4d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:19 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-6417d1e8-efd0-4f74-94b5-aeee2ece5ce6 tempest-CreateVolumesFromImageTest-1615511721 None] Flow 'volume_create_manager' (b3946978-efee-46a5-bc17-332fd2741bdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:04:19 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-6417d1e8-efd0-4f74-94b5-aeee2ece5ce6 tempest-CreateVolumesFromImageTest-1615511721 None] Created volume successfully. Aug 10 16:04:19 devstack sudo[100257]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-41ba1652-64e2-4587-909d-a3d5d3abcb38 tempest-VolumesTransfersV355Test-1995437605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3d9d936c-0e3a-464e-88cc-4fe8d2da24cc" returned: 0 in 0.282s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:19 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-41ba1652-64e2-4587-909d-a3d5d3abcb38 tempest-VolumesTransfersV355Test-1995437605 None] Lock "cinder-quobyte-3d9d936c-0e3a-464e-88cc-4fe8d2da24cc" released by "delete_volume" :: held 0.737s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:04:19 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-41ba1652-64e2-4587-909d-a3d5d3abcb38 tempest-VolumesTransfersV355Test-1995437605 None] Created reservations ['57ab9ce2-f86e-4f53-bf32-89a42714798e', '38244dbc-6303-4131-a320-c47f16bb117b', 'f6edc34f-4a34-4e00-bbf6-ca3ee326a7e2', 'bec65a64-b7c5-41a6-b857-93a776348da5'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:04:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-41ba1652-64e2-4587-909d-a3d5d3abcb38 tempest-VolumesTransfersV355Test-1995437605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:04:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-41ba1652-64e2-4587-909d-a3d5d3abcb38 tempest-VolumesTransfersV355Test-1995437605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:04:19 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-41ba1652-64e2-4587-909d-a3d5d3abcb38 tempest-VolumesTransfersV355Test-1995437605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:04:19 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-41ba1652-64e2-4587-909d-a3d5d3abcb38 tempest-VolumesTransfersV355Test-1995437605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:04:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-41ba1652-64e2-4587-909d-a3d5d3abcb38 tempest-VolumesTransfersV355Test-1995437605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:04:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-41ba1652-64e2-4587-909d-a3d5d3abcb38 tempest-VolumesTransfersV355Test-1995437605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:19 devstack sudo[100265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:04:19 devstack sudo[100265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:20 devstack sudo[100260]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:20 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4a138b09-3815-43f3-becd-d93270829c84 tempest-CreateVolumesFromImageTest-1615511721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-71d14e3c-9dfc-477a-a885-2430803cd794 1073741824" returned: 0 in 0.585s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:20 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4a138b09-3815-43f3-becd-d93270829c84 tempest-CreateVolumesFromImageTest-1615511721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-71d14e3c-9dfc-477a-a885-2430803cd794 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:20 devstack sudo[100265]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:20 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-41ba1652-64e2-4587-909d-a3d5d3abcb38 tempest-VolumesTransfersV355Test-1995437605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.362s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:20 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-41ba1652-64e2-4587-909d-a3d5d3abcb38 tempest-VolumesTransfersV355Test-1995437605 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:04:20 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-41ba1652-64e2-4587-909d-a3d5d3abcb38 tempest-VolumesTransfersV355Test-1995437605 None] Deleted volume successfully. Aug 10 16:04:20 devstack sudo[100270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-71d14e3c-9dfc-477a-a885-2430803cd794 Aug 10 16:04:20 devstack sudo[100270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:20 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-41ba1652-64e2-4587-909d-a3d5d3abcb38 tempest-VolumesTransfersV355Test-1995437605 None] Lock "cinder-3d9d936c-0e3a-464e-88cc-4fe8d2da24cc-delete_volume" released by "delete_volume" :: held 1.400s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:04:20 devstack sudo[100270]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:20 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4a138b09-3815-43f3-becd-d93270829c84 tempest-CreateVolumesFromImageTest-1615511721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-71d14e3c-9dfc-477a-a885-2430803cd794" returned: 0 in 0.313s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:20 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-4a138b09-3815-43f3-becd-d93270829c84 tempest-CreateVolumesFromImageTest-1615511721 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:04:20 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-4a138b09-3815-43f3-becd-d93270829c84 tempest-CreateVolumesFromImageTest-1615511721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:04:20 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-4a138b09-3815-43f3-becd-d93270829c84 tempest-CreateVolumesFromImageTest-1615511721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e2f70a3-0912-42f4-986b-a23f59b645b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71d14e3c-9dfc-477a-a885-2430803cd794', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:20 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-4a138b09-3815-43f3-becd-d93270829c84 tempest-CreateVolumesFromImageTest-1615511721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb4b02f5-0c42-4981-8050-16667bd9762b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:20 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-4a138b09-3815-43f3-becd-d93270829c84 tempest-CreateVolumesFromImageTest-1615511721 None] Volume volume-71d14e3c-9dfc-477a-a885-2430803cd794 (71d14e3c-9dfc-477a-a885-2430803cd794): created successfully Aug 10 16:04:20 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-4a138b09-3815-43f3-becd-d93270829c84 tempest-CreateVolumesFromImageTest-1615511721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb4b02f5-0c42-4981-8050-16667bd9762b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:20 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-4a138b09-3815-43f3-becd-d93270829c84 tempest-CreateVolumesFromImageTest-1615511721 None] Flow 'volume_create_manager' (fcc43676-ba7f-4d76-9277-8a528e6ae3c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:04:20 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b39adfe-d147-4c04-a9f7-456226421f76 tempest-VolumesTransfersV355Test-1677236538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:04:20 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2b39adfe-d147-4c04-a9f7-456226421f76 tempest-VolumesTransfersV355Test-1677236538 None] Flow 'volume_create_manager' (7f539f85-087b-45a8-99c5-1e5f8ad554d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:04:20 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2b39adfe-d147-4c04-a9f7-456226421f76 tempest-VolumesTransfersV355Test-1677236538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (199c1dc3-e7d6-4c23-951a-82d2e93f3079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:20 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2b39adfe-d147-4c04-a9f7-456226421f76 tempest-VolumesTransfersV355Test-1677236538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (199c1dc3-e7d6-4c23-951a-82d2e93f3079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:04:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-752054412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37a2c5e4-c12d-4eb3-af95-2e2983abf062,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='968147adb23d4e59a32f2139b9cb840b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:04:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:04:20Z,use_quota=True,user_id='97ab090a54344d9e8a7ce6e8ad6de638',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:20 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2b39adfe-d147-4c04-a9f7-456226421f76 tempest-VolumesTransfersV355Test-1677236538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1eb905a-ff9e-4e2d-a4af-e95f5e05042a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:20 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2b39adfe-d147-4c04-a9f7-456226421f76 tempest-VolumesTransfersV355Test-1677236538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1eb905a-ff9e-4e2d-a4af-e95f5e05042a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:20 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2b39adfe-d147-4c04-a9f7-456226421f76 tempest-VolumesTransfersV355Test-1677236538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (993d54b4-0284-4d6e-915c-a0ea54338bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:20 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2b39adfe-d147-4c04-a9f7-456226421f76 tempest-VolumesTransfersV355Test-1677236538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (993d54b4-0284-4d6e-915c-a0ea54338bfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37a2c5e4-c12d-4eb3-af95-2e2983abf062', 'volume_name': 'volume-37a2c5e4-c12d-4eb3-af95-2e2983abf062', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:20 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2b39adfe-d147-4c04-a9f7-456226421f76 tempest-VolumesTransfersV355Test-1677236538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9012336-6130-4f3e-8bc6-6360f71f2940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:20 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2b39adfe-d147-4c04-a9f7-456226421f76 tempest-VolumesTransfersV355Test-1677236538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9012336-6130-4f3e-8bc6-6360f71f2940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:20 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2b39adfe-d147-4c04-a9f7-456226421f76 tempest-VolumesTransfersV355Test-1677236538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa5eb39e-bfc6-45d0-a081-46a697faf0fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:20 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-2b39adfe-d147-4c04-a9f7-456226421f76 tempest-VolumesTransfersV355Test-1677236538 None] Volume 37a2c5e4-c12d-4eb3-af95-2e2983abf062: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37a2c5e4-c12d-4eb3-af95-2e2983abf062', 'volume_size': 1} Aug 10 16:04:20 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-2b39adfe-d147-4c04-a9f7-456226421f76 tempest-VolumesTransfersV355Test-1677236538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:04:20 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-2b39adfe-d147-4c04-a9f7-456226421f76 tempest-VolumesTransfersV355Test-1677236538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:04:20 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-2b39adfe-d147-4c04-a9f7-456226421f76 tempest-VolumesTransfersV355Test-1677236538 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:04:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-752054412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37a2c5e4-c12d-4eb3-af95-2e2983abf062,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='968147adb23d4e59a32f2139b9cb840b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:04:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:04:20Z,use_quota=True,user_id='97ab090a54344d9e8a7ce6e8ad6de638',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:04:20 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-2b39adfe-d147-4c04-a9f7-456226421f76 tempest-VolumesTransfersV355Test-1677236538 None] Creating volume 37a2c5e4-c12d-4eb3-af95-2e2983abf062 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:04:20 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-2b39adfe-d147-4c04-a9f7-456226421f76 tempest-VolumesTransfersV355Test-1677236538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:04:20 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-2b39adfe-d147-4c04-a9f7-456226421f76 tempest-VolumesTransfersV355Test-1677236538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:04:20 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-2b39adfe-d147-4c04-a9f7-456226421f76 tempest-VolumesTransfersV355Test-1677236538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:04:20 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-2b39adfe-d147-4c04-a9f7-456226421f76 tempest-VolumesTransfersV355Test-1677236538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:04:20 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-2b39adfe-d147-4c04-a9f7-456226421f76 tempest-VolumesTransfersV355Test-1677236538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:04:20 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-2b39adfe-d147-4c04-a9f7-456226421f76 tempest-VolumesTransfersV355Test-1677236538 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:04:20 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-2b39adfe-d147-4c04-a9f7-456226421f76 tempest-VolumesTransfersV355Test-1677236538 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:04:20 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-2b39adfe-d147-4c04-a9f7-456226421f76 tempest-VolumesTransfersV355Test-1677236538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-37a2c5e4-c12d-4eb3-af95-2e2983abf062 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:20 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-4a138b09-3815-43f3-becd-d93270829c84 tempest-CreateVolumesFromImageTest-1615511721 None] Created volume successfully. Aug 10 16:04:20 devstack sudo[100273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-37a2c5e4-c12d-4eb3-af95-2e2983abf062 1073741824 Aug 10 16:04:20 devstack sudo[100273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:21 devstack sudo[100273]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:21 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-2b39adfe-d147-4c04-a9f7-456226421f76 tempest-VolumesTransfersV355Test-1677236538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-37a2c5e4-c12d-4eb3-af95-2e2983abf062 1073741824" returned: 0 in 0.483s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:21 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-2b39adfe-d147-4c04-a9f7-456226421f76 tempest-VolumesTransfersV355Test-1677236538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-37a2c5e4-c12d-4eb3-af95-2e2983abf062 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:21 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-0dc7df7e-0fff-4417-b7f5-9519c2f3ca3a tempest-CreateVolumesFromImageTest-1615511721 None] Acquiring lock "cinder-71d14e3c-9dfc-477a-a885-2430803cd794-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:04:21 devstack sudo[100281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-37a2c5e4-c12d-4eb3-af95-2e2983abf062 Aug 10 16:04:21 devstack sudo[100281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:21 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-0dc7df7e-0fff-4417-b7f5-9519c2f3ca3a tempest-CreateVolumesFromImageTest-1615511721 None] Lock "cinder-71d14e3c-9dfc-477a-a885-2430803cd794-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:04:21 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-0dc7df7e-0fff-4417-b7f5-9519c2f3ca3a tempest-CreateVolumesFromImageTest-1615511721 None] Acquiring lock "cinder-quobyte-71d14e3c-9dfc-477a-a885-2430803cd794" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:04:21 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-0dc7df7e-0fff-4417-b7f5-9519c2f3ca3a tempest-CreateVolumesFromImageTest-1615511721 None] Lock "cinder-quobyte-71d14e3c-9dfc-477a-a885-2430803cd794" acquired by "delete_volume" :: waited 0.020s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:04:21 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec23bb02-817f-4127-ada6-1f781776129f]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:04:21 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0dc7df7e-0fff-4417-b7f5-9519c2f3ca3a tempest-CreateVolumesFromImageTest-1615511721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-71d14e3c-9dfc-477a-a885-2430803cd794 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:21 devstack sudo[100281]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:21 devstack sudo[100285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-71d14e3c-9dfc-477a-a885-2430803cd794 Aug 10 16:04:21 devstack sudo[100285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:21 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-2b39adfe-d147-4c04-a9f7-456226421f76 tempest-VolumesTransfersV355Test-1677236538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-37a2c5e4-c12d-4eb3-af95-2e2983abf062" returned: 0 in 0.301s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:21 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-2b39adfe-d147-4c04-a9f7-456226421f76 tempest-VolumesTransfersV355Test-1677236538 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:04:21 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-2b39adfe-d147-4c04-a9f7-456226421f76 tempest-VolumesTransfersV355Test-1677236538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:04:21 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2b39adfe-d147-4c04-a9f7-456226421f76 tempest-VolumesTransfersV355Test-1677236538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa5eb39e-bfc6-45d0-a081-46a697faf0fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37a2c5e4-c12d-4eb3-af95-2e2983abf062', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:21 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2b39adfe-d147-4c04-a9f7-456226421f76 tempest-VolumesTransfersV355Test-1677236538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9796442-62e2-4680-87f3-1c9729123b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:21 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-2b39adfe-d147-4c04-a9f7-456226421f76 tempest-VolumesTransfersV355Test-1677236538 None] Volume volume-37a2c5e4-c12d-4eb3-af95-2e2983abf062 (37a2c5e4-c12d-4eb3-af95-2e2983abf062): created successfully Aug 10 16:04:21 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2b39adfe-d147-4c04-a9f7-456226421f76 tempest-VolumesTransfersV355Test-1677236538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9796442-62e2-4680-87f3-1c9729123b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:21 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2b39adfe-d147-4c04-a9f7-456226421f76 tempest-VolumesTransfersV355Test-1677236538 None] Flow 'volume_create_manager' (7f539f85-087b-45a8-99c5-1e5f8ad554d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:04:21 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-2b39adfe-d147-4c04-a9f7-456226421f76 tempest-VolumesTransfersV355Test-1677236538 None] Created volume successfully. Aug 10 16:04:21 devstack sudo[100285]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:21 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0dc7df7e-0fff-4417-b7f5-9519c2f3ca3a tempest-CreateVolumesFromImageTest-1615511721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-71d14e3c-9dfc-477a-a885-2430803cd794" returned: 0 in 0.437s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:21 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0dc7df7e-0fff-4417-b7f5-9519c2f3ca3a tempest-CreateVolumesFromImageTest-1615511721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-71d14e3c-9dfc-477a-a885-2430803cd794 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:21 devstack sudo[100292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-71d14e3c-9dfc-477a-a885-2430803cd794 Aug 10 16:04:21 devstack sudo[100292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:22 devstack sudo[100292]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0dc7df7e-0fff-4417-b7f5-9519c2f3ca3a tempest-CreateVolumesFromImageTest-1615511721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-71d14e3c-9dfc-477a-a885-2430803cd794" returned: 0 in 0.272s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:22 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-0dc7df7e-0fff-4417-b7f5-9519c2f3ca3a tempest-CreateVolumesFromImageTest-1615511721 None] Lock "cinder-quobyte-71d14e3c-9dfc-477a-a885-2430803cd794" released by "delete_volume" :: held 0.760s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:04:22 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-0dc7df7e-0fff-4417-b7f5-9519c2f3ca3a tempest-CreateVolumesFromImageTest-1615511721 None] Created reservations ['b5ebb9df-4d6b-4ecf-8059-3d14d685aa6a', 'cc91dcd0-57cc-444e-873b-c57896d5be95', 'c2ab82b5-eb7a-45c3-b93c-fc945e65b55d', 'b13fb6f7-c2db-47bd-8edf-cc5820b6d5ae'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:04:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-0dc7df7e-0fff-4417-b7f5-9519c2f3ca3a tempest-CreateVolumesFromImageTest-1615511721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:04:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-0dc7df7e-0fff-4417-b7f5-9519c2f3ca3a tempest-CreateVolumesFromImageTest-1615511721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:04:22 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-0dc7df7e-0fff-4417-b7f5-9519c2f3ca3a tempest-CreateVolumesFromImageTest-1615511721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:04:22 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-0dc7df7e-0fff-4417-b7f5-9519c2f3ca3a tempest-CreateVolumesFromImageTest-1615511721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:04:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-0dc7df7e-0fff-4417-b7f5-9519c2f3ca3a tempest-CreateVolumesFromImageTest-1615511721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:04:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0dc7df7e-0fff-4417-b7f5-9519c2f3ca3a tempest-CreateVolumesFromImageTest-1615511721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:22 devstack sudo[100296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:04:22 devstack sudo[100296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:22 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-936440f6-5000-445e-b6a5-7c5c1b39f80f tempest-CreateVolumesFromImageTest-1615511721 None] Acquiring lock "cinder-d3bab69c-e24b-4cb7-8dcc-81123cac0e2c-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:04:22 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-936440f6-5000-445e-b6a5-7c5c1b39f80f tempest-CreateVolumesFromImageTest-1615511721 None] Lock "cinder-d3bab69c-e24b-4cb7-8dcc-81123cac0e2c-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:04:22 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-936440f6-5000-445e-b6a5-7c5c1b39f80f tempest-CreateVolumesFromImageTest-1615511721 None] Acquiring lock "cinder-quobyte-d3bab69c-e24b-4cb7-8dcc-81123cac0e2c" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:04:22 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-936440f6-5000-445e-b6a5-7c5c1b39f80f tempest-CreateVolumesFromImageTest-1615511721 None] Lock "cinder-quobyte-d3bab69c-e24b-4cb7-8dcc-81123cac0e2c" acquired by "delete_volume" :: waited 0.037s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:04:22 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ee4300-1a6f-4013-921a-157082c46446]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:04:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-936440f6-5000-445e-b6a5-7c5c1b39f80f tempest-CreateVolumesFromImageTest-1615511721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d3bab69c-e24b-4cb7-8dcc-81123cac0e2c {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-6db575a8-7436-4ff2-8282-f2d177881f35 req-24641dae-6405-4b24-ab42-e9003b4c25ee tempest-TestShelveInstance-1958992432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:04:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-6db575a8-7436-4ff2-8282-f2d177881f35 req-24641dae-6405-4b24-ab42-e9003b4c25ee tempest-TestShelveInstance-1958992432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:04:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-6db575a8-7436-4ff2-8282-f2d177881f35 req-24641dae-6405-4b24-ab42-e9003b4c25ee tempest-TestShelveInstance-1958992432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:04:22 devstack sudo[100296]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0dc7df7e-0fff-4417-b7f5-9519c2f3ca3a tempest-CreateVolumesFromImageTest-1615511721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.461s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:22 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-0dc7df7e-0fff-4417-b7f5-9519c2f3ca3a tempest-CreateVolumesFromImageTest-1615511721 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:04:22 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-0dc7df7e-0fff-4417-b7f5-9519c2f3ca3a tempest-CreateVolumesFromImageTest-1615511721 None] Deleted volume successfully. Aug 10 16:04:22 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [req-6db575a8-7436-4ff2-8282-f2d177881f35 req-24641dae-6405-4b24-ab42-e9003b4c25ee tempest-TestShelveInstance-1958992432 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc', 'name': 'volume-240f4272-f60e-42a3-9240-e677fd927ddc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ee033960-66b9-4199-af26-0559e683c6e8', 'enforce_multipath': True} {{(pid=88641) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 10 16:04:22 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-0dc7df7e-0fff-4417-b7f5-9519c2f3ca3a tempest-CreateVolumesFromImageTest-1615511721 None] Lock "cinder-71d14e3c-9dfc-477a-a885-2430803cd794-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:04:22 devstack sudo[100307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d3bab69c-e24b-4cb7-8dcc-81123cac0e2c Aug 10 16:04:22 devstack sudo[100307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:22 devstack cinder-volume[88641]: INFO cinder.volume.manager [req-6db575a8-7436-4ff2-8282-f2d177881f35 req-24641dae-6405-4b24-ab42-e9003b4c25ee tempest-TestShelveInstance-1958992432 None] attachment_update completed successfully. Aug 10 16:04:23 devstack sudo[100307]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:23 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-2add4b83-e679-44a4-a889-8e1870fa7ee3 tempest-VolumesTransfersV355Test-1995437605 None] Acquiring lock "cinder-37a2c5e4-c12d-4eb3-af95-2e2983abf062-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:04:23 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-936440f6-5000-445e-b6a5-7c5c1b39f80f tempest-CreateVolumesFromImageTest-1615511721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d3bab69c-e24b-4cb7-8dcc-81123cac0e2c" returned: 0 in 0.606s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:23 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-936440f6-5000-445e-b6a5-7c5c1b39f80f tempest-CreateVolumesFromImageTest-1615511721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d3bab69c-e24b-4cb7-8dcc-81123cac0e2c {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:23 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-2add4b83-e679-44a4-a889-8e1870fa7ee3 tempest-VolumesTransfersV355Test-1995437605 None] Lock "cinder-37a2c5e4-c12d-4eb3-af95-2e2983abf062-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:04:23 devstack sudo[100312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d3bab69c-e24b-4cb7-8dcc-81123cac0e2c Aug 10 16:04:23 devstack sudo[100312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:23 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-2add4b83-e679-44a4-a889-8e1870fa7ee3 tempest-VolumesTransfersV355Test-1995437605 None] Acquiring lock "cinder-quobyte-37a2c5e4-c12d-4eb3-af95-2e2983abf062" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:04:23 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-2add4b83-e679-44a4-a889-8e1870fa7ee3 tempest-VolumesTransfersV355Test-1995437605 None] Lock "cinder-quobyte-37a2c5e4-c12d-4eb3-af95-2e2983abf062" acquired by "delete_volume" :: waited 0.017s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:04:23 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[568193e7-01da-4463-a3ab-f1e74cb46e9d]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:04:23 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-2add4b83-e679-44a4-a889-8e1870fa7ee3 tempest-VolumesTransfersV355Test-1995437605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-37a2c5e4-c12d-4eb3-af95-2e2983abf062 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:23 devstack sudo[100314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-37a2c5e4-c12d-4eb3-af95-2e2983abf062 Aug 10 16:04:23 devstack sudo[100314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:23 devstack sudo[100312]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:23 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-936440f6-5000-445e-b6a5-7c5c1b39f80f tempest-CreateVolumesFromImageTest-1615511721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d3bab69c-e24b-4cb7-8dcc-81123cac0e2c" returned: 0 in 0.326s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:23 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-936440f6-5000-445e-b6a5-7c5c1b39f80f tempest-CreateVolumesFromImageTest-1615511721 None] Lock "cinder-quobyte-d3bab69c-e24b-4cb7-8dcc-81123cac0e2c" released by "delete_volume" :: held 1.022s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:04:23 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-936440f6-5000-445e-b6a5-7c5c1b39f80f tempest-CreateVolumesFromImageTest-1615511721 None] Created reservations ['f2145339-df5f-4240-844b-c77d07be663e', 'd90cae92-19cf-4cb1-bad6-97f1d4ee3999', '448b5096-3ded-42c8-af18-29a6af899d83', 'c81f1f29-3c7f-4aaa-a766-2495794d05d8'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:04:23 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-936440f6-5000-445e-b6a5-7c5c1b39f80f tempest-CreateVolumesFromImageTest-1615511721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:04:23 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-936440f6-5000-445e-b6a5-7c5c1b39f80f tempest-CreateVolumesFromImageTest-1615511721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:04:23 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-936440f6-5000-445e-b6a5-7c5c1b39f80f tempest-CreateVolumesFromImageTest-1615511721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:04:23 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-936440f6-5000-445e-b6a5-7c5c1b39f80f tempest-CreateVolumesFromImageTest-1615511721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:04:23 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-936440f6-5000-445e-b6a5-7c5c1b39f80f tempest-CreateVolumesFromImageTest-1615511721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:04:23 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-936440f6-5000-445e-b6a5-7c5c1b39f80f tempest-CreateVolumesFromImageTest-1615511721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:23 devstack sudo[100319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:04:23 devstack sudo[100319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:23 devstack sudo[100314]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:23 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-2add4b83-e679-44a4-a889-8e1870fa7ee3 tempest-VolumesTransfersV355Test-1995437605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-37a2c5e4-c12d-4eb3-af95-2e2983abf062" returned: 0 in 0.445s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:23 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-2add4b83-e679-44a4-a889-8e1870fa7ee3 tempest-VolumesTransfersV355Test-1995437605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-37a2c5e4-c12d-4eb3-af95-2e2983abf062 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:23 devstack sudo[100323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-37a2c5e4-c12d-4eb3-af95-2e2983abf062 Aug 10 16:04:23 devstack sudo[100323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:23 devstack sudo[100319]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:23 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-936440f6-5000-445e-b6a5-7c5c1b39f80f tempest-CreateVolumesFromImageTest-1615511721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.274s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:23 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-936440f6-5000-445e-b6a5-7c5c1b39f80f tempest-CreateVolumesFromImageTest-1615511721 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:04:24 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-936440f6-5000-445e-b6a5-7c5c1b39f80f tempest-CreateVolumesFromImageTest-1615511721 None] Deleted volume successfully. Aug 10 16:04:24 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-936440f6-5000-445e-b6a5-7c5c1b39f80f tempest-CreateVolumesFromImageTest-1615511721 None] Lock "cinder-d3bab69c-e24b-4cb7-8dcc-81123cac0e2c-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:04:24 devstack sudo[100323]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:24 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-2add4b83-e679-44a4-a889-8e1870fa7ee3 tempest-VolumesTransfersV355Test-1995437605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-37a2c5e4-c12d-4eb3-af95-2e2983abf062" returned: 0 in 0.286s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:24 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-2add4b83-e679-44a4-a889-8e1870fa7ee3 tempest-VolumesTransfersV355Test-1995437605 None] Lock "cinder-quobyte-37a2c5e4-c12d-4eb3-af95-2e2983abf062" released by "delete_volume" :: held 0.781s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:04:24 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-2add4b83-e679-44a4-a889-8e1870fa7ee3 tempest-VolumesTransfersV355Test-1995437605 None] Created reservations ['54c37eb2-ab21-4da8-9ddf-e50d2c6bb6e0', 'd1cb6a85-fd10-4e48-af2f-e9233209e1d5', '1086361d-d4a5-453f-96bc-04d93aa37b9b', 'c40ad084-dc68-42c7-ad87-2569c3f0ea7c'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:04:24 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-2add4b83-e679-44a4-a889-8e1870fa7ee3 tempest-VolumesTransfersV355Test-1995437605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:04:24 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-2add4b83-e679-44a4-a889-8e1870fa7ee3 tempest-VolumesTransfersV355Test-1995437605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:04:24 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-2add4b83-e679-44a4-a889-8e1870fa7ee3 tempest-VolumesTransfersV355Test-1995437605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:04:24 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-2add4b83-e679-44a4-a889-8e1870fa7ee3 tempest-VolumesTransfersV355Test-1995437605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:04:24 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-2add4b83-e679-44a4-a889-8e1870fa7ee3 tempest-VolumesTransfersV355Test-1995437605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:04:24 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-2add4b83-e679-44a4-a889-8e1870fa7ee3 tempest-VolumesTransfersV355Test-1995437605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:24 devstack sudo[100327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:04:24 devstack sudo[100327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:24 devstack sudo[100327]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:24 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-2add4b83-e679-44a4-a889-8e1870fa7ee3 tempest-VolumesTransfersV355Test-1995437605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.279s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:24 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-2add4b83-e679-44a4-a889-8e1870fa7ee3 tempest-VolumesTransfersV355Test-1995437605 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:04:24 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-2add4b83-e679-44a4-a889-8e1870fa7ee3 tempest-VolumesTransfersV355Test-1995437605 None] Deleted volume successfully. Aug 10 16:04:24 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-2add4b83-e679-44a4-a889-8e1870fa7ee3 tempest-VolumesTransfersV355Test-1995437605 None] Lock "cinder-37a2c5e4-c12d-4eb3-af95-2e2983abf062-delete_volume" released by "delete_volume" :: held 1.330s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:04:24 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-29250ba2-c94c-4cc9-9923-244961d86e99 tempest-CreateVolumesFromImageTest-1615511721 None] Acquiring lock "cinder-78d95808-d55a-4b93-92c3-1278f18f7975-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:04:24 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-29250ba2-c94c-4cc9-9923-244961d86e99 tempest-CreateVolumesFromImageTest-1615511721 None] Lock "cinder-78d95808-d55a-4b93-92c3-1278f18f7975-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:04:24 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-29250ba2-c94c-4cc9-9923-244961d86e99 tempest-CreateVolumesFromImageTest-1615511721 None] Acquiring lock "cinder-quobyte-78d95808-d55a-4b93-92c3-1278f18f7975" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:04:24 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-29250ba2-c94c-4cc9-9923-244961d86e99 tempest-CreateVolumesFromImageTest-1615511721 None] Lock "cinder-quobyte-78d95808-d55a-4b93-92c3-1278f18f7975" acquired by "delete_volume" :: waited 0.020s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:04:25 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[f85f9695-7587-43ad-a2db-6dd74be40c4e]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:04:25 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-29250ba2-c94c-4cc9-9923-244961d86e99 tempest-CreateVolumesFromImageTest-1615511721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-78d95808-d55a-4b93-92c3-1278f18f7975 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:25 devstack sudo[100331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-78d95808-d55a-4b93-92c3-1278f18f7975 Aug 10 16:04:25 devstack sudo[100331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:25 devstack sudo[100331]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:25 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-29250ba2-c94c-4cc9-9923-244961d86e99 tempest-CreateVolumesFromImageTest-1615511721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-78d95808-d55a-4b93-92c3-1278f18f7975" returned: 0 in 0.669s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:25 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-29250ba2-c94c-4cc9-9923-244961d86e99 tempest-CreateVolumesFromImageTest-1615511721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-78d95808-d55a-4b93-92c3-1278f18f7975 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:25 devstack sudo[100403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-78d95808-d55a-4b93-92c3-1278f18f7975 Aug 10 16:04:25 devstack sudo[100403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:26 devstack sudo[100403]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:26 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-29250ba2-c94c-4cc9-9923-244961d86e99 tempest-CreateVolumesFromImageTest-1615511721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-78d95808-d55a-4b93-92c3-1278f18f7975" returned: 0 in 0.634s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:26 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-29250ba2-c94c-4cc9-9923-244961d86e99 tempest-CreateVolumesFromImageTest-1615511721 None] Lock "cinder-quobyte-78d95808-d55a-4b93-92c3-1278f18f7975" released by "delete_volume" :: held 1.376s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:04:26 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-29250ba2-c94c-4cc9-9923-244961d86e99 tempest-CreateVolumesFromImageTest-1615511721 None] Created reservations ['80f88955-b2e2-4139-b842-415550a834a1', 'ec8d2335-7b87-4bd7-a9ba-96fb3b312c31', '0df64580-f9e1-4d12-be8c-71c2e0c0bb73', '96d3c4b0-c57e-4785-a892-515ed2775db6'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:04:26 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-29250ba2-c94c-4cc9-9923-244961d86e99 tempest-CreateVolumesFromImageTest-1615511721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:04:26 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-29250ba2-c94c-4cc9-9923-244961d86e99 tempest-CreateVolumesFromImageTest-1615511721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:04:26 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-29250ba2-c94c-4cc9-9923-244961d86e99 tempest-CreateVolumesFromImageTest-1615511721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:04:26 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-29250ba2-c94c-4cc9-9923-244961d86e99 tempest-CreateVolumesFromImageTest-1615511721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:04:26 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-29250ba2-c94c-4cc9-9923-244961d86e99 tempest-CreateVolumesFromImageTest-1615511721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:04:26 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-29250ba2-c94c-4cc9-9923-244961d86e99 tempest-CreateVolumesFromImageTest-1615511721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:26 devstack sudo[100756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:04:26 devstack sudo[100756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:27 devstack sudo[100756]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:27 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-29250ba2-c94c-4cc9-9923-244961d86e99 tempest-CreateVolumesFromImageTest-1615511721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.498s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:27 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-29250ba2-c94c-4cc9-9923-244961d86e99 tempest-CreateVolumesFromImageTest-1615511721 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:04:27 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-29250ba2-c94c-4cc9-9923-244961d86e99 tempest-CreateVolumesFromImageTest-1615511721 None] Deleted volume successfully. Aug 10 16:04:27 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-29250ba2-c94c-4cc9-9923-244961d86e99 tempest-CreateVolumesFromImageTest-1615511721 None] Lock "cinder-78d95808-d55a-4b93-92c3-1278f18f7975-delete_volume" released by "delete_volume" :: held 2.377s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:04:27 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-e054da42-c718-4730-9804-eb1e84dbf3fb tempest-CreateVolumesFromImageTest-1615511721 None] Acquiring lock "cinder-64454666-c100-4c85-989e-7da483a01be0-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:04:27 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-e054da42-c718-4730-9804-eb1e84dbf3fb tempest-CreateVolumesFromImageTest-1615511721 None] Lock "cinder-64454666-c100-4c85-989e-7da483a01be0-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:04:27 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-e054da42-c718-4730-9804-eb1e84dbf3fb tempest-CreateVolumesFromImageTest-1615511721 None] Acquiring lock "cinder-quobyte-64454666-c100-4c85-989e-7da483a01be0" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:04:27 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-e054da42-c718-4730-9804-eb1e84dbf3fb tempest-CreateVolumesFromImageTest-1615511721 None] Lock "cinder-quobyte-64454666-c100-4c85-989e-7da483a01be0" acquired by "delete_volume" :: waited 0.026s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:04:27 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ddaf2c-c6c0-482b-8000-e249fdc0971a]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:04:27 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e054da42-c718-4730-9804-eb1e84dbf3fb tempest-CreateVolumesFromImageTest-1615511721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-64454666-c100-4c85-989e-7da483a01be0 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:27 devstack sudo[100783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-64454666-c100-4c85-989e-7da483a01be0 Aug 10 16:04:27 devstack sudo[100783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:27 devstack sudo[100783]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:27 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e054da42-c718-4730-9804-eb1e84dbf3fb tempest-CreateVolumesFromImageTest-1615511721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-64454666-c100-4c85-989e-7da483a01be0" returned: 0 in 0.440s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:27 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e054da42-c718-4730-9804-eb1e84dbf3fb tempest-CreateVolumesFromImageTest-1615511721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-64454666-c100-4c85-989e-7da483a01be0 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:28 devstack sudo[100801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-64454666-c100-4c85-989e-7da483a01be0 Aug 10 16:04:28 devstack sudo[100801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:28 devstack sudo[100801]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:28 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e054da42-c718-4730-9804-eb1e84dbf3fb tempest-CreateVolumesFromImageTest-1615511721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-64454666-c100-4c85-989e-7da483a01be0" returned: 0 in 0.287s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:28 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-e054da42-c718-4730-9804-eb1e84dbf3fb tempest-CreateVolumesFromImageTest-1615511721 None] Lock "cinder-quobyte-64454666-c100-4c85-989e-7da483a01be0" released by "delete_volume" :: held 0.780s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:04:28 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-e054da42-c718-4730-9804-eb1e84dbf3fb tempest-CreateVolumesFromImageTest-1615511721 None] Created reservations ['f96949cd-4cf5-4e8e-acb7-67b644d84617', '803a01b2-627d-48e0-9146-bab203b392ef', '66aa62bc-306b-4bb2-b07c-31deccb57d92', '0d5ce63f-775c-4dfa-8a19-58a5c5a340b6'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:04:28 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-e054da42-c718-4730-9804-eb1e84dbf3fb tempest-CreateVolumesFromImageTest-1615511721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:04:28 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-e054da42-c718-4730-9804-eb1e84dbf3fb tempest-CreateVolumesFromImageTest-1615511721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:04:28 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-e054da42-c718-4730-9804-eb1e84dbf3fb tempest-CreateVolumesFromImageTest-1615511721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:04:28 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-e054da42-c718-4730-9804-eb1e84dbf3fb tempest-CreateVolumesFromImageTest-1615511721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:04:28 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-e054da42-c718-4730-9804-eb1e84dbf3fb tempest-CreateVolumesFromImageTest-1615511721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:04:28 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e054da42-c718-4730-9804-eb1e84dbf3fb tempest-CreateVolumesFromImageTest-1615511721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:28 devstack sudo[100810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:04:28 devstack sudo[100810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:28 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-a59f5394-0197-40c7-a21a-2eb3b4680978 tempest-CreateVolumesFromImageTest-1615511721 None] Acquiring lock "cinder-9f7b8b4e-6feb-406f-bb0a-df4be7d007fe-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:04:28 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-a59f5394-0197-40c7-a21a-2eb3b4680978 tempest-CreateVolumesFromImageTest-1615511721 None] Lock "cinder-9f7b8b4e-6feb-406f-bb0a-df4be7d007fe-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:04:28 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-a59f5394-0197-40c7-a21a-2eb3b4680978 tempest-CreateVolumesFromImageTest-1615511721 None] Acquiring lock "cinder-quobyte-9f7b8b4e-6feb-406f-bb0a-df4be7d007fe" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:04:28 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-a59f5394-0197-40c7-a21a-2eb3b4680978 tempest-CreateVolumesFromImageTest-1615511721 None] Lock "cinder-quobyte-9f7b8b4e-6feb-406f-bb0a-df4be7d007fe" acquired by "delete_volume" :: waited 0.031s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:04:28 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c581c92-3b75-4eb2-85c7-d5497d1b5c93]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:04:28 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a59f5394-0197-40c7-a21a-2eb3b4680978 tempest-CreateVolumesFromImageTest-1615511721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9f7b8b4e-6feb-406f-bb0a-df4be7d007fe {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:28 devstack sudo[100810]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:28 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e054da42-c718-4730-9804-eb1e84dbf3fb tempest-CreateVolumesFromImageTest-1615511721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.366s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:28 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-e054da42-c718-4730-9804-eb1e84dbf3fb tempest-CreateVolumesFromImageTest-1615511721 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:04:28 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-e054da42-c718-4730-9804-eb1e84dbf3fb tempest-CreateVolumesFromImageTest-1615511721 None] Deleted volume successfully. Aug 10 16:04:28 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-e054da42-c718-4730-9804-eb1e84dbf3fb tempest-CreateVolumesFromImageTest-1615511721 None] Lock "cinder-64454666-c100-4c85-989e-7da483a01be0-delete_volume" released by "delete_volume" :: held 1.541s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:04:29 devstack sudo[100812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9f7b8b4e-6feb-406f-bb0a-df4be7d007fe Aug 10 16:04:29 devstack sudo[100812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:29 devstack sudo[100812]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:29 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a59f5394-0197-40c7-a21a-2eb3b4680978 tempest-CreateVolumesFromImageTest-1615511721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9f7b8b4e-6feb-406f-bb0a-df4be7d007fe" returned: 0 in 0.756s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:29 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a59f5394-0197-40c7-a21a-2eb3b4680978 tempest-CreateVolumesFromImageTest-1615511721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9f7b8b4e-6feb-406f-bb0a-df4be7d007fe {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:29 devstack sudo[100820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9f7b8b4e-6feb-406f-bb0a-df4be7d007fe Aug 10 16:04:29 devstack sudo[100820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:29 devstack sudo[100820]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:29 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a59f5394-0197-40c7-a21a-2eb3b4680978 tempest-CreateVolumesFromImageTest-1615511721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9f7b8b4e-6feb-406f-bb0a-df4be7d007fe" returned: 0 in 0.288s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:29 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-a59f5394-0197-40c7-a21a-2eb3b4680978 tempest-CreateVolumesFromImageTest-1615511721 None] Lock "cinder-quobyte-9f7b8b4e-6feb-406f-bb0a-df4be7d007fe" released by "delete_volume" :: held 1.102s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:04:30 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-a59f5394-0197-40c7-a21a-2eb3b4680978 tempest-CreateVolumesFromImageTest-1615511721 None] Created reservations ['2d3ef3ff-cac3-441c-96b3-40f570a1a7cb', '223668fe-2f28-4de3-850c-71519fcb694c', '4e094353-a4e5-448d-8dcd-bf4db33c55b0', 'c3c2d7ce-c4d8-44d1-9f62-3e7c12a48259'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:04:30 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-a59f5394-0197-40c7-a21a-2eb3b4680978 tempest-CreateVolumesFromImageTest-1615511721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:04:30 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-a59f5394-0197-40c7-a21a-2eb3b4680978 tempest-CreateVolumesFromImageTest-1615511721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:04:30 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-a59f5394-0197-40c7-a21a-2eb3b4680978 tempest-CreateVolumesFromImageTest-1615511721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:04:30 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-a59f5394-0197-40c7-a21a-2eb3b4680978 tempest-CreateVolumesFromImageTest-1615511721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:04:30 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-a59f5394-0197-40c7-a21a-2eb3b4680978 tempest-CreateVolumesFromImageTest-1615511721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:04:30 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a59f5394-0197-40c7-a21a-2eb3b4680978 tempest-CreateVolumesFromImageTest-1615511721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:30 devstack sudo[100823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:04:30 devstack sudo[100823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:30 devstack sudo[100823]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:30 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a59f5394-0197-40c7-a21a-2eb3b4680978 tempest-CreateVolumesFromImageTest-1615511721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.285s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:30 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-a59f5394-0197-40c7-a21a-2eb3b4680978 tempest-CreateVolumesFromImageTest-1615511721 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:04:30 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-a59f5394-0197-40c7-a21a-2eb3b4680978 tempest-CreateVolumesFromImageTest-1615511721 None] Deleted volume successfully. Aug 10 16:04:30 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-a59f5394-0197-40c7-a21a-2eb3b4680978 tempest-CreateVolumesFromImageTest-1615511721 None] Lock "cinder-9f7b8b4e-6feb-406f-bb0a-df4be7d007fe-delete_volume" released by "delete_volume" :: held 1.680s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:04:31 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-7eeee0b1-627a-46f7-a74a-da9390b93a93 tempest-AttachVolumeTestJSON-1986652723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:04:31 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-7eeee0b1-627a-46f7-a74a-da9390b93a93 tempest-AttachVolumeTestJSON-1986652723 None] Flow 'volume_create_manager' (221360a3-c61c-456a-ab36-3c35a78e8278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:04:32 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-7eeee0b1-627a-46f7-a74a-da9390b93a93 tempest-AttachVolumeTestJSON-1986652723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eb8a01d-0108-4ef1-91c4-6e297df416b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:32 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-7eeee0b1-627a-46f7-a74a-da9390b93a93 tempest-AttachVolumeTestJSON-1986652723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eb8a01d-0108-4ef1-91c4-6e297df416b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:04:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-380884792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7168e1a7-078a-4fb0-bf43-ee40aa6774e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc33fe4b7ee34471b4438bd107c7a225',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:04:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:04:32Z,use_quota=True,user_id='daca380af8ab42918d1d1f5815ed4f3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:32 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-7eeee0b1-627a-46f7-a74a-da9390b93a93 tempest-AttachVolumeTestJSON-1986652723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ad8e376-ca13-4b33-bb80-113670fa9eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:32 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-7eeee0b1-627a-46f7-a74a-da9390b93a93 tempest-AttachVolumeTestJSON-1986652723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ad8e376-ca13-4b33-bb80-113670fa9eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:32 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-7eeee0b1-627a-46f7-a74a-da9390b93a93 tempest-AttachVolumeTestJSON-1986652723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ba9eebf-6ed4-4ba3-bc50-718939232c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:32 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-7eeee0b1-627a-46f7-a74a-da9390b93a93 tempest-AttachVolumeTestJSON-1986652723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ba9eebf-6ed4-4ba3-bc50-718939232c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7168e1a7-078a-4fb0-bf43-ee40aa6774e2', 'volume_name': 'volume-7168e1a7-078a-4fb0-bf43-ee40aa6774e2', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:32 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-7eeee0b1-627a-46f7-a74a-da9390b93a93 tempest-AttachVolumeTestJSON-1986652723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b735e1c-d37c-4e04-8c13-32d05238077b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:32 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-7eeee0b1-627a-46f7-a74a-da9390b93a93 tempest-AttachVolumeTestJSON-1986652723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b735e1c-d37c-4e04-8c13-32d05238077b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:32 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-7eeee0b1-627a-46f7-a74a-da9390b93a93 tempest-AttachVolumeTestJSON-1986652723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d0ccdc7-960d-49f7-9f59-3954638b5bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:32 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-7eeee0b1-627a-46f7-a74a-da9390b93a93 tempest-AttachVolumeTestJSON-1986652723 None] Volume 7168e1a7-078a-4fb0-bf43-ee40aa6774e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7168e1a7-078a-4fb0-bf43-ee40aa6774e2', 'volume_size': 1} Aug 10 16:04:32 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-7eeee0b1-627a-46f7-a74a-da9390b93a93 tempest-AttachVolumeTestJSON-1986652723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:04:32 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-7eeee0b1-627a-46f7-a74a-da9390b93a93 tempest-AttachVolumeTestJSON-1986652723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:04:32 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-7eeee0b1-627a-46f7-a74a-da9390b93a93 tempest-AttachVolumeTestJSON-1986652723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:04:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-380884792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7168e1a7-078a-4fb0-bf43-ee40aa6774e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc33fe4b7ee34471b4438bd107c7a225',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:04:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:04:32Z,use_quota=True,user_id='daca380af8ab42918d1d1f5815ed4f3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:04:32 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-7eeee0b1-627a-46f7-a74a-da9390b93a93 tempest-AttachVolumeTestJSON-1986652723 None] Creating volume 7168e1a7-078a-4fb0-bf43-ee40aa6774e2 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:04:32 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-7eeee0b1-627a-46f7-a74a-da9390b93a93 tempest-AttachVolumeTestJSON-1986652723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:04:32 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-7eeee0b1-627a-46f7-a74a-da9390b93a93 tempest-AttachVolumeTestJSON-1986652723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:04:32 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-7eeee0b1-627a-46f7-a74a-da9390b93a93 tempest-AttachVolumeTestJSON-1986652723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:04:32 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-7eeee0b1-627a-46f7-a74a-da9390b93a93 tempest-AttachVolumeTestJSON-1986652723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:04:32 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-7eeee0b1-627a-46f7-a74a-da9390b93a93 tempest-AttachVolumeTestJSON-1986652723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:04:32 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-7eeee0b1-627a-46f7-a74a-da9390b93a93 tempest-AttachVolumeTestJSON-1986652723 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:04:32 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-7eeee0b1-627a-46f7-a74a-da9390b93a93 tempest-AttachVolumeTestJSON-1986652723 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:04:32 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7eeee0b1-627a-46f7-a74a-da9390b93a93 tempest-AttachVolumeTestJSON-1986652723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-7168e1a7-078a-4fb0-bf43-ee40aa6774e2 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:32 devstack sudo[100831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-7168e1a7-078a-4fb0-bf43-ee40aa6774e2 1073741824 Aug 10 16:04:32 devstack sudo[100831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:33 devstack sudo[100831]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:33 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7eeee0b1-627a-46f7-a74a-da9390b93a93 tempest-AttachVolumeTestJSON-1986652723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-7168e1a7-078a-4fb0-bf43-ee40aa6774e2 1073741824" returned: 0 in 0.914s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:33 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7eeee0b1-627a-46f7-a74a-da9390b93a93 tempest-AttachVolumeTestJSON-1986652723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-7168e1a7-078a-4fb0-bf43-ee40aa6774e2 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:33 devstack sudo[100845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-7168e1a7-078a-4fb0-bf43-ee40aa6774e2 Aug 10 16:04:33 devstack sudo[100845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:33 devstack sudo[100845]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:33 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7eeee0b1-627a-46f7-a74a-da9390b93a93 tempest-AttachVolumeTestJSON-1986652723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-7168e1a7-078a-4fb0-bf43-ee40aa6774e2" returned: 0 in 0.560s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:33 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-7eeee0b1-627a-46f7-a74a-da9390b93a93 tempest-AttachVolumeTestJSON-1986652723 None] <== create_volume: return (1564ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:04:33 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-7eeee0b1-627a-46f7-a74a-da9390b93a93 tempest-AttachVolumeTestJSON-1986652723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.568s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:04:33 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-7eeee0b1-627a-46f7-a74a-da9390b93a93 tempest-AttachVolumeTestJSON-1986652723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d0ccdc7-960d-49f7-9f59-3954638b5bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7168e1a7-078a-4fb0-bf43-ee40aa6774e2', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:33 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-7eeee0b1-627a-46f7-a74a-da9390b93a93 tempest-AttachVolumeTestJSON-1986652723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dd352ce-d175-4961-8ae1-5f24f1f38e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:33 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-7eeee0b1-627a-46f7-a74a-da9390b93a93 tempest-AttachVolumeTestJSON-1986652723 None] Volume volume-7168e1a7-078a-4fb0-bf43-ee40aa6774e2 (7168e1a7-078a-4fb0-bf43-ee40aa6774e2): created successfully Aug 10 16:04:33 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-7eeee0b1-627a-46f7-a74a-da9390b93a93 tempest-AttachVolumeTestJSON-1986652723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dd352ce-d175-4961-8ae1-5f24f1f38e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:33 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-7eeee0b1-627a-46f7-a74a-da9390b93a93 tempest-AttachVolumeTestJSON-1986652723 None] Flow 'volume_create_manager' (221360a3-c61c-456a-ab36-3c35a78e8278) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:04:33 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-7eeee0b1-627a-46f7-a74a-da9390b93a93 tempest-AttachVolumeTestJSON-1986652723 None] Created volume successfully. Aug 10 16:04:34 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-232d1b89-f149-4c1f-b43f-440806452cfa tempest-VolumesCloneTest-1548246695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:04:34 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-232d1b89-f149-4c1f-b43f-440806452cfa tempest-VolumesCloneTest-1548246695 None] Flow 'volume_create_manager' (89e64372-7f6d-43c0-85e1-48e772d8d61f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:04:34 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-232d1b89-f149-4c1f-b43f-440806452cfa tempest-VolumesCloneTest-1548246695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be109abe-65c7-4c06-a8f7-2abf785c9602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:35 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-232d1b89-f149-4c1f-b43f-440806452cfa tempest-VolumesCloneTest-1548246695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be109abe-65c7-4c06-a8f7-2abf785c9602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:04:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-524490068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4333f588-ce3f-44ad-8bfb-ae14592f03ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='310429daab214e78876ef6e423afd84a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:04:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:04:35Z,use_quota=True,user_id='5b397635494b4468bd812bb4d116de57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:35 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-232d1b89-f149-4c1f-b43f-440806452cfa tempest-VolumesCloneTest-1548246695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fb4786b-d89d-40b8-994a-42ab88240b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:35 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-232d1b89-f149-4c1f-b43f-440806452cfa tempest-VolumesCloneTest-1548246695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fb4786b-d89d-40b8-994a-42ab88240b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:35 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-232d1b89-f149-4c1f-b43f-440806452cfa tempest-VolumesCloneTest-1548246695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad0620c1-8509-410e-965f-0c61e6c23a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:35 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-232d1b89-f149-4c1f-b43f-440806452cfa tempest-VolumesCloneTest-1548246695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad0620c1-8509-410e-965f-0c61e6c23a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4333f588-ce3f-44ad-8bfb-ae14592f03ca', 'volume_name': 'volume-4333f588-ce3f-44ad-8bfb-ae14592f03ca', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:35 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-232d1b89-f149-4c1f-b43f-440806452cfa tempest-VolumesCloneTest-1548246695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0885798e-2956-4caa-86c4-ad4e1867c640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:35 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-232d1b89-f149-4c1f-b43f-440806452cfa tempest-VolumesCloneTest-1548246695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0885798e-2956-4caa-86c4-ad4e1867c640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:35 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-232d1b89-f149-4c1f-b43f-440806452cfa tempest-VolumesCloneTest-1548246695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a60ca97a-4fce-4e93-a633-561f642b1bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:35 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-232d1b89-f149-4c1f-b43f-440806452cfa tempest-VolumesCloneTest-1548246695 None] Volume 4333f588-ce3f-44ad-8bfb-ae14592f03ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4333f588-ce3f-44ad-8bfb-ae14592f03ca', 'volume_size': 1} Aug 10 16:04:35 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-232d1b89-f149-4c1f-b43f-440806452cfa tempest-VolumesCloneTest-1548246695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:04:35 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-232d1b89-f149-4c1f-b43f-440806452cfa tempest-VolumesCloneTest-1548246695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:04:35 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-232d1b89-f149-4c1f-b43f-440806452cfa tempest-VolumesCloneTest-1548246695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:04:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-524490068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4333f588-ce3f-44ad-8bfb-ae14592f03ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='310429daab214e78876ef6e423afd84a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:04:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:04:35Z,use_quota=True,user_id='5b397635494b4468bd812bb4d116de57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:04:35 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-232d1b89-f149-4c1f-b43f-440806452cfa tempest-VolumesCloneTest-1548246695 None] Creating volume 4333f588-ce3f-44ad-8bfb-ae14592f03ca {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:04:35 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-232d1b89-f149-4c1f-b43f-440806452cfa tempest-VolumesCloneTest-1548246695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:04:35 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-232d1b89-f149-4c1f-b43f-440806452cfa tempest-VolumesCloneTest-1548246695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:04:35 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-232d1b89-f149-4c1f-b43f-440806452cfa tempest-VolumesCloneTest-1548246695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:04:35 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-232d1b89-f149-4c1f-b43f-440806452cfa tempest-VolumesCloneTest-1548246695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:04:35 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-232d1b89-f149-4c1f-b43f-440806452cfa tempest-VolumesCloneTest-1548246695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:04:35 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-232d1b89-f149-4c1f-b43f-440806452cfa tempest-VolumesCloneTest-1548246695 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:04:35 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-232d1b89-f149-4c1f-b43f-440806452cfa tempest-VolumesCloneTest-1548246695 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:04:35 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-232d1b89-f149-4c1f-b43f-440806452cfa tempest-VolumesCloneTest-1548246695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4333f588-ce3f-44ad-8bfb-ae14592f03ca 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:35 devstack sudo[100857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4333f588-ce3f-44ad-8bfb-ae14592f03ca 1073741824 Aug 10 16:04:35 devstack sudo[100857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:35 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-e1ac3dc1-7974-4346-92b8-c9e93164d1aa req-d9055392-9d2b-441b-a579-1bbd39710245 tempest-AttachVolumeTestJSON-1986652723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:04:35 devstack sudo[100857]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:35 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-232d1b89-f149-4c1f-b43f-440806452cfa tempest-VolumesCloneTest-1548246695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4333f588-ce3f-44ad-8bfb-ae14592f03ca 1073741824" returned: 0 in 0.818s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:35 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-232d1b89-f149-4c1f-b43f-440806452cfa tempest-VolumesCloneTest-1548246695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4333f588-ce3f-44ad-8bfb-ae14592f03ca {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:36 devstack sudo[100866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4333f588-ce3f-44ad-8bfb-ae14592f03ca Aug 10 16:04:36 devstack sudo[100866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:36 devstack sudo[100866]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-232d1b89-f149-4c1f-b43f-440806452cfa tempest-VolumesCloneTest-1548246695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4333f588-ce3f-44ad-8bfb-ae14592f03ca" returned: 0 in 0.298s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:36 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-232d1b89-f149-4c1f-b43f-440806452cfa tempest-VolumesCloneTest-1548246695 None] <== create_volume: return (1188ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:04:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-232d1b89-f149-4c1f-b43f-440806452cfa tempest-VolumesCloneTest-1548246695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.197s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:04:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-e1ac3dc1-7974-4346-92b8-c9e93164d1aa req-d9055392-9d2b-441b-a579-1bbd39710245 tempest-AttachVolumeTestJSON-1986652723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.866s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:04:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-e1ac3dc1-7974-4346-92b8-c9e93164d1aa req-d9055392-9d2b-441b-a579-1bbd39710245 tempest-AttachVolumeTestJSON-1986652723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:04:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-232d1b89-f149-4c1f-b43f-440806452cfa tempest-VolumesCloneTest-1548246695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a60ca97a-4fce-4e93-a633-561f642b1bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4333f588-ce3f-44ad-8bfb-ae14592f03ca', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-232d1b89-f149-4c1f-b43f-440806452cfa tempest-VolumesCloneTest-1548246695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0de8da74-5099-4ff9-8144-f045a3f685e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:36 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-232d1b89-f149-4c1f-b43f-440806452cfa tempest-VolumesCloneTest-1548246695 None] Volume volume-4333f588-ce3f-44ad-8bfb-ae14592f03ca (4333f588-ce3f-44ad-8bfb-ae14592f03ca): created successfully Aug 10 16:04:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-232d1b89-f149-4c1f-b43f-440806452cfa tempest-VolumesCloneTest-1548246695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0de8da74-5099-4ff9-8144-f045a3f685e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-232d1b89-f149-4c1f-b43f-440806452cfa tempest-VolumesCloneTest-1548246695 None] Flow 'volume_create_manager' (89e64372-7f6d-43c0-85e1-48e772d8d61f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:04:36 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-232d1b89-f149-4c1f-b43f-440806452cfa tempest-VolumesCloneTest-1548246695 None] Created volume successfully. Aug 10 16:04:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [req-e1ac3dc1-7974-4346-92b8-c9e93164d1aa req-d9055392-9d2b-441b-a579-1bbd39710245 tempest-AttachVolumeTestJSON-1986652723 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc', 'name': 'volume-7168e1a7-078a-4fb0-bf43-ee40aa6774e2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a4a25520-91f5-453b-a0be-60a53a9644df', 'enforce_multipath': True} {{(pid=88641) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 10 16:04:36 devstack cinder-volume[88641]: DEBUG oslo_service.periodic_task [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88641) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 16:04:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:04:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:04:36 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:04:36 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:04:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:04:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:36 devstack sudo[100870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:04:36 devstack sudo[100870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:36 devstack cinder-volume[88641]: INFO cinder.volume.manager [req-e1ac3dc1-7974-4346-92b8-c9e93164d1aa req-d9055392-9d2b-441b-a579-1bbd39710245 tempest-AttachVolumeTestJSON-1986652723 None] attachment_update completed successfully. Aug 10 16:04:36 devstack sudo[100870]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.431s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:36 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:04:36 devstack cinder-volume[88641]: DEBUG oslo_service.periodic_task [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Running periodic task VolumeManager._thread_info {{(pid=88641) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 16:04:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] thread count: 28 {{(pid=88641) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 10 16:04:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] thread info: [<_MainThread(MainThread, started 127361545748608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88641) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 10 16:04:37 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2c6e07a-559f-48ad-963b-80017509deee tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:04:37 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b2c6e07a-559f-48ad-963b-80017509deee tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Flow 'volume_create_manager' (690db6a1-8097-469e-ae41-042f5d3c0f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:04:37 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b2c6e07a-559f-48ad-963b-80017509deee tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d4141ef-de86-4e40-a44b-b60ac89403c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:37 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b2c6e07a-559f-48ad-963b-80017509deee tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d4141ef-de86-4e40-a44b-b60ac89403c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:04:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1534320632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3b71d12-56f3-4e44-9701-0196474f964a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b96c5c7254104cfb9786cc2236c76300',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:04:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:04:37Z,use_quota=True,user_id='1394bc988a7f4d36b84f95a5b50507fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:37 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b2c6e07a-559f-48ad-963b-80017509deee tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (594e2311-5ff7-4dfe-bff1-863ab2289de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:37 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b2c6e07a-559f-48ad-963b-80017509deee tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (594e2311-5ff7-4dfe-bff1-863ab2289de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:37 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b2c6e07a-559f-48ad-963b-80017509deee tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (989a16ba-cf9c-45f5-a2e6-18968ea14926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:37 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b2c6e07a-559f-48ad-963b-80017509deee tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (989a16ba-cf9c-45f5-a2e6-18968ea14926) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3b71d12-56f3-4e44-9701-0196474f964a', 'volume_name': 'volume-e3b71d12-56f3-4e44-9701-0196474f964a', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:37 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b2c6e07a-559f-48ad-963b-80017509deee tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b763e173-31a9-41f8-84c5-680c66e0b871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:37 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b2c6e07a-559f-48ad-963b-80017509deee tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b763e173-31a9-41f8-84c5-680c66e0b871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:37 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b2c6e07a-559f-48ad-963b-80017509deee tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (919e1e5d-cf45-4480-9430-1f2807e66436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:37 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-b2c6e07a-559f-48ad-963b-80017509deee tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Volume e3b71d12-56f3-4e44-9701-0196474f964a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3b71d12-56f3-4e44-9701-0196474f964a', 'volume_size': 1} Aug 10 16:04:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-b2c6e07a-559f-48ad-963b-80017509deee tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:04:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-b2c6e07a-559f-48ad-963b-80017509deee tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:04:37 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-b2c6e07a-559f-48ad-963b-80017509deee tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:04:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1534320632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3b71d12-56f3-4e44-9701-0196474f964a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b96c5c7254104cfb9786cc2236c76300',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:04:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:04:37Z,use_quota=True,user_id='1394bc988a7f4d36b84f95a5b50507fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:04:37 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-b2c6e07a-559f-48ad-963b-80017509deee tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Creating volume e3b71d12-56f3-4e44-9701-0196474f964a {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:04:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-b2c6e07a-559f-48ad-963b-80017509deee tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:04:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-b2c6e07a-559f-48ad-963b-80017509deee tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:04:37 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-b2c6e07a-559f-48ad-963b-80017509deee tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:04:37 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-b2c6e07a-559f-48ad-963b-80017509deee tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:04:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-b2c6e07a-559f-48ad-963b-80017509deee tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:04:37 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-b2c6e07a-559f-48ad-963b-80017509deee tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:04:37 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-b2c6e07a-559f-48ad-963b-80017509deee tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:04:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b2c6e07a-559f-48ad-963b-80017509deee tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-e3b71d12-56f3-4e44-9701-0196474f964a 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:37 devstack sudo[100878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-e3b71d12-56f3-4e44-9701-0196474f964a 1073741824 Aug 10 16:04:37 devstack sudo[100878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:37 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-950a422f-c99f-47d1-bdb1-5e111e37b55a tempest-VolumesCloneTest-1548246695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:04:37 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-950a422f-c99f-47d1-bdb1-5e111e37b55a tempest-VolumesCloneTest-1548246695 None] Flow 'volume_create_manager' (2cc27c8e-4ef1-453b-87a1-58817ed6ab72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:04:37 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-950a422f-c99f-47d1-bdb1-5e111e37b55a tempest-VolumesCloneTest-1548246695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48b56f7a-f06a-4218-b13e-3559353666d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:37 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-950a422f-c99f-47d1-bdb1-5e111e37b55a tempest-VolumesCloneTest-1548246695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48b56f7a-f06a-4218-b13e-3559353666d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:04:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-463155205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=943801b4-7e15-48d9-870b-ea4a1576ae3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='310429daab214e78876ef6e423afd84a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:04:38Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=4333f588-ce3f-44ad-8bfb-ae14592f03ca,status='creating',terminated_at=None,updated_at=2026-08-10T14:04:38Z,use_quota=True,user_id='5b397635494b4468bd812bb4d116de57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:37 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-950a422f-c99f-47d1-bdb1-5e111e37b55a tempest-VolumesCloneTest-1548246695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed079452-cb16-49df-818b-9814d78f263b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:37 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-950a422f-c99f-47d1-bdb1-5e111e37b55a tempest-VolumesCloneTest-1548246695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed079452-cb16-49df-818b-9814d78f263b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:38 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-950a422f-c99f-47d1-bdb1-5e111e37b55a tempest-VolumesCloneTest-1548246695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c74a83e-8708-4522-aa47-505403b5a5c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:38 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-950a422f-c99f-47d1-bdb1-5e111e37b55a tempest-VolumesCloneTest-1548246695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c74a83e-8708-4522-aa47-505403b5a5c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '943801b4-7e15-48d9-870b-ea4a1576ae3a', 'volume_name': 'volume-943801b4-7e15-48d9-870b-ea4a1576ae3a', 'volume_size': 2, 'source_volid': '4333f588-ce3f-44ad-8bfb-ae14592f03ca', 'source_volstatus': 'available'}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:38 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-950a422f-c99f-47d1-bdb1-5e111e37b55a tempest-VolumesCloneTest-1548246695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c56817dc-da9c-43c4-b2b1-275c6335d4e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:38 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-950a422f-c99f-47d1-bdb1-5e111e37b55a tempest-VolumesCloneTest-1548246695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c56817dc-da9c-43c4-b2b1-275c6335d4e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:38 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-950a422f-c99f-47d1-bdb1-5e111e37b55a tempest-VolumesCloneTest-1548246695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cedfb99-21ed-43f5-ab0f-f1601759a0c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:38 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-950a422f-c99f-47d1-bdb1-5e111e37b55a tempest-VolumesCloneTest-1548246695 None] Volume 943801b4-7e15-48d9-870b-ea4a1576ae3a: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-943801b4-7e15-48d9-870b-ea4a1576ae3a', 'volume_size': 2, 'source_volid': '4333f588-ce3f-44ad-8bfb-ae14592f03ca', 'source_volstatus': 'available'} Aug 10 16:04:38 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-950a422f-c99f-47d1-bdb1-5e111e37b55a tempest-VolumesCloneTest-1548246695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:04:38 devstack sudo[100878]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:38 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b2c6e07a-559f-48ad-963b-80017509deee tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-e3b71d12-56f3-4e44-9701-0196474f964a 1073741824" returned: 0 in 0.648s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:38 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b2c6e07a-559f-48ad-963b-80017509deee tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-e3b71d12-56f3-4e44-9701-0196474f964a {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:38 devstack sudo[100885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-e3b71d12-56f3-4e44-9701-0196474f964a Aug 10 16:04:38 devstack sudo[100885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:38 devstack sudo[100885]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:38 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b2c6e07a-559f-48ad-963b-80017509deee tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-e3b71d12-56f3-4e44-9701-0196474f964a" returned: 0 in 0.263s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:38 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-b2c6e07a-559f-48ad-963b-80017509deee tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:04:38 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-b2c6e07a-559f-48ad-963b-80017509deee tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:04:38 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-950a422f-c99f-47d1-bdb1-5e111e37b55a tempest-VolumesCloneTest-1548246695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.315s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:04:38 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-950a422f-c99f-47d1-bdb1-5e111e37b55a tempest-VolumesCloneTest-1548246695 None] Cloning volume 4333f588-ce3f-44ad-8bfb-ae14592f03ca to volume 943801b4-7e15-48d9-870b-ea4a1576ae3a Aug 10 16:04:38 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b2c6e07a-559f-48ad-963b-80017509deee tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (919e1e5d-cf45-4480-9430-1f2807e66436) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3b71d12-56f3-4e44-9701-0196474f964a', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:38 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b2c6e07a-559f-48ad-963b-80017509deee tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (972b6c76-ef4a-4b05-b0df-678911ceaffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:38 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-b2c6e07a-559f-48ad-963b-80017509deee tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Volume volume-e3b71d12-56f3-4e44-9701-0196474f964a (e3b71d12-56f3-4e44-9701-0196474f964a): created successfully Aug 10 16:04:38 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b2c6e07a-559f-48ad-963b-80017509deee tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (972b6c76-ef4a-4b05-b0df-678911ceaffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:38 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b2c6e07a-559f-48ad-963b-80017509deee tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Flow 'volume_create_manager' (690db6a1-8097-469e-ae41-042f5d3c0f31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:04:38 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-950a422f-c99f-47d1-bdb1-5e111e37b55a tempest-VolumesCloneTest-1548246695 None] Creating offline snapshot f541cafa-3ebd-4a5b-823c-21c31b5cd84d of volume 4333f588-ce3f-44ad-8bfb-ae14592f03ca {{(pid=88641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 16:04:38 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-b2c6e07a-559f-48ad-963b-80017509deee tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Created volume successfully. Aug 10 16:04:38 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae549809-350a-4bc9-80ae-5ecdec27b9ce]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:04:38 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-950a422f-c99f-47d1-bdb1-5e111e37b55a tempest-VolumesCloneTest-1548246695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4333f588-ce3f-44ad-8bfb-ae14592f03ca {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:38 devstack sudo[100888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4333f588-ce3f-44ad-8bfb-ae14592f03ca Aug 10 16:04:38 devstack sudo[100888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:38 devstack sudo[100888]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:38 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-950a422f-c99f-47d1-bdb1-5e111e37b55a tempest-VolumesCloneTest-1548246695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4333f588-ce3f-44ad-8bfb-ae14592f03ca" returned: 0 in 0.452s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:38 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-950a422f-c99f-47d1-bdb1-5e111e37b55a tempest-VolumesCloneTest-1548246695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4333f588-ce3f-44ad-8bfb-ae14592f03ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4333f588-ce3f-44ad-8bfb-ae14592f03ca.f541cafa-3ebd-4a5b-823c-21c31b5cd84d 1G {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:38 devstack sudo[100894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4333f588-ce3f-44ad-8bfb-ae14592f03ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4333f588-ce3f-44ad-8bfb-ae14592f03ca.f541cafa-3ebd-4a5b-823c-21c31b5cd84d 1G Aug 10 16:04:38 devstack sudo[100894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:39 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ad84ceb-ba46-45ac-a8fd-5eab52248558 tempest-AttachVolumeTestJSON-1986652723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:04:39 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9ad84ceb-ba46-45ac-a8fd-5eab52248558 tempest-AttachVolumeTestJSON-1986652723 None] Flow 'volume_create_manager' (18ae5584-041c-4e28-a4cb-ffb20953936b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:04:39 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9ad84ceb-ba46-45ac-a8fd-5eab52248558 tempest-AttachVolumeTestJSON-1986652723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79529e40-7a1e-4d7b-9b21-a05424aceed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:39 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9ad84ceb-ba46-45ac-a8fd-5eab52248558 tempest-AttachVolumeTestJSON-1986652723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79529e40-7a1e-4d7b-9b21-a05424aceed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:04:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1805450276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc438c0e-1676-438a-9b4f-96fa01a2d708,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc33fe4b7ee34471b4438bd107c7a225',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:04:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:04:39Z,use_quota=True,user_id='daca380af8ab42918d1d1f5815ed4f3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:39 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9ad84ceb-ba46-45ac-a8fd-5eab52248558 tempest-AttachVolumeTestJSON-1986652723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2408df1-57dd-4257-a49a-37c57c1527a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:39 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9ad84ceb-ba46-45ac-a8fd-5eab52248558 tempest-AttachVolumeTestJSON-1986652723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2408df1-57dd-4257-a49a-37c57c1527a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:39 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9ad84ceb-ba46-45ac-a8fd-5eab52248558 tempest-AttachVolumeTestJSON-1986652723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (692fef85-d2ea-4efa-8568-8c93164173a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:39 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9ad84ceb-ba46-45ac-a8fd-5eab52248558 tempest-AttachVolumeTestJSON-1986652723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (692fef85-d2ea-4efa-8568-8c93164173a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc438c0e-1676-438a-9b4f-96fa01a2d708', 'volume_name': 'volume-fc438c0e-1676-438a-9b4f-96fa01a2d708', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:39 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9ad84ceb-ba46-45ac-a8fd-5eab52248558 tempest-AttachVolumeTestJSON-1986652723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59bd68ba-a91e-4de3-b888-f88f4b1fd6a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:39 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9ad84ceb-ba46-45ac-a8fd-5eab52248558 tempest-AttachVolumeTestJSON-1986652723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59bd68ba-a91e-4de3-b888-f88f4b1fd6a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:39 devstack sudo[100894]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:39 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9ad84ceb-ba46-45ac-a8fd-5eab52248558 tempest-AttachVolumeTestJSON-1986652723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c92e5a40-1d15-48e3-bf19-99a5a45e3c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:39 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-9ad84ceb-ba46-45ac-a8fd-5eab52248558 tempest-AttachVolumeTestJSON-1986652723 None] Volume fc438c0e-1676-438a-9b4f-96fa01a2d708: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc438c0e-1676-438a-9b4f-96fa01a2d708', 'volume_size': 1} Aug 10 16:04:39 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-9ad84ceb-ba46-45ac-a8fd-5eab52248558 tempest-AttachVolumeTestJSON-1986652723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:04:39 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-950a422f-c99f-47d1-bdb1-5e111e37b55a tempest-VolumesCloneTest-1548246695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4333f588-ce3f-44ad-8bfb-ae14592f03ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4333f588-ce3f-44ad-8bfb-ae14592f03ca.f541cafa-3ebd-4a5b-823c-21c31b5cd84d 1G" returned: 0 in 0.528s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:39 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-950a422f-c99f-47d1-bdb1-5e111e37b55a tempest-VolumesCloneTest-1548246695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4333f588-ce3f-44ad-8bfb-ae14592f03ca -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4333f588-ce3f-44ad-8bfb-ae14592f03ca.f541cafa-3ebd-4a5b-823c-21c31b5cd84d {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:39 devstack sudo[100900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4333f588-ce3f-44ad-8bfb-ae14592f03ca -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4333f588-ce3f-44ad-8bfb-ae14592f03ca.f541cafa-3ebd-4a5b-823c-21c31b5cd84d Aug 10 16:04:39 devstack sudo[100900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:39 devstack sudo[100900]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:39 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-950a422f-c99f-47d1-bdb1-5e111e37b55a tempest-VolumesCloneTest-1548246695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4333f588-ce3f-44ad-8bfb-ae14592f03ca -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4333f588-ce3f-44ad-8bfb-ae14592f03ca.f541cafa-3ebd-4a5b-823c-21c31b5cd84d" returned: 0 in 0.418s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:39 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-950a422f-c99f-47d1-bdb1-5e111e37b55a tempest-VolumesCloneTest-1548246695 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4333f588-ce3f-44ad-8bfb-ae14592f03ca.f541cafa-3ebd-4a5b-823c-21c31b5cd84d is being set with open permissions: ugo+rw Aug 10 16:04:39 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-950a422f-c99f-47d1-bdb1-5e111e37b55a tempest-VolumesCloneTest-1548246695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4333f588-ce3f-44ad-8bfb-ae14592f03ca.f541cafa-3ebd-4a5b-823c-21c31b5cd84d {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:39 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-38bbea0a-0a0f-4521-bfe1-546c675711b3 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:04:39 devstack sudo[100906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4333f588-ce3f-44ad-8bfb-ae14592f03ca.f541cafa-3ebd-4a5b-823c-21c31b5cd84d Aug 10 16:04:39 devstack sudo[100906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:39 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-38bbea0a-0a0f-4521-bfe1-546c675711b3 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Flow 'volume_create_manager' (bbc37922-57c4-4aa4-9cfb-069609e4a8f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:04:39 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-38bbea0a-0a0f-4521-bfe1-546c675711b3 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92e47600-5560-46f1-a5e3-26e7effe6f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:40 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-38bbea0a-0a0f-4521-bfe1-546c675711b3 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92e47600-5560-46f1-a5e3-26e7effe6f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:04:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-411639978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9a1eb27-a971-412e-9f59-1038f8db703e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b96c5c7254104cfb9786cc2236c76300',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:04:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:04:40Z,use_quota=True,user_id='1394bc988a7f4d36b84f95a5b50507fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:40 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-38bbea0a-0a0f-4521-bfe1-546c675711b3 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b80c46c2-fca4-4ce5-b712-626993a44b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:40 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-38bbea0a-0a0f-4521-bfe1-546c675711b3 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b80c46c2-fca4-4ce5-b712-626993a44b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:40 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-38bbea0a-0a0f-4521-bfe1-546c675711b3 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e999fbd-be39-4e83-8d9f-3ae38ed3e578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:40 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-38bbea0a-0a0f-4521-bfe1-546c675711b3 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e999fbd-be39-4e83-8d9f-3ae38ed3e578) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9a1eb27-a971-412e-9f59-1038f8db703e', 'volume_name': 'volume-b9a1eb27-a971-412e-9f59-1038f8db703e', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:40 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-38bbea0a-0a0f-4521-bfe1-546c675711b3 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d43c7d7-b225-47a9-8e34-1997d1a973d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:40 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-38bbea0a-0a0f-4521-bfe1-546c675711b3 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d43c7d7-b225-47a9-8e34-1997d1a973d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:40 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-38bbea0a-0a0f-4521-bfe1-546c675711b3 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fa8b53d-78e9-4fad-88a0-493a233a51cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:40 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-38bbea0a-0a0f-4521-bfe1-546c675711b3 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Volume b9a1eb27-a971-412e-9f59-1038f8db703e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9a1eb27-a971-412e-9f59-1038f8db703e', 'volume_size': 1} Aug 10 16:04:40 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-38bbea0a-0a0f-4521-bfe1-546c675711b3 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:04:40 devstack sudo[100906]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:40 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-950a422f-c99f-47d1-bdb1-5e111e37b55a tempest-VolumesCloneTest-1548246695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4333f588-ce3f-44ad-8bfb-ae14592f03ca.f541cafa-3ebd-4a5b-823c-21c31b5cd84d" returned: 0 in 0.351s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:40 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-950a422f-c99f-47d1-bdb1-5e111e37b55a tempest-VolumesCloneTest-1548246695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4333f588-ce3f-44ad-8bfb-ae14592f03ca.info {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:40 devstack sudo[100909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4333f588-ce3f-44ad-8bfb-ae14592f03ca.info Aug 10 16:04:40 devstack sudo[100909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:40 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b19d6d2-faa3-4d08-8942-8197eda58187 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:04:40 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-5b19d6d2-faa3-4d08-8942-8197eda58187 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Flow 'volume_create_manager' (54a56e9c-1e8c-4b72-9980-21c7d15856dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:04:40 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-5b19d6d2-faa3-4d08-8942-8197eda58187 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b31c19d2-ff2c-41f0-b425-fb4b416d1761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:40 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-5b19d6d2-faa3-4d08-8942-8197eda58187 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b31c19d2-ff2c-41f0-b425-fb4b416d1761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:04:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1336932050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7586c173-0e1c-4c40-9081-9eb7981a1340,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b96c5c7254104cfb9786cc2236c76300',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:04:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:04:40Z,use_quota=True,user_id='1394bc988a7f4d36b84f95a5b50507fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:40 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-5b19d6d2-faa3-4d08-8942-8197eda58187 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (196b7977-6246-478a-a73d-41ce8e07633b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:40 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-5b19d6d2-faa3-4d08-8942-8197eda58187 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (196b7977-6246-478a-a73d-41ce8e07633b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:40 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-5b19d6d2-faa3-4d08-8942-8197eda58187 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35af54f9-5013-45ee-951e-d12f060bd552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:40 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-5b19d6d2-faa3-4d08-8942-8197eda58187 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35af54f9-5013-45ee-951e-d12f060bd552) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7586c173-0e1c-4c40-9081-9eb7981a1340', 'volume_name': 'volume-7586c173-0e1c-4c40-9081-9eb7981a1340', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:40 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-5b19d6d2-faa3-4d08-8942-8197eda58187 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f01c7b0f-8c4c-48e7-8f90-115836ad87be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:40 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-5b19d6d2-faa3-4d08-8942-8197eda58187 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f01c7b0f-8c4c-48e7-8f90-115836ad87be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:40 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-5b19d6d2-faa3-4d08-8942-8197eda58187 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3db14089-6251-42ec-8b01-d264af2d08b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:40 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-5b19d6d2-faa3-4d08-8942-8197eda58187 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Volume 7586c173-0e1c-4c40-9081-9eb7981a1340: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7586c173-0e1c-4c40-9081-9eb7981a1340', 'volume_size': 1} Aug 10 16:04:40 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-5b19d6d2-faa3-4d08-8942-8197eda58187 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:04:40 devstack sudo[100909]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:40 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-950a422f-c99f-47d1-bdb1-5e111e37b55a tempest-VolumesCloneTest-1548246695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4333f588-ce3f-44ad-8bfb-ae14592f03ca.info" returned: 0 in 0.426s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:40 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-950a422f-c99f-47d1-bdb1-5e111e37b55a tempest-VolumesCloneTest-1548246695 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4333f588-ce3f-44ad-8bfb-ae14592f03ca.info is being set with open permissions: ugo+rw Aug 10 16:04:40 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-950a422f-c99f-47d1-bdb1-5e111e37b55a tempest-VolumesCloneTest-1548246695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4333f588-ce3f-44ad-8bfb-ae14592f03ca.info {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:40 devstack sudo[100912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4333f588-ce3f-44ad-8bfb-ae14592f03ca.info Aug 10 16:04:40 devstack sudo[100912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:40 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-86f6a2dd-ac30-48c0-90e6-26c8d59c2e93 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:04:40 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-86f6a2dd-ac30-48c0-90e6-26c8d59c2e93 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Flow 'volume_create_manager' (16e5c5ab-b5eb-4d8d-922e-8531d94a9f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:04:40 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-86f6a2dd-ac30-48c0-90e6-26c8d59c2e93 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b2cac38-22b9-4e97-926a-327953597c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:40 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-86f6a2dd-ac30-48c0-90e6-26c8d59c2e93 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b2cac38-22b9-4e97-926a-327953597c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:04:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-281839388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a206c8ed-073a-45cc-a858-00379742e74a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b96c5c7254104cfb9786cc2236c76300',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:04:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:04:41Z,use_quota=True,user_id='1394bc988a7f4d36b84f95a5b50507fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:40 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-86f6a2dd-ac30-48c0-90e6-26c8d59c2e93 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f8c173b-6093-4cc2-a95a-82cc4043f0a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:41 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-86f6a2dd-ac30-48c0-90e6-26c8d59c2e93 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f8c173b-6093-4cc2-a95a-82cc4043f0a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:41 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-86f6a2dd-ac30-48c0-90e6-26c8d59c2e93 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce538004-bc57-48be-b736-02f97a6a7379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:41 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-86f6a2dd-ac30-48c0-90e6-26c8d59c2e93 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce538004-bc57-48be-b736-02f97a6a7379) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a206c8ed-073a-45cc-a858-00379742e74a', 'volume_name': 'volume-a206c8ed-073a-45cc-a858-00379742e74a', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:41 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-86f6a2dd-ac30-48c0-90e6-26c8d59c2e93 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ef7c5b8-0c48-4f09-b6f8-e0172ae778ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:41 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-86f6a2dd-ac30-48c0-90e6-26c8d59c2e93 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ef7c5b8-0c48-4f09-b6f8-e0172ae778ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:41 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-86f6a2dd-ac30-48c0-90e6-26c8d59c2e93 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bb8d5eb-11e6-43f4-91a6-612e8bfd5c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:41 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-86f6a2dd-ac30-48c0-90e6-26c8d59c2e93 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Volume a206c8ed-073a-45cc-a858-00379742e74a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a206c8ed-073a-45cc-a858-00379742e74a', 'volume_size': 1} Aug 10 16:04:41 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-86f6a2dd-ac30-48c0-90e6-26c8d59c2e93 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:04:41 devstack sudo[100912]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:41 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-950a422f-c99f-47d1-bdb1-5e111e37b55a tempest-VolumesCloneTest-1548246695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4333f588-ce3f-44ad-8bfb-ae14592f03ca.info" returned: 0 in 0.363s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:41 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-950a422f-c99f-47d1-bdb1-5e111e37b55a tempest-VolumesCloneTest-1548246695 None] Acquiring lock "cinder-quobyte-943801b4-7e15-48d9-870b-ea4a1576ae3a" by "_copy_volume_from_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:04:41 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-950a422f-c99f-47d1-bdb1-5e111e37b55a tempest-VolumesCloneTest-1548246695 None] Lock "cinder-quobyte-943801b4-7e15-48d9-870b-ea4a1576ae3a" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:04:41 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-950a422f-c99f-47d1-bdb1-5e111e37b55a tempest-VolumesCloneTest-1548246695 None] snapshot: f541cafa-3ebd-4a5b-823c-21c31b5cd84d, volume: 943801b4-7e15-48d9-870b-ea4a1576ae3a, {{(pid=88641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 10 16:04:41 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-950a422f-c99f-47d1-bdb1-5e111e37b55a tempest-VolumesCloneTest-1548246695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:04:41 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-950a422f-c99f-47d1-bdb1-5e111e37b55a tempest-VolumesCloneTest-1548246695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:04:41 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-950a422f-c99f-47d1-bdb1-5e111e37b55a tempest-VolumesCloneTest-1548246695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:04:41 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-950a422f-c99f-47d1-bdb1-5e111e37b55a tempest-VolumesCloneTest-1548246695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:04:41 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-950a422f-c99f-47d1-bdb1-5e111e37b55a tempest-VolumesCloneTest-1548246695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:04:41 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c5d974-079f-4b75-be2b-2c4de74bef04]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:04:41 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-950a422f-c99f-47d1-bdb1-5e111e37b55a tempest-VolumesCloneTest-1548246695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4333f588-ce3f-44ad-8bfb-ae14592f03ca.f541cafa-3ebd-4a5b-823c-21c31b5cd84d {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:41 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a4a182b-9160-4572-910b-04cfdd3bd232 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:04:41 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2a4a182b-9160-4572-910b-04cfdd3bd232 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Flow 'volume_create_manager' (6cba775c-697e-46b1-a88f-cc1daaa8e892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:04:41 devstack sudo[100915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4333f588-ce3f-44ad-8bfb-ae14592f03ca.f541cafa-3ebd-4a5b-823c-21c31b5cd84d Aug 10 16:04:41 devstack sudo[100915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:41 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2a4a182b-9160-4572-910b-04cfdd3bd232 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1694fe76-27ee-4c9b-8e76-9c87ee9cb9c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:41 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2a4a182b-9160-4572-910b-04cfdd3bd232 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1694fe76-27ee-4c9b-8e76-9c87ee9cb9c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:04:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-84906466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2092c34d-6faf-4ed1-b9b0-98d20afa7723,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b96c5c7254104cfb9786cc2236c76300',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:04:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:04:41Z,use_quota=True,user_id='1394bc988a7f4d36b84f95a5b50507fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:41 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2a4a182b-9160-4572-910b-04cfdd3bd232 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1328005-5f30-47b1-a909-7b90a56a9063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:41 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2a4a182b-9160-4572-910b-04cfdd3bd232 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1328005-5f30-47b1-a909-7b90a56a9063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:41 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2a4a182b-9160-4572-910b-04cfdd3bd232 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c05ddead-177c-49cb-8038-6e043cb97177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:41 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2a4a182b-9160-4572-910b-04cfdd3bd232 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c05ddead-177c-49cb-8038-6e043cb97177) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2092c34d-6faf-4ed1-b9b0-98d20afa7723', 'volume_name': 'volume-2092c34d-6faf-4ed1-b9b0-98d20afa7723', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:41 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2a4a182b-9160-4572-910b-04cfdd3bd232 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bed7011-3a39-4ce6-83bb-193bc1379c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:41 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2a4a182b-9160-4572-910b-04cfdd3bd232 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bed7011-3a39-4ce6-83bb-193bc1379c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:41 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2a4a182b-9160-4572-910b-04cfdd3bd232 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f7b96a1-8aaf-45bc-b763-2d181135d536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:41 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-2a4a182b-9160-4572-910b-04cfdd3bd232 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Volume 2092c34d-6faf-4ed1-b9b0-98d20afa7723: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2092c34d-6faf-4ed1-b9b0-98d20afa7723', 'volume_size': 1} Aug 10 16:04:41 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-2a4a182b-9160-4572-910b-04cfdd3bd232 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:04:41 devstack sudo[100915]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:41 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-950a422f-c99f-47d1-bdb1-5e111e37b55a tempest-VolumesCloneTest-1548246695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4333f588-ce3f-44ad-8bfb-ae14592f03ca.f541cafa-3ebd-4a5b-823c-21c31b5cd84d" returned: 0 in 0.553s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:41 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-950a422f-c99f-47d1-bdb1-5e111e37b55a tempest-VolumesCloneTest-1548246695 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4333f588-ce3f-44ad-8bfb-ae14592f03ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 16:04:41 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[2227d9fb-c34a-471a-829d-b5dbe219d0fd]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:04:41 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-950a422f-c99f-47d1-bdb1-5e111e37b55a tempest-VolumesCloneTest-1548246695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4333f588-ce3f-44ad-8bfb-ae14592f03ca {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:41 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-0348c114-b505-40c4-a110-171275691d8c tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:04:41 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-0348c114-b505-40c4-a110-171275691d8c tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Flow 'volume_create_manager' (b26314a3-18ea-474e-af2b-66c9847fc406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:04:41 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-0348c114-b505-40c4-a110-171275691d8c tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (947b33aa-9483-42e5-8cba-5d97cf55de12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:41 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-0348c114-b505-40c4-a110-171275691d8c tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (947b33aa-9483-42e5-8cba-5d97cf55de12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:04:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2075186739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15716f06-6315-429b-8416-3f2df77d1031,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b96c5c7254104cfb9786cc2236c76300',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:04:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:04:42Z,use_quota=True,user_id='1394bc988a7f4d36b84f95a5b50507fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:41 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-0348c114-b505-40c4-a110-171275691d8c tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3803564c-3712-4c04-8461-b87a7af81c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:41 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-0348c114-b505-40c4-a110-171275691d8c tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3803564c-3712-4c04-8461-b87a7af81c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:41 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-0348c114-b505-40c4-a110-171275691d8c tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a075ed27-edfe-4eb3-bc31-194cf7a3fd8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:41 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-0348c114-b505-40c4-a110-171275691d8c tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a075ed27-edfe-4eb3-bc31-194cf7a3fd8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15716f06-6315-429b-8416-3f2df77d1031', 'volume_name': 'volume-15716f06-6315-429b-8416-3f2df77d1031', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:41 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-0348c114-b505-40c4-a110-171275691d8c tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41dfd894-844b-4842-983f-9f7b11f15e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:41 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-0348c114-b505-40c4-a110-171275691d8c tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41dfd894-844b-4842-983f-9f7b11f15e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:41 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-0348c114-b505-40c4-a110-171275691d8c tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60a8341d-dde6-4f9d-96e7-c480e0d6d5aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:41 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-0348c114-b505-40c4-a110-171275691d8c tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Volume 15716f06-6315-429b-8416-3f2df77d1031: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15716f06-6315-429b-8416-3f2df77d1031', 'volume_size': 1} Aug 10 16:04:41 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-0348c114-b505-40c4-a110-171275691d8c tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:04:41 devstack sudo[100920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4333f588-ce3f-44ad-8bfb-ae14592f03ca Aug 10 16:04:41 devstack sudo[100920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:42 devstack sudo[100920]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:42 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-950a422f-c99f-47d1-bdb1-5e111e37b55a tempest-VolumesCloneTest-1548246695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4333f588-ce3f-44ad-8bfb-ae14592f03ca" returned: 0 in 0.368s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:42 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-950a422f-c99f-47d1-bdb1-5e111e37b55a tempest-VolumesCloneTest-1548246695 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4333f588-ce3f-44ad-8bfb-ae14592f03ca {{(pid=88641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 10 16:04:42 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-950a422f-c99f-47d1-bdb1-5e111e37b55a tempest-VolumesCloneTest-1548246695 None] Creating direct copy from snapshot {{(pid=88641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 10 16:04:42 devstack cinder-volume[88641]: DEBUG cinder.utils [None req-950a422f-c99f-47d1-bdb1-5e111e37b55a tempest-VolumesCloneTest-1548246695 None] Path /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-943801b4-7e15-48d9-870b-ea4a1576ae3a not found in is_blk_device check {{(pid=88641) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 10 16:04:42 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-950a422f-c99f-47d1-bdb1-5e111e37b55a tempest-VolumesCloneTest-1548246695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4333f588-ce3f-44ad-8bfb-ae14592f03ca /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-943801b4-7e15-48d9-870b-ea4a1576ae3a {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:42 devstack sudo[100926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4333f588-ce3f-44ad-8bfb-ae14592f03ca /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-943801b4-7e15-48d9-870b-ea4a1576ae3a Aug 10 16:04:42 devstack sudo[100926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:47 devstack sudo[100926]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:47 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-950a422f-c99f-47d1-bdb1-5e111e37b55a tempest-VolumesCloneTest-1548246695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4333f588-ce3f-44ad-8bfb-ae14592f03ca /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-943801b4-7e15-48d9-870b-ea4a1576ae3a" returned: 0 in 5.245s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:47 devstack cinder-volume[88641]: DEBUG cinder.image.image_utils [None req-950a422f-c99f-47d1-bdb1-5e111e37b55a tempest-VolumesCloneTest-1548246695 None] Image conversion details: src /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4333f588-ce3f-44ad-8bfb-ae14592f03ca, size 1024.00 MB, duration 5.25 sec, destination /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-943801b4-7e15-48d9-870b-ea4a1576ae3a {{(pid=88641) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 10 16:04:47 devstack cinder-volume[88641]: INFO cinder.image.image_utils [None req-950a422f-c99f-47d1-bdb1-5e111e37b55a tempest-VolumesCloneTest-1548246695 None] Converted 1024.00 MB image at 195.17 MB/s Aug 10 16:04:47 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-950a422f-c99f-47d1-bdb1-5e111e37b55a tempest-VolumesCloneTest-1548246695 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-943801b4-7e15-48d9-870b-ea4a1576ae3a is being set with open permissions: ugo+rw Aug 10 16:04:47 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-950a422f-c99f-47d1-bdb1-5e111e37b55a tempest-VolumesCloneTest-1548246695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-943801b4-7e15-48d9-870b-ea4a1576ae3a {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:47 devstack sudo[100975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-943801b4-7e15-48d9-870b-ea4a1576ae3a Aug 10 16:04:47 devstack sudo[100975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:47 devstack sudo[100975]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:47 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-950a422f-c99f-47d1-bdb1-5e111e37b55a tempest-VolumesCloneTest-1548246695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-943801b4-7e15-48d9-870b-ea4a1576ae3a" returned: 0 in 0.277s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:47 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-950a422f-c99f-47d1-bdb1-5e111e37b55a tempest-VolumesCloneTest-1548246695 None] Lock "cinder-quobyte-943801b4-7e15-48d9-870b-ea4a1576ae3a" released by "_copy_volume_from_snapshot" :: held 6.551s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:04:47 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-950a422f-c99f-47d1-bdb1-5e111e37b55a tempest-VolumesCloneTest-1548246695 None] Acquiring lock "cinder-quobyte-f541cafa-3ebd-4a5b-823c-21c31b5cd84d" by "_delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:04:47 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-950a422f-c99f-47d1-bdb1-5e111e37b55a tempest-VolumesCloneTest-1548246695 None] Lock "cinder-quobyte-f541cafa-3ebd-4a5b-823c-21c31b5cd84d" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:04:47 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-950a422f-c99f-47d1-bdb1-5e111e37b55a tempest-VolumesCloneTest-1548246695 None] Deleting offline snapshot f541cafa-3ebd-4a5b-823c-21c31b5cd84d of volume 4333f588-ce3f-44ad-8bfb-ae14592f03ca {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 16:04:47 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-950a422f-c99f-47d1-bdb1-5e111e37b55a tempest-VolumesCloneTest-1548246695 None] snapshot_file for this snap is: volume-4333f588-ce3f-44ad-8bfb-ae14592f03ca.f541cafa-3ebd-4a5b-823c-21c31b5cd84d {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 16:04:47 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[573ac411-5505-4dc2-ae5e-259770544ff9]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:04:47 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-950a422f-c99f-47d1-bdb1-5e111e37b55a tempest-VolumesCloneTest-1548246695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4333f588-ce3f-44ad-8bfb-ae14592f03ca.f541cafa-3ebd-4a5b-823c-21c31b5cd84d {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:47 devstack sudo[100978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4333f588-ce3f-44ad-8bfb-ae14592f03ca.f541cafa-3ebd-4a5b-823c-21c31b5cd84d Aug 10 16:04:47 devstack sudo[100978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:48 devstack sudo[100978]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:48 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-950a422f-c99f-47d1-bdb1-5e111e37b55a tempest-VolumesCloneTest-1548246695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4333f588-ce3f-44ad-8bfb-ae14592f03ca.f541cafa-3ebd-4a5b-823c-21c31b5cd84d" returned: 0 in 0.362s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:48 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-950a422f-c99f-47d1-bdb1-5e111e37b55a tempest-VolumesCloneTest-1548246695 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4333f588-ce3f-44ad-8bfb-ae14592f03ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 16:04:48 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5732c1-b581-4ea3-92da-e91cb4920151]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:04:48 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-950a422f-c99f-47d1-bdb1-5e111e37b55a tempest-VolumesCloneTest-1548246695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4333f588-ce3f-44ad-8bfb-ae14592f03ca {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:48 devstack sudo[100983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4333f588-ce3f-44ad-8bfb-ae14592f03ca Aug 10 16:04:48 devstack sudo[100983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:48 devstack sudo[100983]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:48 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-950a422f-c99f-47d1-bdb1-5e111e37b55a tempest-VolumesCloneTest-1548246695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4333f588-ce3f-44ad-8bfb-ae14592f03ca" returned: 0 in 0.526s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:48 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-950a422f-c99f-47d1-bdb1-5e111e37b55a tempest-VolumesCloneTest-1548246695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4333f588-ce3f-44ad-8bfb-ae14592f03ca.f541cafa-3ebd-4a5b-823c-21c31b5cd84d {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:48 devstack sudo[100988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4333f588-ce3f-44ad-8bfb-ae14592f03ca.f541cafa-3ebd-4a5b-823c-21c31b5cd84d Aug 10 16:04:48 devstack sudo[100988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:48 devstack sudo[100988]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:48 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-950a422f-c99f-47d1-bdb1-5e111e37b55a tempest-VolumesCloneTest-1548246695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4333f588-ce3f-44ad-8bfb-ae14592f03ca.f541cafa-3ebd-4a5b-823c-21c31b5cd84d" returned: 0 in 0.326s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:48 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-950a422f-c99f-47d1-bdb1-5e111e37b55a tempest-VolumesCloneTest-1548246695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4333f588-ce3f-44ad-8bfb-ae14592f03ca.f541cafa-3ebd-4a5b-823c-21c31b5cd84d {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:49 devstack sudo[100993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4333f588-ce3f-44ad-8bfb-ae14592f03ca.f541cafa-3ebd-4a5b-823c-21c31b5cd84d Aug 10 16:04:49 devstack sudo[100993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:49 devstack sudo[100993]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:49 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-950a422f-c99f-47d1-bdb1-5e111e37b55a tempest-VolumesCloneTest-1548246695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4333f588-ce3f-44ad-8bfb-ae14592f03ca.f541cafa-3ebd-4a5b-823c-21c31b5cd84d" returned: 0 in 0.240s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:49 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-950a422f-c99f-47d1-bdb1-5e111e37b55a tempest-VolumesCloneTest-1548246695 None] Lock "cinder-quobyte-f541cafa-3ebd-4a5b-823c-21c31b5cd84d" released by "_delete_snapshot" :: held 1.543s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:04:49 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-950a422f-c99f-47d1-bdb1-5e111e37b55a tempest-VolumesCloneTest-1548246695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.920s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:04:49 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-9ad84ceb-ba46-45ac-a8fd-5eab52248558 tempest-AttachVolumeTestJSON-1986652723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.836s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:04:49 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-9ad84ceb-ba46-45ac-a8fd-5eab52248558 tempest-AttachVolumeTestJSON-1986652723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:04:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1805450276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc438c0e-1676-438a-9b4f-96fa01a2d708,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc33fe4b7ee34471b4438bd107c7a225',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:04:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:04:39Z,use_quota=True,user_id='daca380af8ab42918d1d1f5815ed4f3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:04:49 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-9ad84ceb-ba46-45ac-a8fd-5eab52248558 tempest-AttachVolumeTestJSON-1986652723 None] Creating volume fc438c0e-1676-438a-9b4f-96fa01a2d708 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:04:49 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-9ad84ceb-ba46-45ac-a8fd-5eab52248558 tempest-AttachVolumeTestJSON-1986652723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:04:49 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-9ad84ceb-ba46-45ac-a8fd-5eab52248558 tempest-AttachVolumeTestJSON-1986652723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:04:49 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-9ad84ceb-ba46-45ac-a8fd-5eab52248558 tempest-AttachVolumeTestJSON-1986652723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:04:49 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-9ad84ceb-ba46-45ac-a8fd-5eab52248558 tempest-AttachVolumeTestJSON-1986652723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:04:49 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-9ad84ceb-ba46-45ac-a8fd-5eab52248558 tempest-AttachVolumeTestJSON-1986652723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:04:49 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-9ad84ceb-ba46-45ac-a8fd-5eab52248558 tempest-AttachVolumeTestJSON-1986652723 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:04:49 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-9ad84ceb-ba46-45ac-a8fd-5eab52248558 tempest-AttachVolumeTestJSON-1986652723 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:04:49 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9ad84ceb-ba46-45ac-a8fd-5eab52248558 tempest-AttachVolumeTestJSON-1986652723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-fc438c0e-1676-438a-9b4f-96fa01a2d708 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:49 devstack sudo[100996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-fc438c0e-1676-438a-9b4f-96fa01a2d708 1073741824 Aug 10 16:04:49 devstack sudo[100996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:49 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-950a422f-c99f-47d1-bdb1-5e111e37b55a tempest-VolumesCloneTest-1548246695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cedfb99-21ed-43f5-ab0f-f1601759a0c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-943801b4-7e15-48d9-870b-ea4a1576ae3a', 'volume_size': 2, 'source_volid': '4333f588-ce3f-44ad-8bfb-ae14592f03ca', 'source_volstatus': 'available'}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:49 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-950a422f-c99f-47d1-bdb1-5e111e37b55a tempest-VolumesCloneTest-1548246695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c85a2733-e99e-44a7-bd25-5a97f01807d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:49 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-950a422f-c99f-47d1-bdb1-5e111e37b55a tempest-VolumesCloneTest-1548246695 None] Volume volume-943801b4-7e15-48d9-870b-ea4a1576ae3a (943801b4-7e15-48d9-870b-ea4a1576ae3a): created successfully Aug 10 16:04:49 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-950a422f-c99f-47d1-bdb1-5e111e37b55a tempest-VolumesCloneTest-1548246695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c85a2733-e99e-44a7-bd25-5a97f01807d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:49 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-950a422f-c99f-47d1-bdb1-5e111e37b55a tempest-VolumesCloneTest-1548246695 None] Flow 'volume_create_manager' (2cc27c8e-4ef1-453b-87a1-58817ed6ab72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:04:49 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-950a422f-c99f-47d1-bdb1-5e111e37b55a tempest-VolumesCloneTest-1548246695 None] Created volume successfully. Aug 10 16:04:49 devstack sudo[100996]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:49 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9ad84ceb-ba46-45ac-a8fd-5eab52248558 tempest-AttachVolumeTestJSON-1986652723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-fc438c0e-1676-438a-9b4f-96fa01a2d708 1073741824" returned: 0 in 0.437s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:49 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9ad84ceb-ba46-45ac-a8fd-5eab52248558 tempest-AttachVolumeTestJSON-1986652723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-fc438c0e-1676-438a-9b4f-96fa01a2d708 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:49 devstack sudo[101001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-fc438c0e-1676-438a-9b4f-96fa01a2d708 Aug 10 16:04:49 devstack sudo[101001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:49 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-5d929a41-5138-4c04-9d39-315ec5c68fc8 tempest-VolumesCloneTest-1548246695 None] Acquiring lock "cinder-943801b4-7e15-48d9-870b-ea4a1576ae3a-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:04:50 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-5d929a41-5138-4c04-9d39-315ec5c68fc8 tempest-VolumesCloneTest-1548246695 None] Lock "cinder-943801b4-7e15-48d9-870b-ea4a1576ae3a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:04:50 devstack sudo[101001]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9ad84ceb-ba46-45ac-a8fd-5eab52248558 tempest-AttachVolumeTestJSON-1986652723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-fc438c0e-1676-438a-9b4f-96fa01a2d708" returned: 0 in 0.273s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:50 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-9ad84ceb-ba46-45ac-a8fd-5eab52248558 tempest-AttachVolumeTestJSON-1986652723 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:04:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-9ad84ceb-ba46-45ac-a8fd-5eab52248558 tempest-AttachVolumeTestJSON-1986652723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:04:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-38bbea0a-0a0f-4521-bfe1-546c675711b3 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.968s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:04:50 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-38bbea0a-0a0f-4521-bfe1-546c675711b3 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:04:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-411639978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9a1eb27-a971-412e-9f59-1038f8db703e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b96c5c7254104cfb9786cc2236c76300',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:04:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:04:40Z,use_quota=True,user_id='1394bc988a7f4d36b84f95a5b50507fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:04:50 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-38bbea0a-0a0f-4521-bfe1-546c675711b3 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Creating volume b9a1eb27-a971-412e-9f59-1038f8db703e {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:04:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-38bbea0a-0a0f-4521-bfe1-546c675711b3 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:04:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-38bbea0a-0a0f-4521-bfe1-546c675711b3 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:04:50 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-38bbea0a-0a0f-4521-bfe1-546c675711b3 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:04:50 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-38bbea0a-0a0f-4521-bfe1-546c675711b3 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:04:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-38bbea0a-0a0f-4521-bfe1-546c675711b3 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:04:50 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-38bbea0a-0a0f-4521-bfe1-546c675711b3 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:04:50 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-38bbea0a-0a0f-4521-bfe1-546c675711b3 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:04:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-38bbea0a-0a0f-4521-bfe1-546c675711b3 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b9a1eb27-a971-412e-9f59-1038f8db703e 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:50 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-5d929a41-5138-4c04-9d39-315ec5c68fc8 tempest-VolumesCloneTest-1548246695 None] Acquiring lock "cinder-quobyte-943801b4-7e15-48d9-870b-ea4a1576ae3a" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:04:50 devstack sudo[101004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b9a1eb27-a971-412e-9f59-1038f8db703e 1073741824 Aug 10 16:04:50 devstack sudo[101004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:50 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9ad84ceb-ba46-45ac-a8fd-5eab52248558 tempest-AttachVolumeTestJSON-1986652723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c92e5a40-1d15-48e3-bf19-99a5a45e3c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc438c0e-1676-438a-9b4f-96fa01a2d708', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:50 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9ad84ceb-ba46-45ac-a8fd-5eab52248558 tempest-AttachVolumeTestJSON-1986652723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65eb36a6-228b-42ea-bf0e-e58cbc6d6ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:50 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-5d929a41-5138-4c04-9d39-315ec5c68fc8 tempest-VolumesCloneTest-1548246695 None] Lock "cinder-quobyte-943801b4-7e15-48d9-870b-ea4a1576ae3a" acquired by "delete_volume" :: waited 0.034s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:04:50 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-9ad84ceb-ba46-45ac-a8fd-5eab52248558 tempest-AttachVolumeTestJSON-1986652723 None] Volume volume-fc438c0e-1676-438a-9b4f-96fa01a2d708 (fc438c0e-1676-438a-9b4f-96fa01a2d708): created successfully Aug 10 16:04:50 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9ad84ceb-ba46-45ac-a8fd-5eab52248558 tempest-AttachVolumeTestJSON-1986652723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65eb36a6-228b-42ea-bf0e-e58cbc6d6ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:50 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9ad84ceb-ba46-45ac-a8fd-5eab52248558 tempest-AttachVolumeTestJSON-1986652723 None] Flow 'volume_create_manager' (18ae5584-041c-4e28-a4cb-ffb20953936b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:04:50 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[098c8dd8-56af-4dda-9f24-a1c4876da8de]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:04:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5d929a41-5138-4c04-9d39-315ec5c68fc8 tempest-VolumesCloneTest-1548246695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-943801b4-7e15-48d9-870b-ea4a1576ae3a {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:50 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-9ad84ceb-ba46-45ac-a8fd-5eab52248558 tempest-AttachVolumeTestJSON-1986652723 None] Created volume successfully. Aug 10 16:04:50 devstack sudo[101006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-943801b4-7e15-48d9-870b-ea4a1576ae3a Aug 10 16:04:50 devstack sudo[101006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:50 devstack sudo[101004]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-38bbea0a-0a0f-4521-bfe1-546c675711b3 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b9a1eb27-a971-412e-9f59-1038f8db703e 1073741824" returned: 0 in 0.504s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:50 devstack sudo[101006]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5d929a41-5138-4c04-9d39-315ec5c68fc8 tempest-VolumesCloneTest-1548246695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-943801b4-7e15-48d9-870b-ea4a1576ae3a" returned: 0 in 0.428s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5d929a41-5138-4c04-9d39-315ec5c68fc8 tempest-VolumesCloneTest-1548246695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-943801b4-7e15-48d9-870b-ea4a1576ae3a {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:50 devstack sudo[101017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-943801b4-7e15-48d9-870b-ea4a1576ae3a Aug 10 16:04:50 devstack sudo[101017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-38bbea0a-0a0f-4521-bfe1-546c675711b3 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b9a1eb27-a971-412e-9f59-1038f8db703e {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:50 devstack sudo[101019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b9a1eb27-a971-412e-9f59-1038f8db703e Aug 10 16:04:50 devstack sudo[101019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:50 devstack sudo[101017]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5d929a41-5138-4c04-9d39-315ec5c68fc8 tempest-VolumesCloneTest-1548246695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-943801b4-7e15-48d9-870b-ea4a1576ae3a" returned: 0 in 0.272s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:50 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-5d929a41-5138-4c04-9d39-315ec5c68fc8 tempest-VolumesCloneTest-1548246695 None] Lock "cinder-quobyte-943801b4-7e15-48d9-870b-ea4a1576ae3a" released by "delete_volume" :: held 0.754s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:04:50 devstack sudo[101019]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-38bbea0a-0a0f-4521-bfe1-546c675711b3 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b9a1eb27-a971-412e-9f59-1038f8db703e" returned: 0 in 0.277s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:50 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-38bbea0a-0a0f-4521-bfe1-546c675711b3 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] <== create_volume: return (845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:04:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-38bbea0a-0a0f-4521-bfe1-546c675711b3 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.848s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:04:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-5b19d6d2-faa3-4d08-8942-8197eda58187 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.314s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:04:50 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-5b19d6d2-faa3-4d08-8942-8197eda58187 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:04:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1336932050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7586c173-0e1c-4c40-9081-9eb7981a1340,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b96c5c7254104cfb9786cc2236c76300',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:04:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:04:40Z,use_quota=True,user_id='1394bc988a7f4d36b84f95a5b50507fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:04:50 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-5b19d6d2-faa3-4d08-8942-8197eda58187 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Creating volume 7586c173-0e1c-4c40-9081-9eb7981a1340 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:04:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-5b19d6d2-faa3-4d08-8942-8197eda58187 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:04:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-5b19d6d2-faa3-4d08-8942-8197eda58187 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:04:50 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-5b19d6d2-faa3-4d08-8942-8197eda58187 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:04:50 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-5b19d6d2-faa3-4d08-8942-8197eda58187 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:04:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-5b19d6d2-faa3-4d08-8942-8197eda58187 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:04:50 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-5b19d6d2-faa3-4d08-8942-8197eda58187 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:04:50 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-5b19d6d2-faa3-4d08-8942-8197eda58187 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:04:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5b19d6d2-faa3-4d08-8942-8197eda58187 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-7586c173-0e1c-4c40-9081-9eb7981a1340 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:50 devstack sudo[101023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-7586c173-0e1c-4c40-9081-9eb7981a1340 1073741824 Aug 10 16:04:50 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-38bbea0a-0a0f-4521-bfe1-546c675711b3 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fa8b53d-78e9-4fad-88a0-493a233a51cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9a1eb27-a971-412e-9f59-1038f8db703e', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:50 devstack sudo[101023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:50 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-38bbea0a-0a0f-4521-bfe1-546c675711b3 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f78942b3-c26d-482e-9f79-179a9666be3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:50 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-38bbea0a-0a0f-4521-bfe1-546c675711b3 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Volume volume-b9a1eb27-a971-412e-9f59-1038f8db703e (b9a1eb27-a971-412e-9f59-1038f8db703e): created successfully Aug 10 16:04:50 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-38bbea0a-0a0f-4521-bfe1-546c675711b3 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f78942b3-c26d-482e-9f79-179a9666be3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:50 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-38bbea0a-0a0f-4521-bfe1-546c675711b3 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Flow 'volume_create_manager' (bbc37922-57c4-4aa4-9cfb-069609e4a8f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:04:50 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-5d929a41-5138-4c04-9d39-315ec5c68fc8 tempest-VolumesCloneTest-1548246695 None] Created reservations ['d6086693-3128-4531-8354-6d28f386eb69', 'dbba15a5-a59d-43f8-929c-69baa06d872c', 'a27ce7fe-49c4-44ef-a12e-01e411e50369', '7abf85ae-9035-4bb7-921b-78708d3f6d3c'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:04:50 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-38bbea0a-0a0f-4521-bfe1-546c675711b3 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Created volume successfully. Aug 10 16:04:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-5d929a41-5138-4c04-9d39-315ec5c68fc8 tempest-VolumesCloneTest-1548246695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:04:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-5d929a41-5138-4c04-9d39-315ec5c68fc8 tempest-VolumesCloneTest-1548246695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:04:51 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-5d929a41-5138-4c04-9d39-315ec5c68fc8 tempest-VolumesCloneTest-1548246695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:04:51 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-5d929a41-5138-4c04-9d39-315ec5c68fc8 tempest-VolumesCloneTest-1548246695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:04:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-5d929a41-5138-4c04-9d39-315ec5c68fc8 tempest-VolumesCloneTest-1548246695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:04:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5d929a41-5138-4c04-9d39-315ec5c68fc8 tempest-VolumesCloneTest-1548246695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:51 devstack sudo[101025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:04:51 devstack sudo[101025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:51 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-3e62fa41-b442-452a-bbde-52fb0e53b00e tempest-VolumesCloneTest-1548246695 None] Acquiring lock "cinder-4333f588-ce3f-44ad-8bfb-ae14592f03ca-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:04:51 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-3e62fa41-b442-452a-bbde-52fb0e53b00e tempest-VolumesCloneTest-1548246695 None] Lock "cinder-4333f588-ce3f-44ad-8bfb-ae14592f03ca-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:04:51 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-3e62fa41-b442-452a-bbde-52fb0e53b00e tempest-VolumesCloneTest-1548246695 None] Acquiring lock "cinder-quobyte-4333f588-ce3f-44ad-8bfb-ae14592f03ca" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:04:51 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-3e62fa41-b442-452a-bbde-52fb0e53b00e tempest-VolumesCloneTest-1548246695 None] Lock "cinder-quobyte-4333f588-ce3f-44ad-8bfb-ae14592f03ca" acquired by "delete_volume" :: waited 0.026s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:04:51 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[986d4e3c-9073-4b2b-9d3e-ef7cd57b53e6]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:04:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-3e62fa41-b442-452a-bbde-52fb0e53b00e tempest-VolumesCloneTest-1548246695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4333f588-ce3f-44ad-8bfb-ae14592f03ca {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:51 devstack sudo[101025]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5d929a41-5138-4c04-9d39-315ec5c68fc8 tempest-VolumesCloneTest-1548246695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.316s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:51 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-5d929a41-5138-4c04-9d39-315ec5c68fc8 tempest-VolumesCloneTest-1548246695 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:04:51 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-5d929a41-5138-4c04-9d39-315ec5c68fc8 tempest-VolumesCloneTest-1548246695 None] Deleted volume successfully. Aug 10 16:04:51 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-5d929a41-5138-4c04-9d39-315ec5c68fc8 tempest-VolumesCloneTest-1548246695 None] Lock "cinder-943801b4-7e15-48d9-870b-ea4a1576ae3a-delete_volume" released by "delete_volume" :: held 1.475s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:04:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-143ea25d-3223-47a7-9c87-057b2252e9bd req-fd2e6ccd-4596-420f-9427-996da634de3b tempest-AttachVolumeTestJSON-1986652723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:04:51 devstack sudo[101023]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5b19d6d2-faa3-4d08-8942-8197eda58187 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-7586c173-0e1c-4c40-9081-9eb7981a1340 1073741824" returned: 0 in 0.613s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:51 devstack sudo[101040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4333f588-ce3f-44ad-8bfb-ae14592f03ca Aug 10 16:04:51 devstack sudo[101040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5b19d6d2-faa3-4d08-8942-8197eda58187 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-7586c173-0e1c-4c40-9081-9eb7981a1340 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:51 devstack sudo[101043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-7586c173-0e1c-4c40-9081-9eb7981a1340 Aug 10 16:04:51 devstack sudo[101043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:51 devstack sudo[101040]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-3e62fa41-b442-452a-bbde-52fb0e53b00e tempest-VolumesCloneTest-1548246695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4333f588-ce3f-44ad-8bfb-ae14592f03ca" returned: 0 in 0.388s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-3e62fa41-b442-452a-bbde-52fb0e53b00e tempest-VolumesCloneTest-1548246695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4333f588-ce3f-44ad-8bfb-ae14592f03ca {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:51 devstack sudo[101043]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5b19d6d2-faa3-4d08-8942-8197eda58187 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-7586c173-0e1c-4c40-9081-9eb7981a1340" returned: 0 in 0.263s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:51 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-5b19d6d2-faa3-4d08-8942-8197eda58187 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:04:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-5b19d6d2-faa3-4d08-8942-8197eda58187 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:04:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-86f6a2dd-ac30-48c0-90e6-26c8d59c2e93 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.799s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:04:51 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-86f6a2dd-ac30-48c0-90e6-26c8d59c2e93 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:04:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-281839388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a206c8ed-073a-45cc-a858-00379742e74a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b96c5c7254104cfb9786cc2236c76300',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:04:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:04:41Z,use_quota=True,user_id='1394bc988a7f4d36b84f95a5b50507fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:04:51 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-86f6a2dd-ac30-48c0-90e6-26c8d59c2e93 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Creating volume a206c8ed-073a-45cc-a858-00379742e74a {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:04:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-86f6a2dd-ac30-48c0-90e6-26c8d59c2e93 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:04:51 devstack sudo[101049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4333f588-ce3f-44ad-8bfb-ae14592f03ca Aug 10 16:04:51 devstack sudo[101049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-86f6a2dd-ac30-48c0-90e6-26c8d59c2e93 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:04:51 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-86f6a2dd-ac30-48c0-90e6-26c8d59c2e93 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:04:51 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-86f6a2dd-ac30-48c0-90e6-26c8d59c2e93 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:04:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-86f6a2dd-ac30-48c0-90e6-26c8d59c2e93 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:04:51 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-86f6a2dd-ac30-48c0-90e6-26c8d59c2e93 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:04:51 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-86f6a2dd-ac30-48c0-90e6-26c8d59c2e93 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:04:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-86f6a2dd-ac30-48c0-90e6-26c8d59c2e93 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a206c8ed-073a-45cc-a858-00379742e74a 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:51 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-5b19d6d2-faa3-4d08-8942-8197eda58187 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3db14089-6251-42ec-8b01-d264af2d08b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7586c173-0e1c-4c40-9081-9eb7981a1340', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:51 devstack sudo[101051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a206c8ed-073a-45cc-a858-00379742e74a 1073741824 Aug 10 16:04:51 devstack sudo[101051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:51 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-5b19d6d2-faa3-4d08-8942-8197eda58187 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8604bb9a-4fa4-4ca2-8f72-17e956538c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:51 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-5b19d6d2-faa3-4d08-8942-8197eda58187 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Volume volume-7586c173-0e1c-4c40-9081-9eb7981a1340 (7586c173-0e1c-4c40-9081-9eb7981a1340): created successfully Aug 10 16:04:51 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-5b19d6d2-faa3-4d08-8942-8197eda58187 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8604bb9a-4fa4-4ca2-8f72-17e956538c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:51 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-5b19d6d2-faa3-4d08-8942-8197eda58187 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Flow 'volume_create_manager' (54a56e9c-1e8c-4b72-9980-21c7d15856dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:04:51 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-5b19d6d2-faa3-4d08-8942-8197eda58187 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Created volume successfully. Aug 10 16:04:52 devstack sudo[101049]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-3e62fa41-b442-452a-bbde-52fb0e53b00e tempest-VolumesCloneTest-1548246695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4333f588-ce3f-44ad-8bfb-ae14592f03ca" returned: 0 in 0.258s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:52 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-3e62fa41-b442-452a-bbde-52fb0e53b00e tempest-VolumesCloneTest-1548246695 None] Lock "cinder-quobyte-4333f588-ce3f-44ad-8bfb-ae14592f03ca" released by "delete_volume" :: held 0.719s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:04:52 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-3e62fa41-b442-452a-bbde-52fb0e53b00e tempest-VolumesCloneTest-1548246695 None] Created reservations ['881c22b9-8807-4f6b-a8b2-c3c362dca38d', 'a1c3557a-8ced-4ca7-a850-d667d8373440', '26379235-f639-4706-9108-07d5b67af9ce', 'c5956160-b9ba-43d9-9c91-c3c4ebf2332c'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:04:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-3e62fa41-b442-452a-bbde-52fb0e53b00e tempest-VolumesCloneTest-1548246695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:04:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-3e62fa41-b442-452a-bbde-52fb0e53b00e tempest-VolumesCloneTest-1548246695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:04:52 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-3e62fa41-b442-452a-bbde-52fb0e53b00e tempest-VolumesCloneTest-1548246695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:04:52 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-3e62fa41-b442-452a-bbde-52fb0e53b00e tempest-VolumesCloneTest-1548246695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:04:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-3e62fa41-b442-452a-bbde-52fb0e53b00e tempest-VolumesCloneTest-1548246695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:04:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-3e62fa41-b442-452a-bbde-52fb0e53b00e tempest-VolumesCloneTest-1548246695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:52 devstack sudo[101058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:04:52 devstack sudo[101058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:52 devstack sudo[101051]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-86f6a2dd-ac30-48c0-90e6-26c8d59c2e93 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a206c8ed-073a-45cc-a858-00379742e74a 1073741824" returned: 0 in 0.494s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-86f6a2dd-ac30-48c0-90e6-26c8d59c2e93 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a206c8ed-073a-45cc-a858-00379742e74a {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:52 devstack sudo[101061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a206c8ed-073a-45cc-a858-00379742e74a Aug 10 16:04:52 devstack sudo[101061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:52 devstack sudo[101058]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-3e62fa41-b442-452a-bbde-52fb0e53b00e tempest-VolumesCloneTest-1548246695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.260s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:52 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-3e62fa41-b442-452a-bbde-52fb0e53b00e tempest-VolumesCloneTest-1548246695 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:04:52 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-3e62fa41-b442-452a-bbde-52fb0e53b00e tempest-VolumesCloneTest-1548246695 None] Deleted volume successfully. Aug 10 16:04:52 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-3e62fa41-b442-452a-bbde-52fb0e53b00e tempest-VolumesCloneTest-1548246695 None] Lock "cinder-4333f588-ce3f-44ad-8bfb-ae14592f03ca-delete_volume" released by "delete_volume" :: held 1.234s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:04:52 devstack sudo[101061]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-86f6a2dd-ac30-48c0-90e6-26c8d59c2e93 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a206c8ed-073a-45cc-a858-00379742e74a" returned: 0 in 0.267s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:52 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-86f6a2dd-ac30-48c0-90e6-26c8d59c2e93 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:04:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-86f6a2dd-ac30-48c0-90e6-26c8d59c2e93 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:04:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-2a4a182b-9160-4572-910b-04cfdd3bd232 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.230s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:04:52 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-2a4a182b-9160-4572-910b-04cfdd3bd232 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:04:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-84906466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2092c34d-6faf-4ed1-b9b0-98d20afa7723,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b96c5c7254104cfb9786cc2236c76300',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:04:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:04:41Z,use_quota=True,user_id='1394bc988a7f4d36b84f95a5b50507fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:04:52 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-2a4a182b-9160-4572-910b-04cfdd3bd232 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Creating volume 2092c34d-6faf-4ed1-b9b0-98d20afa7723 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:04:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-2a4a182b-9160-4572-910b-04cfdd3bd232 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:04:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-2a4a182b-9160-4572-910b-04cfdd3bd232 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:04:52 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-2a4a182b-9160-4572-910b-04cfdd3bd232 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:04:52 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-2a4a182b-9160-4572-910b-04cfdd3bd232 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:04:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-2a4a182b-9160-4572-910b-04cfdd3bd232 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:04:52 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-2a4a182b-9160-4572-910b-04cfdd3bd232 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:04:52 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-2a4a182b-9160-4572-910b-04cfdd3bd232 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:04:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-2a4a182b-9160-4572-910b-04cfdd3bd232 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2092c34d-6faf-4ed1-b9b0-98d20afa7723 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:52 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-86f6a2dd-ac30-48c0-90e6-26c8d59c2e93 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bb8d5eb-11e6-43f4-91a6-612e8bfd5c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a206c8ed-073a-45cc-a858-00379742e74a', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:52 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-86f6a2dd-ac30-48c0-90e6-26c8d59c2e93 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9eb8c55c-abdb-4bc6-bc1f-10fd49e97bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:52 devstack sudo[101065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2092c34d-6faf-4ed1-b9b0-98d20afa7723 1073741824 Aug 10 16:04:52 devstack sudo[101065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:52 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-86f6a2dd-ac30-48c0-90e6-26c8d59c2e93 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Volume volume-a206c8ed-073a-45cc-a858-00379742e74a (a206c8ed-073a-45cc-a858-00379742e74a): created successfully Aug 10 16:04:52 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-86f6a2dd-ac30-48c0-90e6-26c8d59c2e93 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9eb8c55c-abdb-4bc6-bc1f-10fd49e97bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:52 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-86f6a2dd-ac30-48c0-90e6-26c8d59c2e93 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Flow 'volume_create_manager' (16e5c5ab-b5eb-4d8d-922e-8531d94a9f0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:04:52 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-86f6a2dd-ac30-48c0-90e6-26c8d59c2e93 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Created volume successfully. Aug 10 16:04:53 devstack sudo[101065]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-2a4a182b-9160-4572-910b-04cfdd3bd232 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2092c34d-6faf-4ed1-b9b0-98d20afa7723 1073741824" returned: 0 in 0.523s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-2a4a182b-9160-4572-910b-04cfdd3bd232 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2092c34d-6faf-4ed1-b9b0-98d20afa7723 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:53 devstack sudo[101106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2092c34d-6faf-4ed1-b9b0-98d20afa7723 Aug 10 16:04:53 devstack sudo[101106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:53 devstack sudo[101106]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-2a4a182b-9160-4572-910b-04cfdd3bd232 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2092c34d-6faf-4ed1-b9b0-98d20afa7723" returned: 0 in 0.307s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:53 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-2a4a182b-9160-4572-910b-04cfdd3bd232 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:04:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-2a4a182b-9160-4572-910b-04cfdd3bd232 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:04:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-0348c114-b505-40c4-a110-171275691d8c tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.671s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:04:53 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-0348c114-b505-40c4-a110-171275691d8c tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:04:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2075186739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15716f06-6315-429b-8416-3f2df77d1031,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b96c5c7254104cfb9786cc2236c76300',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:04:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:04:42Z,use_quota=True,user_id='1394bc988a7f4d36b84f95a5b50507fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:04:53 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-0348c114-b505-40c4-a110-171275691d8c tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Creating volume 15716f06-6315-429b-8416-3f2df77d1031 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:04:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-0348c114-b505-40c4-a110-171275691d8c tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:04:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-0348c114-b505-40c4-a110-171275691d8c tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:04:53 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-0348c114-b505-40c4-a110-171275691d8c tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:04:53 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-0348c114-b505-40c4-a110-171275691d8c tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:04:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-0348c114-b505-40c4-a110-171275691d8c tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:04:53 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-0348c114-b505-40c4-a110-171275691d8c tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:04:53 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-0348c114-b505-40c4-a110-171275691d8c tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:04:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0348c114-b505-40c4-a110-171275691d8c tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-15716f06-6315-429b-8416-3f2df77d1031 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:53 devstack sudo[101111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-15716f06-6315-429b-8416-3f2df77d1031 1073741824 Aug 10 16:04:53 devstack sudo[101111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:53 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2a4a182b-9160-4572-910b-04cfdd3bd232 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f7b96a1-8aaf-45bc-b763-2d181135d536) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2092c34d-6faf-4ed1-b9b0-98d20afa7723', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:53 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2a4a182b-9160-4572-910b-04cfdd3bd232 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f450e89c-3a2f-4a31-b2a4-47ff8f401a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:53 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-2a4a182b-9160-4572-910b-04cfdd3bd232 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Volume volume-2092c34d-6faf-4ed1-b9b0-98d20afa7723 (2092c34d-6faf-4ed1-b9b0-98d20afa7723): created successfully Aug 10 16:04:53 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2a4a182b-9160-4572-910b-04cfdd3bd232 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f450e89c-3a2f-4a31-b2a4-47ff8f401a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:53 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2a4a182b-9160-4572-910b-04cfdd3bd232 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Flow 'volume_create_manager' (6cba775c-697e-46b1-a88f-cc1daaa8e892) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:04:53 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-2a4a182b-9160-4572-910b-04cfdd3bd232 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Created volume successfully. Aug 10 16:04:54 devstack sudo[101111]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0348c114-b505-40c4-a110-171275691d8c tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-15716f06-6315-429b-8416-3f2df77d1031 1073741824" returned: 0 in 0.503s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0348c114-b505-40c4-a110-171275691d8c tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-15716f06-6315-429b-8416-3f2df77d1031 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:54 devstack sudo[101117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-15716f06-6315-429b-8416-3f2df77d1031 Aug 10 16:04:54 devstack sudo[101117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:54 devstack sudo[101117]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0348c114-b505-40c4-a110-171275691d8c tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-15716f06-6315-429b-8416-3f2df77d1031" returned: 0 in 0.282s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:54 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-0348c114-b505-40c4-a110-171275691d8c tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:04:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-0348c114-b505-40c4-a110-171275691d8c tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:04:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-143ea25d-3223-47a7-9c87-057b2252e9bd req-fd2e6ccd-4596-420f-9427-996da634de3b tempest-AttachVolumeTestJSON-1986652723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.881s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:04:54 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-0348c114-b505-40c4-a110-171275691d8c tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60a8341d-dde6-4f9d-96e7-c480e0d6d5aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15716f06-6315-429b-8416-3f2df77d1031', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:54 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-0348c114-b505-40c4-a110-171275691d8c tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (830e05b4-0754-433d-8c36-ee90e5de4e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-143ea25d-3223-47a7-9c87-057b2252e9bd req-fd2e6ccd-4596-420f-9427-996da634de3b tempest-AttachVolumeTestJSON-1986652723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:04:54 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-0348c114-b505-40c4-a110-171275691d8c tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Volume volume-15716f06-6315-429b-8416-3f2df77d1031 (15716f06-6315-429b-8416-3f2df77d1031): created successfully Aug 10 16:04:54 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-0348c114-b505-40c4-a110-171275691d8c tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (830e05b4-0754-433d-8c36-ee90e5de4e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:54 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-0348c114-b505-40c4-a110-171275691d8c tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Flow 'volume_create_manager' (b26314a3-18ea-474e-af2b-66c9847fc406) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:04:54 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-0348c114-b505-40c4-a110-171275691d8c tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Created volume successfully. Aug 10 16:04:54 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [req-143ea25d-3223-47a7-9c87-057b2252e9bd req-fd2e6ccd-4596-420f-9427-996da634de3b tempest-AttachVolumeTestJSON-1986652723 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc', 'name': 'volume-fc438c0e-1676-438a-9b4f-96fa01a2d708', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4d041abf-2ccf-4090-88f9-2c0493cb48bf', 'enforce_multipath': True} {{(pid=88641) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 10 16:04:54 devstack cinder-volume[88641]: INFO cinder.volume.manager [req-143ea25d-3223-47a7-9c87-057b2252e9bd req-fd2e6ccd-4596-420f-9427-996da634de3b tempest-AttachVolumeTestJSON-1986652723 None] attachment_update completed successfully. Aug 10 16:04:55 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-c08f71df-8a49-455b-a543-eb77965f8e26 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Acquiring lock "cinder-15716f06-6315-429b-8416-3f2df77d1031-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:04:55 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-c08f71df-8a49-455b-a543-eb77965f8e26 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Lock "cinder-15716f06-6315-429b-8416-3f2df77d1031-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:04:55 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-c08f71df-8a49-455b-a543-eb77965f8e26 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Acquiring lock "cinder-quobyte-15716f06-6315-429b-8416-3f2df77d1031" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:04:55 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-c08f71df-8a49-455b-a543-eb77965f8e26 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Lock "cinder-quobyte-15716f06-6315-429b-8416-3f2df77d1031" acquired by "delete_volume" :: waited 0.023s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:04:55 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[52fc1b65-d509-49eb-98f7-a7343651afee]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:04:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c08f71df-8a49-455b-a543-eb77965f8e26 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-15716f06-6315-429b-8416-3f2df77d1031 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:55 devstack sudo[101125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-15716f06-6315-429b-8416-3f2df77d1031 Aug 10 16:04:55 devstack sudo[101125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:55 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4568920-bce1-47e3-ada8-2e5379faf1b8 tempest-VolumesCloneNegativeTest-969142577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:04:55 devstack sudo[101125]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-f4568920-bce1-47e3-ada8-2e5379faf1b8 tempest-VolumesCloneNegativeTest-969142577 None] Flow 'volume_create_manager' (944cdfbe-6c71-404e-83d3-f87549684e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:04:56 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-f4568920-bce1-47e3-ada8-2e5379faf1b8 tempest-VolumesCloneNegativeTest-969142577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b79dbb1c-0404-4284-80d8-0b990325092c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c08f71df-8a49-455b-a543-eb77965f8e26 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-15716f06-6315-429b-8416-3f2df77d1031" returned: 0 in 0.611s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c08f71df-8a49-455b-a543-eb77965f8e26 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-15716f06-6315-429b-8416-3f2df77d1031 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:56 devstack sudo[101136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-15716f06-6315-429b-8416-3f2df77d1031 Aug 10 16:04:56 devstack sudo[101136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:56 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-f4568920-bce1-47e3-ada8-2e5379faf1b8 tempest-VolumesCloneNegativeTest-969142577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b79dbb1c-0404-4284-80d8-0b990325092c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:04:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-331141320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78851337-cf58-4159-bff1-fd229a65536e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4d7c3903a6e4c9aad120b92b18f04a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:04:56Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:04:56Z,use_quota=True,user_id='c4e1571e0c2b4107ad6877384af9b3a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:56 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-f4568920-bce1-47e3-ada8-2e5379faf1b8 tempest-VolumesCloneNegativeTest-969142577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02c8edcd-2124-47f7-9489-d9171911283e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:56 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-f4568920-bce1-47e3-ada8-2e5379faf1b8 tempest-VolumesCloneNegativeTest-969142577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02c8edcd-2124-47f7-9489-d9171911283e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:56 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-f4568920-bce1-47e3-ada8-2e5379faf1b8 tempest-VolumesCloneNegativeTest-969142577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d23e41c6-42e9-408f-802f-59c171c3d96e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:56 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-f4568920-bce1-47e3-ada8-2e5379faf1b8 tempest-VolumesCloneNegativeTest-969142577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d23e41c6-42e9-408f-802f-59c171c3d96e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78851337-cf58-4159-bff1-fd229a65536e', 'volume_name': 'volume-78851337-cf58-4159-bff1-fd229a65536e', 'volume_size': 2}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:56 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-f4568920-bce1-47e3-ada8-2e5379faf1b8 tempest-VolumesCloneNegativeTest-969142577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f3212fd-931c-4c23-837c-87f8084f902d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:56 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-f4568920-bce1-47e3-ada8-2e5379faf1b8 tempest-VolumesCloneNegativeTest-969142577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f3212fd-931c-4c23-837c-87f8084f902d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:56 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-f4568920-bce1-47e3-ada8-2e5379faf1b8 tempest-VolumesCloneNegativeTest-969142577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db4d6bc4-8dc1-431c-8ffc-2283d6f7ac2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:56 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-f4568920-bce1-47e3-ada8-2e5379faf1b8 tempest-VolumesCloneNegativeTest-969142577 None] Volume 78851337-cf58-4159-bff1-fd229a65536e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78851337-cf58-4159-bff1-fd229a65536e', 'volume_size': 2} Aug 10 16:04:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-f4568920-bce1-47e3-ada8-2e5379faf1b8 tempest-VolumesCloneNegativeTest-969142577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:04:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-f4568920-bce1-47e3-ada8-2e5379faf1b8 tempest-VolumesCloneNegativeTest-969142577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:04:56 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-f4568920-bce1-47e3-ada8-2e5379faf1b8 tempest-VolumesCloneNegativeTest-969142577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:04:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-331141320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78851337-cf58-4159-bff1-fd229a65536e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4d7c3903a6e4c9aad120b92b18f04a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:04:56Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:04:56Z,use_quota=True,user_id='c4e1571e0c2b4107ad6877384af9b3a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:04:56 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-f4568920-bce1-47e3-ada8-2e5379faf1b8 tempest-VolumesCloneNegativeTest-969142577 None] Creating volume 78851337-cf58-4159-bff1-fd229a65536e {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:04:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-f4568920-bce1-47e3-ada8-2e5379faf1b8 tempest-VolumesCloneNegativeTest-969142577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:04:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-f4568920-bce1-47e3-ada8-2e5379faf1b8 tempest-VolumesCloneNegativeTest-969142577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:04:56 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-f4568920-bce1-47e3-ada8-2e5379faf1b8 tempest-VolumesCloneNegativeTest-969142577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:04:56 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-f4568920-bce1-47e3-ada8-2e5379faf1b8 tempest-VolumesCloneNegativeTest-969142577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:04:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-f4568920-bce1-47e3-ada8-2e5379faf1b8 tempest-VolumesCloneNegativeTest-969142577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:04:56 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-f4568920-bce1-47e3-ada8-2e5379faf1b8 tempest-VolumesCloneNegativeTest-969142577 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:04:56 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-f4568920-bce1-47e3-ada8-2e5379faf1b8 tempest-VolumesCloneNegativeTest-969142577 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:04:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-f4568920-bce1-47e3-ada8-2e5379faf1b8 tempest-VolumesCloneNegativeTest-969142577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-78851337-cf58-4159-bff1-fd229a65536e 2147483648 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:56 devstack sudo[101148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-78851337-cf58-4159-bff1-fd229a65536e 2147483648 Aug 10 16:04:56 devstack sudo[101148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:56 devstack sudo[101136]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c08f71df-8a49-455b-a543-eb77965f8e26 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-15716f06-6315-429b-8416-3f2df77d1031" returned: 0 in 0.299s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:56 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-c08f71df-8a49-455b-a543-eb77965f8e26 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Lock "cinder-quobyte-15716f06-6315-429b-8416-3f2df77d1031" released by "delete_volume" :: held 1.006s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:04:56 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-c08f71df-8a49-455b-a543-eb77965f8e26 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Created reservations ['bd093220-819c-4927-ba86-9759b1015dd8', 'a1580bb7-6327-4cd0-9d9e-c4a666bf0e08', '82dbb293-4c33-4f72-af21-ee2ed521d741', '4a7b2e44-f77a-4e88-816f-5844bf145ab6'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:04:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-c08f71df-8a49-455b-a543-eb77965f8e26 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:04:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-c08f71df-8a49-455b-a543-eb77965f8e26 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:04:56 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-c08f71df-8a49-455b-a543-eb77965f8e26 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:04:56 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-c08f71df-8a49-455b-a543-eb77965f8e26 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:04:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-c08f71df-8a49-455b-a543-eb77965f8e26 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:04:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c08f71df-8a49-455b-a543-eb77965f8e26 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:56 devstack sudo[101157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:04:56 devstack sudo[101157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:56 devstack sudo[101148]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-f4568920-bce1-47e3-ada8-2e5379faf1b8 tempest-VolumesCloneNegativeTest-969142577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-78851337-cf58-4159-bff1-fd229a65536e 2147483648" returned: 0 in 0.846s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-f4568920-bce1-47e3-ada8-2e5379faf1b8 tempest-VolumesCloneNegativeTest-969142577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-78851337-cf58-4159-bff1-fd229a65536e {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:57 devstack sudo[101157]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:57 devstack sudo[101166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-78851337-cf58-4159-bff1-fd229a65536e Aug 10 16:04:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c08f71df-8a49-455b-a543-eb77965f8e26 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.383s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:57 devstack sudo[101166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:57 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-c08f71df-8a49-455b-a543-eb77965f8e26 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:04:57 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-c08f71df-8a49-455b-a543-eb77965f8e26 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Deleted volume successfully. Aug 10 16:04:57 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-c08f71df-8a49-455b-a543-eb77965f8e26 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Lock "cinder-15716f06-6315-429b-8416-3f2df77d1031-delete_volume" released by "delete_volume" :: held 1.801s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:04:57 devstack cinder-volume[88641]: INFO cinder.volume.manager [req-d8294285-ee54-425a-b7a4-d751272abbb0 req-f95f4b7b-d096-4755-9ce5-b8e42366b42f tempest-AttachVolumeTestJSON-1986652723 None] Terminate volume connection completed successfully. Aug 10 16:04:57 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [req-d8294285-ee54-425a-b7a4-d751272abbb0 req-f95f4b7b-d096-4755-9ce5-b8e42366b42f tempest-AttachVolumeTestJSON-1986652723 None] Deleting attachment a4a25520-91f5-453b-a0be-60a53a9644df. {{(pid=88641) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 10 16:04:57 devstack sudo[101166]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-f4568920-bce1-47e3-ada8-2e5379faf1b8 tempest-VolumesCloneNegativeTest-969142577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-78851337-cf58-4159-bff1-fd229a65536e" returned: 0 in 0.299s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:57 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-f4568920-bce1-47e3-ada8-2e5379faf1b8 tempest-VolumesCloneNegativeTest-969142577 None] <== create_volume: return (1202ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:04:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-f4568920-bce1-47e3-ada8-2e5379faf1b8 tempest-VolumesCloneNegativeTest-969142577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.206s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:04:57 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-f4568920-bce1-47e3-ada8-2e5379faf1b8 tempest-VolumesCloneNegativeTest-969142577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db4d6bc4-8dc1-431c-8ffc-2283d6f7ac2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78851337-cf58-4159-bff1-fd229a65536e', 'volume_size': 2}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:57 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-f4568920-bce1-47e3-ada8-2e5379faf1b8 tempest-VolumesCloneNegativeTest-969142577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48bf5ea2-a7c7-4fe3-a1d3-21ad801d3b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:04:57 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-f4568920-bce1-47e3-ada8-2e5379faf1b8 tempest-VolumesCloneNegativeTest-969142577 None] Volume volume-78851337-cf58-4159-bff1-fd229a65536e (78851337-cf58-4159-bff1-fd229a65536e): created successfully Aug 10 16:04:57 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-f4568920-bce1-47e3-ada8-2e5379faf1b8 tempest-VolumesCloneNegativeTest-969142577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48bf5ea2-a7c7-4fe3-a1d3-21ad801d3b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:04:57 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-f4568920-bce1-47e3-ada8-2e5379faf1b8 tempest-VolumesCloneNegativeTest-969142577 None] Flow 'volume_create_manager' (944cdfbe-6c71-404e-83d3-f87549684e10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:04:57 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-f4568920-bce1-47e3-ada8-2e5379faf1b8 tempest-VolumesCloneNegativeTest-969142577 None] Created volume successfully. Aug 10 16:04:57 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-5a81fe17-c781-40d7-bd97-53ec19d860ed tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Acquiring lock "cinder-2092c34d-6faf-4ed1-b9b0-98d20afa7723-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:04:57 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-5a81fe17-c781-40d7-bd97-53ec19d860ed tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Lock "cinder-2092c34d-6faf-4ed1-b9b0-98d20afa7723-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:04:57 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-5a81fe17-c781-40d7-bd97-53ec19d860ed tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Acquiring lock "cinder-quobyte-2092c34d-6faf-4ed1-b9b0-98d20afa7723" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:04:57 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-5a81fe17-c781-40d7-bd97-53ec19d860ed tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Lock "cinder-quobyte-2092c34d-6faf-4ed1-b9b0-98d20afa7723" acquired by "delete_volume" :: waited 0.016s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:04:57 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d50c32-76f2-4e02-954d-a24f7a8dfdeb]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:04:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5a81fe17-c781-40d7-bd97-53ec19d860ed tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2092c34d-6faf-4ed1-b9b0-98d20afa7723 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:57 devstack sudo[101176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2092c34d-6faf-4ed1-b9b0-98d20afa7723 Aug 10 16:04:57 devstack sudo[101176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:58 devstack sudo[101176]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5a81fe17-c781-40d7-bd97-53ec19d860ed tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2092c34d-6faf-4ed1-b9b0-98d20afa7723" returned: 0 in 0.468s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5a81fe17-c781-40d7-bd97-53ec19d860ed tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2092c34d-6faf-4ed1-b9b0-98d20afa7723 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:58 devstack sudo[101182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2092c34d-6faf-4ed1-b9b0-98d20afa7723 Aug 10 16:04:58 devstack sudo[101182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:58 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-bd7ad2b3-d495-45d3-96ca-26e6692e6776 tempest-VolumesCloneNegativeTest-969142577 None] Acquiring lock "cinder-78851337-cf58-4159-bff1-fd229a65536e-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:04:58 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-bd7ad2b3-d495-45d3-96ca-26e6692e6776 tempest-VolumesCloneNegativeTest-969142577 None] Lock "cinder-78851337-cf58-4159-bff1-fd229a65536e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:04:58 devstack sudo[101182]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:58 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-bd7ad2b3-d495-45d3-96ca-26e6692e6776 tempest-VolumesCloneNegativeTest-969142577 None] Acquiring lock "cinder-quobyte-78851337-cf58-4159-bff1-fd229a65536e" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:04:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5a81fe17-c781-40d7-bd97-53ec19d860ed tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2092c34d-6faf-4ed1-b9b0-98d20afa7723" returned: 0 in 0.458s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:58 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-5a81fe17-c781-40d7-bd97-53ec19d860ed tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Lock "cinder-quobyte-2092c34d-6faf-4ed1-b9b0-98d20afa7723" released by "delete_volume" :: held 1.001s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:04:58 devstack cinder-volume[88641]: INFO cinder.volume.manager [req-93603219-1531-4a5b-881d-1d431f175f22 req-e0984cd2-1253-4fd1-a2ab-0366834f2a56 tempest-AttachVolumeTestJSON-1986652723 None] Terminate volume connection completed successfully. Aug 10 16:04:58 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [req-93603219-1531-4a5b-881d-1d431f175f22 req-e0984cd2-1253-4fd1-a2ab-0366834f2a56 tempest-AttachVolumeTestJSON-1986652723 None] Deleting attachment 4d041abf-2ccf-4090-88f9-2c0493cb48bf. {{(pid=88641) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 10 16:04:58 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-bd7ad2b3-d495-45d3-96ca-26e6692e6776 tempest-VolumesCloneNegativeTest-969142577 None] Lock "cinder-quobyte-78851337-cf58-4159-bff1-fd229a65536e" acquired by "delete_volume" :: waited 0.068s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:04:58 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be0de27-d7a3-4546-8c59-6752f6af5b3c]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:04:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bd7ad2b3-d495-45d3-96ca-26e6692e6776 tempest-VolumesCloneNegativeTest-969142577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-78851337-cf58-4159-bff1-fd229a65536e {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:58 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-5a81fe17-c781-40d7-bd97-53ec19d860ed tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Created reservations ['a6d4309b-18a2-413a-aaee-b34601d7e65d', '5c253dd3-ea4e-427d-9402-069e6381c4ac', '9ab3c78f-b78a-4be5-b1dd-f5e6736e1ed0', 'f09981a3-5fe6-4e3e-a577-47a8a609e226'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:04:59 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-5a81fe17-c781-40d7-bd97-53ec19d860ed tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:04:59 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-5a81fe17-c781-40d7-bd97-53ec19d860ed tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:04:59 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-5a81fe17-c781-40d7-bd97-53ec19d860ed tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:04:59 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-5a81fe17-c781-40d7-bd97-53ec19d860ed tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:04:59 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-5a81fe17-c781-40d7-bd97-53ec19d860ed tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:04:59 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5a81fe17-c781-40d7-bd97-53ec19d860ed tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:59 devstack sudo[101200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:04:59 devstack sudo[101200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:59 devstack sudo[101191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-78851337-cf58-4159-bff1-fd229a65536e Aug 10 16:04:59 devstack sudo[101191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:04:59 devstack cinder-volume[88641]: INFO cinder.volume.manager [req-4614ff37-5298-4d22-ab21-68c06d5da99b req-a7700235-335f-4a00-aa59-843c485a6dc3 tempest-TestShelveInstance-1958992432 None] Terminate volume connection completed successfully. Aug 10 16:04:59 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [req-4614ff37-5298-4d22-ab21-68c06d5da99b req-a7700235-335f-4a00-aa59-843c485a6dc3 tempest-TestShelveInstance-1958992432 None] Deleting attachment ee033960-66b9-4199-af26-0559e683c6e8. {{(pid=88641) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 10 16:04:59 devstack sudo[101200]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:59 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5a81fe17-c781-40d7-bd97-53ec19d860ed tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.565s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:59 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-5a81fe17-c781-40d7-bd97-53ec19d860ed tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:04:59 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-5a81fe17-c781-40d7-bd97-53ec19d860ed tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Deleted volume successfully. Aug 10 16:04:59 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-5a81fe17-c781-40d7-bd97-53ec19d860ed tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Lock "cinder-2092c34d-6faf-4ed1-b9b0-98d20afa7723-delete_volume" released by "delete_volume" :: held 1.963s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:04:59 devstack sudo[101191]: pam_unix(sudo:session): session closed for user root Aug 10 16:04:59 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bd7ad2b3-d495-45d3-96ca-26e6692e6776 tempest-VolumesCloneNegativeTest-969142577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-78851337-cf58-4159-bff1-fd229a65536e" returned: 0 in 0.860s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:04:59 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bd7ad2b3-d495-45d3-96ca-26e6692e6776 tempest-VolumesCloneNegativeTest-969142577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-78851337-cf58-4159-bff1-fd229a65536e {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:04:59 devstack sudo[101216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-78851337-cf58-4159-bff1-fd229a65536e Aug 10 16:04:59 devstack sudo[101216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:00 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-29bb64da-24da-4cf3-82ff-d02690066a58 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Acquiring lock "cinder-a206c8ed-073a-45cc-a858-00379742e74a-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:05:00 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-29bb64da-24da-4cf3-82ff-d02690066a58 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Lock "cinder-a206c8ed-073a-45cc-a858-00379742e74a-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:05:00 devstack sudo[101216]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bd7ad2b3-d495-45d3-96ca-26e6692e6776 tempest-VolumesCloneNegativeTest-969142577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-78851337-cf58-4159-bff1-fd229a65536e" returned: 0 in 0.426s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:00 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-bd7ad2b3-d495-45d3-96ca-26e6692e6776 tempest-VolumesCloneNegativeTest-969142577 None] Lock "cinder-quobyte-78851337-cf58-4159-bff1-fd229a65536e" released by "delete_volume" :: held 1.374s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:05:00 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-29bb64da-24da-4cf3-82ff-d02690066a58 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Acquiring lock "cinder-quobyte-a206c8ed-073a-45cc-a858-00379742e74a" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:05:00 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-29bb64da-24da-4cf3-82ff-d02690066a58 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Lock "cinder-quobyte-a206c8ed-073a-45cc-a858-00379742e74a" acquired by "delete_volume" :: waited 0.046s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:05:00 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53a27dc-3f76-4b41-8fca-d23b9177e7f0]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:05:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-29bb64da-24da-4cf3-82ff-d02690066a58 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a206c8ed-073a-45cc-a858-00379742e74a {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:00 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-bd7ad2b3-d495-45d3-96ca-26e6692e6776 tempest-VolumesCloneNegativeTest-969142577 None] Created reservations ['a32fede6-1d0c-4362-b765-273be7325d8d', '7a95864a-ca46-4e17-9473-45878e19b6c4', 'a16a5561-b45b-4808-a52c-377dd15f1eff', '4422b3a7-720b-4606-999c-8168591609df'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:05:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bd7ad2b3-d495-45d3-96ca-26e6692e6776 tempest-VolumesCloneNegativeTest-969142577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:05:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bd7ad2b3-d495-45d3-96ca-26e6692e6776 tempest-VolumesCloneNegativeTest-969142577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:05:00 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-bd7ad2b3-d495-45d3-96ca-26e6692e6776 tempest-VolumesCloneNegativeTest-969142577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:05:00 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-bd7ad2b3-d495-45d3-96ca-26e6692e6776 tempest-VolumesCloneNegativeTest-969142577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:05:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bd7ad2b3-d495-45d3-96ca-26e6692e6776 tempest-VolumesCloneNegativeTest-969142577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:05:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bd7ad2b3-d495-45d3-96ca-26e6692e6776 tempest-VolumesCloneNegativeTest-969142577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:00 devstack sudo[101219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a206c8ed-073a-45cc-a858-00379742e74a Aug 10 16:05:00 devstack sudo[101219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:00 devstack sudo[101221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:05:00 devstack sudo[101221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:00 devstack sudo[101221]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bd7ad2b3-d495-45d3-96ca-26e6692e6776 tempest-VolumesCloneNegativeTest-969142577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.335s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:00 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-bd7ad2b3-d495-45d3-96ca-26e6692e6776 tempest-VolumesCloneNegativeTest-969142577 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:05:00 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-bd7ad2b3-d495-45d3-96ca-26e6692e6776 tempest-VolumesCloneNegativeTest-969142577 None] Deleted volume successfully. Aug 10 16:05:00 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-bd7ad2b3-d495-45d3-96ca-26e6692e6776 tempest-VolumesCloneNegativeTest-969142577 None] Lock "cinder-78851337-cf58-4159-bff1-fd229a65536e-delete_volume" released by "delete_volume" :: held 2.169s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:05:00 devstack sudo[101219]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-29bb64da-24da-4cf3-82ff-d02690066a58 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a206c8ed-073a-45cc-a858-00379742e74a" returned: 0 in 0.607s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-29bb64da-24da-4cf3-82ff-d02690066a58 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a206c8ed-073a-45cc-a858-00379742e74a {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:00 devstack sudo[101247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a206c8ed-073a-45cc-a858-00379742e74a Aug 10 16:05:00 devstack sudo[101247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:01 devstack sudo[101247]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:01 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-29bb64da-24da-4cf3-82ff-d02690066a58 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a206c8ed-073a-45cc-a858-00379742e74a" returned: 0 in 0.416s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:01 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-29bb64da-24da-4cf3-82ff-d02690066a58 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Lock "cinder-quobyte-a206c8ed-073a-45cc-a858-00379742e74a" released by "delete_volume" :: held 1.094s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:05:01 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-29bb64da-24da-4cf3-82ff-d02690066a58 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Created reservations ['e2270add-e2cd-4ed9-b86c-3f5b83044b1b', '33e29736-5a45-4a03-817f-98881d883035', '6d0b16f7-bedd-4143-b3ea-14dd7e4ecfc1', '94c9c18c-b272-45d4-9a8e-b77312dbfd53'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:05:01 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-29bb64da-24da-4cf3-82ff-d02690066a58 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:05:01 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-29bb64da-24da-4cf3-82ff-d02690066a58 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:05:01 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-29bb64da-24da-4cf3-82ff-d02690066a58 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:05:01 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-29bb64da-24da-4cf3-82ff-d02690066a58 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:05:01 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-29bb64da-24da-4cf3-82ff-d02690066a58 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:05:01 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-29bb64da-24da-4cf3-82ff-d02690066a58 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:01 devstack sudo[101255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:05:01 devstack sudo[101255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:01 devstack sudo[101255]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:01 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-29bb64da-24da-4cf3-82ff-d02690066a58 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.354s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:01 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-29bb64da-24da-4cf3-82ff-d02690066a58 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:05:01 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-29bb64da-24da-4cf3-82ff-d02690066a58 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Deleted volume successfully. Aug 10 16:05:01 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-29bb64da-24da-4cf3-82ff-d02690066a58 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Lock "cinder-a206c8ed-073a-45cc-a858-00379742e74a-delete_volume" released by "delete_volume" :: held 1.845s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:05:02 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-c8ba2d2b-5422-4fc8-97b3-b4531900f270 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Acquiring lock "cinder-7586c173-0e1c-4c40-9081-9eb7981a1340-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:05:02 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-c8ba2d2b-5422-4fc8-97b3-b4531900f270 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Lock "cinder-7586c173-0e1c-4c40-9081-9eb7981a1340-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:05:02 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-c8ba2d2b-5422-4fc8-97b3-b4531900f270 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Acquiring lock "cinder-quobyte-7586c173-0e1c-4c40-9081-9eb7981a1340" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:05:02 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-c8ba2d2b-5422-4fc8-97b3-b4531900f270 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Lock "cinder-quobyte-7586c173-0e1c-4c40-9081-9eb7981a1340" acquired by "delete_volume" :: waited 0.022s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:05:02 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a518cf-11ee-4077-9ff7-643eca23fa73]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:05:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c8ba2d2b-5422-4fc8-97b3-b4531900f270 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-7586c173-0e1c-4c40-9081-9eb7981a1340 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:02 devstack sudo[101264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-7586c173-0e1c-4c40-9081-9eb7981a1340 Aug 10 16:05:02 devstack sudo[101264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:03 devstack sudo[101264]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c8ba2d2b-5422-4fc8-97b3-b4531900f270 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-7586c173-0e1c-4c40-9081-9eb7981a1340" returned: 0 in 0.462s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c8ba2d2b-5422-4fc8-97b3-b4531900f270 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-7586c173-0e1c-4c40-9081-9eb7981a1340 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:03 devstack sudo[101271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-7586c173-0e1c-4c40-9081-9eb7981a1340 Aug 10 16:05:03 devstack sudo[101271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:03 devstack sudo[101271]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c8ba2d2b-5422-4fc8-97b3-b4531900f270 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-7586c173-0e1c-4c40-9081-9eb7981a1340" returned: 0 in 0.286s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:03 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-c8ba2d2b-5422-4fc8-97b3-b4531900f270 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Lock "cinder-quobyte-7586c173-0e1c-4c40-9081-9eb7981a1340" released by "delete_volume" :: held 0.819s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:05:03 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-c8ba2d2b-5422-4fc8-97b3-b4531900f270 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Created reservations ['03786c75-65e9-4447-960a-b2327c2afa1c', '791ee4f6-3583-4a59-9ff8-b6288c704d86', '29fe70f5-7074-4195-9f53-c39901c4db6a', '43661ecf-f977-48c5-b7e2-21a7b80c68e5'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:05:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-c8ba2d2b-5422-4fc8-97b3-b4531900f270 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:05:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-c8ba2d2b-5422-4fc8-97b3-b4531900f270 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:05:03 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-c8ba2d2b-5422-4fc8-97b3-b4531900f270 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:05:03 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-c8ba2d2b-5422-4fc8-97b3-b4531900f270 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:05:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-c8ba2d2b-5422-4fc8-97b3-b4531900f270 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:05:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c8ba2d2b-5422-4fc8-97b3-b4531900f270 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:03 devstack sudo[101274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:05:03 devstack sudo[101274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:03 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-69c697fe-5580-4c4f-9d57-bf93ef18daf1 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Acquiring lock "cinder-b9a1eb27-a971-412e-9f59-1038f8db703e-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:05:03 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-69c697fe-5580-4c4f-9d57-bf93ef18daf1 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Lock "cinder-b9a1eb27-a971-412e-9f59-1038f8db703e-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:05:03 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-69c697fe-5580-4c4f-9d57-bf93ef18daf1 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Acquiring lock "cinder-quobyte-b9a1eb27-a971-412e-9f59-1038f8db703e" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:05:03 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-69c697fe-5580-4c4f-9d57-bf93ef18daf1 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Lock "cinder-quobyte-b9a1eb27-a971-412e-9f59-1038f8db703e" acquired by "delete_volume" :: waited 0.033s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:05:03 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b48d2e5-b53c-40ea-84b3-44411073a90c]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:05:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-69c697fe-5580-4c4f-9d57-bf93ef18daf1 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b9a1eb27-a971-412e-9f59-1038f8db703e {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:04 devstack sudo[101274]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c8ba2d2b-5422-4fc8-97b3-b4531900f270 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.579s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:04 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-c8ba2d2b-5422-4fc8-97b3-b4531900f270 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:05:04 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-c8ba2d2b-5422-4fc8-97b3-b4531900f270 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Deleted volume successfully. Aug 10 16:05:04 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-c8ba2d2b-5422-4fc8-97b3-b4531900f270 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Lock "cinder-7586c173-0e1c-4c40-9081-9eb7981a1340-delete_volume" released by "delete_volume" :: held 1.699s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:05:04 devstack sudo[101276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b9a1eb27-a971-412e-9f59-1038f8db703e Aug 10 16:05:04 devstack sudo[101276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:04 devstack sudo[101276]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-69c697fe-5580-4c4f-9d57-bf93ef18daf1 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b9a1eb27-a971-412e-9f59-1038f8db703e" returned: 0 in 0.545s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-69c697fe-5580-4c4f-9d57-bf93ef18daf1 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b9a1eb27-a971-412e-9f59-1038f8db703e {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:04 devstack sudo[101291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b9a1eb27-a971-412e-9f59-1038f8db703e Aug 10 16:05:04 devstack sudo[101291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-d8ffb830-f124-4f31-b193-f111789dc35d req-9cf922f1-be6a-4b87-8d65-2458fc5f41b8 tempest-TestShelveInstance-1958992432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:05:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-d8ffb830-f124-4f31-b193-f111789dc35d req-9cf922f1-be6a-4b87-8d65-2458fc5f41b8 tempest-TestShelveInstance-1958992432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:05:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-d8ffb830-f124-4f31-b193-f111789dc35d req-9cf922f1-be6a-4b87-8d65-2458fc5f41b8 tempest-TestShelveInstance-1958992432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:05:04 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [req-d8ffb830-f124-4f31-b193-f111789dc35d req-9cf922f1-be6a-4b87-8d65-2458fc5f41b8 tempest-TestShelveInstance-1958992432 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc', 'name': 'volume-240f4272-f60e-42a3-9240-e677fd927ddc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1340c287-b4bd-43b9-ba38-b9bb96290e85', 'enforce_multipath': True} {{(pid=88641) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 10 16:05:04 devstack cinder-volume[88641]: INFO cinder.volume.manager [req-d8ffb830-f124-4f31-b193-f111789dc35d req-9cf922f1-be6a-4b87-8d65-2458fc5f41b8 tempest-TestShelveInstance-1958992432 None] attachment_update completed successfully. Aug 10 16:05:04 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-eb940e56-69fb-48e8-9a98-7e82d868e6d5 tempest-AttachVolumeTestJSON-1986652723 None] Acquiring lock "cinder-fc438c0e-1676-438a-9b4f-96fa01a2d708-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:05:04 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-eb940e56-69fb-48e8-9a98-7e82d868e6d5 tempest-AttachVolumeTestJSON-1986652723 None] Lock "cinder-fc438c0e-1676-438a-9b4f-96fa01a2d708-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:05:04 devstack sudo[101291]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-69c697fe-5580-4c4f-9d57-bf93ef18daf1 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b9a1eb27-a971-412e-9f59-1038f8db703e" returned: 0 in 0.392s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:04 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-69c697fe-5580-4c4f-9d57-bf93ef18daf1 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Lock "cinder-quobyte-b9a1eb27-a971-412e-9f59-1038f8db703e" released by "delete_volume" :: held 1.009s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:05:04 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-eb940e56-69fb-48e8-9a98-7e82d868e6d5 tempest-AttachVolumeTestJSON-1986652723 None] Acquiring lock "cinder-quobyte-fc438c0e-1676-438a-9b4f-96fa01a2d708" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:05:04 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-eb940e56-69fb-48e8-9a98-7e82d868e6d5 tempest-AttachVolumeTestJSON-1986652723 None] Lock "cinder-quobyte-fc438c0e-1676-438a-9b4f-96fa01a2d708" acquired by "delete_volume" :: waited 0.021s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:05:04 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73af33b-25f7-4de4-a213-2e5601b1a053]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:05:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-eb940e56-69fb-48e8-9a98-7e82d868e6d5 tempest-AttachVolumeTestJSON-1986652723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-fc438c0e-1676-438a-9b4f-96fa01a2d708 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:05 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-69c697fe-5580-4c4f-9d57-bf93ef18daf1 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Created reservations ['636aab56-aad9-447e-997a-0704cc904365', '53d96471-824d-4273-9423-73e7c3e6c6a4', '7c19ce1f-dc83-4fda-a22b-ea999e3f13fd', '42156349-d2c1-426a-8ccc-78f4e610aec0'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:05:05 devstack sudo[101294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-fc438c0e-1676-438a-9b4f-96fa01a2d708 Aug 10 16:05:05 devstack sudo[101294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:05 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-69c697fe-5580-4c4f-9d57-bf93ef18daf1 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:05:05 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-69c697fe-5580-4c4f-9d57-bf93ef18daf1 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:05:05 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-69c697fe-5580-4c4f-9d57-bf93ef18daf1 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:05:05 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-69c697fe-5580-4c4f-9d57-bf93ef18daf1 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:05:05 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-69c697fe-5580-4c4f-9d57-bf93ef18daf1 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:05:05 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-69c697fe-5580-4c4f-9d57-bf93ef18daf1 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:05 devstack sudo[101299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:05:05 devstack sudo[101299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:05 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-55461b89-cd38-4277-9fe8-7bd2c8b00bc7 tempest-VolumesGetTest-1343471577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:05:05 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-55461b89-cd38-4277-9fe8-7bd2c8b00bc7 tempest-VolumesGetTest-1343471577 None] Flow 'volume_create_manager' (3d88b8ac-e612-4968-85f3-9ce43d374e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:05:05 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-55461b89-cd38-4277-9fe8-7bd2c8b00bc7 tempest-VolumesGetTest-1343471577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9eb00e2f-7351-4952-8f9d-7527a7de1de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:05:05 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-55461b89-cd38-4277-9fe8-7bd2c8b00bc7 tempest-VolumesGetTest-1343471577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9eb00e2f-7351-4952-8f9d-7527a7de1de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:05:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1597465144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c642651a-ef85-4f97-96e6-6cedb44553af,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8e7031fd1bb44cf0a04e7115662ddae4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:05:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:05:05Z,use_quota=True,user_id='7f39fba2cc494ee4ae204aeae406bec5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:05:05 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-55461b89-cd38-4277-9fe8-7bd2c8b00bc7 tempest-VolumesGetTest-1343471577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d31a1823-022f-4a8a-a09d-e76a03c9dbce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:05:05 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-55461b89-cd38-4277-9fe8-7bd2c8b00bc7 tempest-VolumesGetTest-1343471577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d31a1823-022f-4a8a-a09d-e76a03c9dbce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:05:05 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-55461b89-cd38-4277-9fe8-7bd2c8b00bc7 tempest-VolumesGetTest-1343471577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (deddef19-97bc-4f78-bc02-0d84298d8610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:05:05 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-55461b89-cd38-4277-9fe8-7bd2c8b00bc7 tempest-VolumesGetTest-1343471577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (deddef19-97bc-4f78-bc02-0d84298d8610) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c642651a-ef85-4f97-96e6-6cedb44553af', 'volume_name': 'volume-c642651a-ef85-4f97-96e6-6cedb44553af', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:05:05 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-55461b89-cd38-4277-9fe8-7bd2c8b00bc7 tempest-VolumesGetTest-1343471577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12cdd44e-7484-485b-ade9-418f05faf076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:05:05 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-55461b89-cd38-4277-9fe8-7bd2c8b00bc7 tempest-VolumesGetTest-1343471577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12cdd44e-7484-485b-ade9-418f05faf076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:05:05 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-55461b89-cd38-4277-9fe8-7bd2c8b00bc7 tempest-VolumesGetTest-1343471577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ff4f264-9bbb-4142-81fd-a487b9cb0d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:05:05 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-55461b89-cd38-4277-9fe8-7bd2c8b00bc7 tempest-VolumesGetTest-1343471577 None] Volume c642651a-ef85-4f97-96e6-6cedb44553af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c642651a-ef85-4f97-96e6-6cedb44553af', 'volume_size': 1} Aug 10 16:05:05 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-55461b89-cd38-4277-9fe8-7bd2c8b00bc7 tempest-VolumesGetTest-1343471577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:05:05 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-55461b89-cd38-4277-9fe8-7bd2c8b00bc7 tempest-VolumesGetTest-1343471577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:05:05 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-55461b89-cd38-4277-9fe8-7bd2c8b00bc7 tempest-VolumesGetTest-1343471577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:05:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1597465144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c642651a-ef85-4f97-96e6-6cedb44553af,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8e7031fd1bb44cf0a04e7115662ddae4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:05:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:05:05Z,use_quota=True,user_id='7f39fba2cc494ee4ae204aeae406bec5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:05:05 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-55461b89-cd38-4277-9fe8-7bd2c8b00bc7 tempest-VolumesGetTest-1343471577 None] Creating volume c642651a-ef85-4f97-96e6-6cedb44553af {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:05:05 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-55461b89-cd38-4277-9fe8-7bd2c8b00bc7 tempest-VolumesGetTest-1343471577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:05:05 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-55461b89-cd38-4277-9fe8-7bd2c8b00bc7 tempest-VolumesGetTest-1343471577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:05:05 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-55461b89-cd38-4277-9fe8-7bd2c8b00bc7 tempest-VolumesGetTest-1343471577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:05:05 devstack sudo[101294]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:05 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-55461b89-cd38-4277-9fe8-7bd2c8b00bc7 tempest-VolumesGetTest-1343471577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:05:05 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-55461b89-cd38-4277-9fe8-7bd2c8b00bc7 tempest-VolumesGetTest-1343471577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:05:05 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-55461b89-cd38-4277-9fe8-7bd2c8b00bc7 tempest-VolumesGetTest-1343471577 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:05:05 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-55461b89-cd38-4277-9fe8-7bd2c8b00bc7 tempest-VolumesGetTest-1343471577 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:05:05 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-55461b89-cd38-4277-9fe8-7bd2c8b00bc7 tempest-VolumesGetTest-1343471577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c642651a-ef85-4f97-96e6-6cedb44553af 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:05 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-eb940e56-69fb-48e8-9a98-7e82d868e6d5 tempest-AttachVolumeTestJSON-1986652723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-fc438c0e-1676-438a-9b4f-96fa01a2d708" returned: 0 in 0.658s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:05 devstack sudo[101299]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:05 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-eb940e56-69fb-48e8-9a98-7e82d868e6d5 tempest-AttachVolumeTestJSON-1986652723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-fc438c0e-1676-438a-9b4f-96fa01a2d708 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:05 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-69c697fe-5580-4c4f-9d57-bf93ef18daf1 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.440s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:05 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-69c697fe-5580-4c4f-9d57-bf93ef18daf1 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:05:05 devstack sudo[101308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c642651a-ef85-4f97-96e6-6cedb44553af 1073741824 Aug 10 16:05:05 devstack sudo[101308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:05 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-69c697fe-5580-4c4f-9d57-bf93ef18daf1 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Deleted volume successfully. Aug 10 16:05:05 devstack sudo[101309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-fc438c0e-1676-438a-9b4f-96fa01a2d708 Aug 10 16:05:05 devstack sudo[101309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:05 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-69c697fe-5580-4c4f-9d57-bf93ef18daf1 tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Lock "cinder-b9a1eb27-a971-412e-9f59-1038f8db703e-delete_volume" released by "delete_volume" :: held 1.938s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:05:05 devstack sudo[101309]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:05 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-eb940e56-69fb-48e8-9a98-7e82d868e6d5 tempest-AttachVolumeTestJSON-1986652723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-fc438c0e-1676-438a-9b4f-96fa01a2d708" returned: 0 in 0.275s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:05 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-eb940e56-69fb-48e8-9a98-7e82d868e6d5 tempest-AttachVolumeTestJSON-1986652723 None] Lock "cinder-quobyte-fc438c0e-1676-438a-9b4f-96fa01a2d708" released by "delete_volume" :: held 1.001s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:05:05 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-eb940e56-69fb-48e8-9a98-7e82d868e6d5 tempest-AttachVolumeTestJSON-1986652723 None] Created reservations ['41edc7aa-3f39-44bf-aea0-f4eb104d382d', 'e80e2ed2-c43c-4dcb-9760-b58f9f6364e2', 'ba0b4c2b-a563-4b90-b8c3-89059b04ccc1', '5808bd51-8880-470e-b344-8842bec6eac1'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:05:06 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-eb940e56-69fb-48e8-9a98-7e82d868e6d5 tempest-AttachVolumeTestJSON-1986652723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:05:06 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-eb940e56-69fb-48e8-9a98-7e82d868e6d5 tempest-AttachVolumeTestJSON-1986652723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:05:06 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-eb940e56-69fb-48e8-9a98-7e82d868e6d5 tempest-AttachVolumeTestJSON-1986652723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:05:06 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-eb940e56-69fb-48e8-9a98-7e82d868e6d5 tempest-AttachVolumeTestJSON-1986652723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:05:06 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-eb940e56-69fb-48e8-9a98-7e82d868e6d5 tempest-AttachVolumeTestJSON-1986652723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:05:06 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-eb940e56-69fb-48e8-9a98-7e82d868e6d5 tempest-AttachVolumeTestJSON-1986652723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:06 devstack sudo[101316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:05:06 devstack sudo[101316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:06 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-c8da796b-cb48-47c4-a9e5-93d186d872e2 tempest-AttachVolumeTestJSON-1986652723 None] Acquiring lock "cinder-7168e1a7-078a-4fb0-bf43-ee40aa6774e2-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:05:06 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-c8da796b-cb48-47c4-a9e5-93d186d872e2 tempest-AttachVolumeTestJSON-1986652723 None] Lock "cinder-7168e1a7-078a-4fb0-bf43-ee40aa6774e2-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:05:06 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-5a7a57a7-cf18-48ee-a0f9-c03dc6a09c7f tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Acquiring lock "cinder-e3b71d12-56f3-4e44-9701-0196474f964a-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:05:06 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-5a7a57a7-cf18-48ee-a0f9-c03dc6a09c7f tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Lock "cinder-e3b71d12-56f3-4e44-9701-0196474f964a-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:05:06 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-c8da796b-cb48-47c4-a9e5-93d186d872e2 tempest-AttachVolumeTestJSON-1986652723 None] Acquiring lock "cinder-quobyte-7168e1a7-078a-4fb0-bf43-ee40aa6774e2" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:05:06 devstack sudo[101308]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:06 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-55461b89-cd38-4277-9fe8-7bd2c8b00bc7 tempest-VolumesGetTest-1343471577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c642651a-ef85-4f97-96e6-6cedb44553af 1073741824" returned: 0 in 0.662s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:06 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-c8da796b-cb48-47c4-a9e5-93d186d872e2 tempest-AttachVolumeTestJSON-1986652723 None] Lock "cinder-quobyte-7168e1a7-078a-4fb0-bf43-ee40aa6774e2" acquired by "delete_volume" :: waited 0.044s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:05:06 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-5a7a57a7-cf18-48ee-a0f9-c03dc6a09c7f tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Acquiring lock "cinder-quobyte-e3b71d12-56f3-4e44-9701-0196474f964a" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:05:06 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-5a7a57a7-cf18-48ee-a0f9-c03dc6a09c7f tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Lock "cinder-quobyte-e3b71d12-56f3-4e44-9701-0196474f964a" acquired by "delete_volume" :: waited 0.034s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:05:06 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b582d75-3eb7-40fe-8ad9-3af67e20d611]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:05:06 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c8da796b-cb48-47c4-a9e5-93d186d872e2 tempest-AttachVolumeTestJSON-1986652723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-7168e1a7-078a-4fb0-bf43-ee40aa6774e2 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:06 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf2113a-f7d6-43ef-9d74-f457ae613a81]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:05:06 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-55461b89-cd38-4277-9fe8-7bd2c8b00bc7 tempest-VolumesGetTest-1343471577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c642651a-ef85-4f97-96e6-6cedb44553af {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:06 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5a7a57a7-cf18-48ee-a0f9-c03dc6a09c7f tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-e3b71d12-56f3-4e44-9701-0196474f964a {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:06 devstack sudo[101320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c642651a-ef85-4f97-96e6-6cedb44553af Aug 10 16:05:06 devstack sudo[101320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:06 devstack sudo[101316]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:06 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-eb940e56-69fb-48e8-9a98-7e82d868e6d5 tempest-AttachVolumeTestJSON-1986652723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.475s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:06 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-eb940e56-69fb-48e8-9a98-7e82d868e6d5 tempest-AttachVolumeTestJSON-1986652723 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:05:06 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-eb940e56-69fb-48e8-9a98-7e82d868e6d5 tempest-AttachVolumeTestJSON-1986652723 None] Deleted volume successfully. Aug 10 16:05:06 devstack sudo[101319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-7168e1a7-078a-4fb0-bf43-ee40aa6774e2 Aug 10 16:05:06 devstack sudo[101319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:06 devstack sudo[101321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-e3b71d12-56f3-4e44-9701-0196474f964a Aug 10 16:05:06 devstack sudo[101321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:06 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-eb940e56-69fb-48e8-9a98-7e82d868e6d5 tempest-AttachVolumeTestJSON-1986652723 None] Lock "cinder-fc438c0e-1676-438a-9b4f-96fa01a2d708-delete_volume" released by "delete_volume" :: held 1.765s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:05:06 devstack sudo[101320]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:06 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-55461b89-cd38-4277-9fe8-7bd2c8b00bc7 tempest-VolumesGetTest-1343471577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c642651a-ef85-4f97-96e6-6cedb44553af" returned: 0 in 0.450s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:06 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-55461b89-cd38-4277-9fe8-7bd2c8b00bc7 tempest-VolumesGetTest-1343471577 None] <== create_volume: return (1267ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:05:06 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-55461b89-cd38-4277-9fe8-7bd2c8b00bc7 tempest-VolumesGetTest-1343471577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.270s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:05:06 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-55461b89-cd38-4277-9fe8-7bd2c8b00bc7 tempest-VolumesGetTest-1343471577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ff4f264-9bbb-4142-81fd-a487b9cb0d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c642651a-ef85-4f97-96e6-6cedb44553af', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:05:06 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-55461b89-cd38-4277-9fe8-7bd2c8b00bc7 tempest-VolumesGetTest-1343471577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9f01ef6-5926-4da3-b8fd-256db613aa91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:05:06 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-55461b89-cd38-4277-9fe8-7bd2c8b00bc7 tempest-VolumesGetTest-1343471577 None] Volume volume-c642651a-ef85-4f97-96e6-6cedb44553af (c642651a-ef85-4f97-96e6-6cedb44553af): created successfully Aug 10 16:05:06 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-55461b89-cd38-4277-9fe8-7bd2c8b00bc7 tempest-VolumesGetTest-1343471577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9f01ef6-5926-4da3-b8fd-256db613aa91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:05:06 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-55461b89-cd38-4277-9fe8-7bd2c8b00bc7 tempest-VolumesGetTest-1343471577 None] Flow 'volume_create_manager' (3d88b8ac-e612-4968-85f3-9ce43d374e42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:05:06 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-55461b89-cd38-4277-9fe8-7bd2c8b00bc7 tempest-VolumesGetTest-1343471577 None] Created volume successfully. Aug 10 16:05:06 devstack sudo[101321]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:06 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5a7a57a7-cf18-48ee-a0f9-c03dc6a09c7f tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-e3b71d12-56f3-4e44-9701-0196474f964a" returned: 0 in 0.546s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:06 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5a7a57a7-cf18-48ee-a0f9-c03dc6a09c7f tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-e3b71d12-56f3-4e44-9701-0196474f964a {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:07 devstack sudo[101319]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c8da796b-cb48-47c4-a9e5-93d186d872e2 tempest-AttachVolumeTestJSON-1986652723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-7168e1a7-078a-4fb0-bf43-ee40aa6774e2" returned: 0 in 0.623s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c8da796b-cb48-47c4-a9e5-93d186d872e2 tempest-AttachVolumeTestJSON-1986652723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-7168e1a7-078a-4fb0-bf43-ee40aa6774e2 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:07 devstack sudo[101334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-e3b71d12-56f3-4e44-9701-0196474f964a Aug 10 16:05:07 devstack sudo[101334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:07 devstack sudo[101335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-7168e1a7-078a-4fb0-bf43-ee40aa6774e2 Aug 10 16:05:07 devstack sudo[101335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:07 devstack sudo[101334]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:07 devstack sudo[101335]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c8da796b-cb48-47c4-a9e5-93d186d872e2 tempest-AttachVolumeTestJSON-1986652723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-7168e1a7-078a-4fb0-bf43-ee40aa6774e2" returned: 0 in 0.301s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5a7a57a7-cf18-48ee-a0f9-c03dc6a09c7f tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-e3b71d12-56f3-4e44-9701-0196474f964a" returned: 0 in 0.333s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:07 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-c8da796b-cb48-47c4-a9e5-93d186d872e2 tempest-AttachVolumeTestJSON-1986652723 None] Lock "cinder-quobyte-7168e1a7-078a-4fb0-bf43-ee40aa6774e2" released by "delete_volume" :: held 1.036s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:05:07 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-5a7a57a7-cf18-48ee-a0f9-c03dc6a09c7f tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Lock "cinder-quobyte-e3b71d12-56f3-4e44-9701-0196474f964a" released by "delete_volume" :: held 0.977s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:05:07 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-5a7a57a7-cf18-48ee-a0f9-c03dc6a09c7f tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Created reservations ['155f3257-7ff2-493e-8bf0-14cb541c54ab', '09641b3a-b33d-400c-8bb8-90186e634e57', '0df7e5ab-f8a5-4e00-a828-de63b07c4e6e', '8241642b-d1d3-4063-9d4b-ca74cfb45d5d'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:05:07 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-c8da796b-cb48-47c4-a9e5-93d186d872e2 tempest-AttachVolumeTestJSON-1986652723 None] Created reservations ['a443b18a-f414-4fda-94c1-951cb0f3c76f', '45e038e7-b77a-49eb-bd0c-e4f45e8b3866', '1cfc1ef7-46a0-42f0-84c7-0589731eb104', 'cc880fd6-5541-43a8-abb4-f2390b45ccdf'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:05:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-5a7a57a7-cf18-48ee-a0f9-c03dc6a09c7f tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:05:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-5a7a57a7-cf18-48ee-a0f9-c03dc6a09c7f tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:05:07 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-5a7a57a7-cf18-48ee-a0f9-c03dc6a09c7f tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:05:07 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-5a7a57a7-cf18-48ee-a0f9-c03dc6a09c7f tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:05:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-5a7a57a7-cf18-48ee-a0f9-c03dc6a09c7f tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:05:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5a7a57a7-cf18-48ee-a0f9-c03dc6a09c7f tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:07 devstack sudo[101341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:05:07 devstack sudo[101341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-c8da796b-cb48-47c4-a9e5-93d186d872e2 tempest-AttachVolumeTestJSON-1986652723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:05:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-c8da796b-cb48-47c4-a9e5-93d186d872e2 tempest-AttachVolumeTestJSON-1986652723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:05:07 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-c8da796b-cb48-47c4-a9e5-93d186d872e2 tempest-AttachVolumeTestJSON-1986652723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:05:07 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-c8da796b-cb48-47c4-a9e5-93d186d872e2 tempest-AttachVolumeTestJSON-1986652723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:05:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-c8da796b-cb48-47c4-a9e5-93d186d872e2 tempest-AttachVolumeTestJSON-1986652723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:05:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c8da796b-cb48-47c4-a9e5-93d186d872e2 tempest-AttachVolumeTestJSON-1986652723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:07 devstack sudo[101343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:05:07 devstack sudo[101343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:07 devstack sudo[101341]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5a7a57a7-cf18-48ee-a0f9-c03dc6a09c7f tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.356s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:07 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-5a7a57a7-cf18-48ee-a0f9-c03dc6a09c7f tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:05:07 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-5a7a57a7-cf18-48ee-a0f9-c03dc6a09c7f tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Deleted volume successfully. Aug 10 16:05:07 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-5a7a57a7-cf18-48ee-a0f9-c03dc6a09c7f tempest-CreateVolumesFromSourceVolumeTest-1465401219 None] Lock "cinder-e3b71d12-56f3-4e44-9701-0196474f964a-delete_volume" released by "delete_volume" :: held 1.685s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:05:07 devstack sudo[101343]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c8da796b-cb48-47c4-a9e5-93d186d872e2 tempest-AttachVolumeTestJSON-1986652723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.370s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:07 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-c8da796b-cb48-47c4-a9e5-93d186d872e2 tempest-AttachVolumeTestJSON-1986652723 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:05:07 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-c8da796b-cb48-47c4-a9e5-93d186d872e2 tempest-AttachVolumeTestJSON-1986652723 None] Deleted volume successfully. Aug 10 16:05:07 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-c8da796b-cb48-47c4-a9e5-93d186d872e2 tempest-AttachVolumeTestJSON-1986652723 None] Lock "cinder-7168e1a7-078a-4fb0-bf43-ee40aa6774e2-delete_volume" released by "delete_volume" :: held 1.808s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:05:08 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-4b5c66ca-bb7e-4efd-8d20-a6c9f9a05b28 tempest-AttachVolumeTestJSON-1986652723 None] Acquiring lock "cinder-914dbc04-6c7c-4d80-bd5a-e5c2e3eaf787-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:05:08 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-587edc81-3ea1-4a8a-ab8d-3a7f95f26f06 tempest-VolumesGetTest-1343471577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:05:08 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-587edc81-3ea1-4a8a-ab8d-3a7f95f26f06 tempest-VolumesGetTest-1343471577 None] Flow 'volume_create_manager' (badae735-1dad-44de-9881-b4e3aa6427d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:05:08 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-587edc81-3ea1-4a8a-ab8d-3a7f95f26f06 tempest-VolumesGetTest-1343471577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0df5fe86-7e19-45dc-8c00-2e13beadfdb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:05:08 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-4b5c66ca-bb7e-4efd-8d20-a6c9f9a05b28 tempest-AttachVolumeTestJSON-1986652723 None] Lock "cinder-914dbc04-6c7c-4d80-bd5a-e5c2e3eaf787-delete_volume" acquired by "delete_volume" :: waited 0.102s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:05:08 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-587edc81-3ea1-4a8a-ab8d-3a7f95f26f06 tempest-VolumesGetTest-1343471577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0df5fe86-7e19-45dc-8c00-2e13beadfdb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:05:08Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1225809187',display_name='tempest-VolumesGetTest-Volume-1516005301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdce88b1-482b-46df-a81a-fde43258d71d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e7031fd1bb44cf0a04e7115662ddae4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:05:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:05:09Z,use_quota=True,user_id='7f39fba2cc494ee4ae204aeae406bec5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:05:08 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-587edc81-3ea1-4a8a-ab8d-3a7f95f26f06 tempest-VolumesGetTest-1343471577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07dd78a0-27fc-4e1e-ae58-f2115462bd4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:05:08 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-587edc81-3ea1-4a8a-ab8d-3a7f95f26f06 tempest-VolumesGetTest-1343471577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07dd78a0-27fc-4e1e-ae58-f2115462bd4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:05:08 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-587edc81-3ea1-4a8a-ab8d-3a7f95f26f06 tempest-VolumesGetTest-1343471577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (726e82cc-e7c7-47fb-b134-e560dabb3e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:05:08 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-587edc81-3ea1-4a8a-ab8d-3a7f95f26f06 tempest-VolumesGetTest-1343471577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (726e82cc-e7c7-47fb-b134-e560dabb3e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cdce88b1-482b-46df-a81a-fde43258d71d', 'volume_name': 'volume-cdce88b1-482b-46df-a81a-fde43258d71d', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:05:08 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-587edc81-3ea1-4a8a-ab8d-3a7f95f26f06 tempest-VolumesGetTest-1343471577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97c0d8ea-248f-485f-b72a-df1aeb0cff73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:05:08 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-587edc81-3ea1-4a8a-ab8d-3a7f95f26f06 tempest-VolumesGetTest-1343471577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97c0d8ea-248f-485f-b72a-df1aeb0cff73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:05:08 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-587edc81-3ea1-4a8a-ab8d-3a7f95f26f06 tempest-VolumesGetTest-1343471577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b40bf8bb-0bbe-47b6-ba05-8d07f3285741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:05:08 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-587edc81-3ea1-4a8a-ab8d-3a7f95f26f06 tempest-VolumesGetTest-1343471577 None] Volume cdce88b1-482b-46df-a81a-fde43258d71d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cdce88b1-482b-46df-a81a-fde43258d71d', 'volume_size': 1} Aug 10 16:05:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-587edc81-3ea1-4a8a-ab8d-3a7f95f26f06 tempest-VolumesGetTest-1343471577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:05:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-587edc81-3ea1-4a8a-ab8d-3a7f95f26f06 tempest-VolumesGetTest-1343471577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:05:08 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-587edc81-3ea1-4a8a-ab8d-3a7f95f26f06 tempest-VolumesGetTest-1343471577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:05:08Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1225809187',display_name='tempest-VolumesGetTest-Volume-1516005301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdce88b1-482b-46df-a81a-fde43258d71d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e7031fd1bb44cf0a04e7115662ddae4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:05:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:05:09Z,use_quota=True,user_id='7f39fba2cc494ee4ae204aeae406bec5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:05:08 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-587edc81-3ea1-4a8a-ab8d-3a7f95f26f06 tempest-VolumesGetTest-1343471577 None] Creating volume cdce88b1-482b-46df-a81a-fde43258d71d {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:05:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-587edc81-3ea1-4a8a-ab8d-3a7f95f26f06 tempest-VolumesGetTest-1343471577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:05:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-587edc81-3ea1-4a8a-ab8d-3a7f95f26f06 tempest-VolumesGetTest-1343471577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:05:08 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-587edc81-3ea1-4a8a-ab8d-3a7f95f26f06 tempest-VolumesGetTest-1343471577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:05:08 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-587edc81-3ea1-4a8a-ab8d-3a7f95f26f06 tempest-VolumesGetTest-1343471577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:05:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-587edc81-3ea1-4a8a-ab8d-3a7f95f26f06 tempest-VolumesGetTest-1343471577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:05:08 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-587edc81-3ea1-4a8a-ab8d-3a7f95f26f06 tempest-VolumesGetTest-1343471577 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:05:08 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-587edc81-3ea1-4a8a-ab8d-3a7f95f26f06 tempest-VolumesGetTest-1343471577 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:05:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-587edc81-3ea1-4a8a-ab8d-3a7f95f26f06 tempest-VolumesGetTest-1343471577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-cdce88b1-482b-46df-a81a-fde43258d71d 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:09 devstack sudo[101767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-cdce88b1-482b-46df-a81a-fde43258d71d 1073741824 Aug 10 16:05:09 devstack sudo[101767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:09 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-4b5c66ca-bb7e-4efd-8d20-a6c9f9a05b28 tempest-AttachVolumeTestJSON-1986652723 None] Acquiring lock "cinder-quobyte-914dbc04-6c7c-4d80-bd5a-e5c2e3eaf787" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:05:09 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-4b5c66ca-bb7e-4efd-8d20-a6c9f9a05b28 tempest-AttachVolumeTestJSON-1986652723 None] Lock "cinder-quobyte-914dbc04-6c7c-4d80-bd5a-e5c2e3eaf787" acquired by "delete_volume" :: waited 0.038s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:05:09 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[a19391d6-7953-42ad-9b22-efa7cb2c8237]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:05:09 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4b5c66ca-bb7e-4efd-8d20-a6c9f9a05b28 tempest-AttachVolumeTestJSON-1986652723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-914dbc04-6c7c-4d80-bd5a-e5c2e3eaf787 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:09 devstack sudo[101776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-914dbc04-6c7c-4d80-bd5a-e5c2e3eaf787 Aug 10 16:05:09 devstack sudo[101776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:09 devstack sudo[101767]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:09 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-587edc81-3ea1-4a8a-ab8d-3a7f95f26f06 tempest-VolumesGetTest-1343471577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-cdce88b1-482b-46df-a81a-fde43258d71d 1073741824" returned: 0 in 0.881s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:09 devstack cinder-volume[88641]: DEBUG dbcounter [-] [88641] Writing DB stats cinder:UPDATE=196,cinder:SELECT=170,cinder:INSERT=56,cinder:DELETE=18 {{(pid=88641) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 16:05:09 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-587edc81-3ea1-4a8a-ab8d-3a7f95f26f06 tempest-VolumesGetTest-1343471577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-cdce88b1-482b-46df-a81a-fde43258d71d {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:10 devstack sudo[101776]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:10 devstack sudo[101802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-cdce88b1-482b-46df-a81a-fde43258d71d Aug 10 16:05:10 devstack sudo[101802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:10 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4b5c66ca-bb7e-4efd-8d20-a6c9f9a05b28 tempest-AttachVolumeTestJSON-1986652723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-914dbc04-6c7c-4d80-bd5a-e5c2e3eaf787" returned: 0 in 0.848s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:10 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4b5c66ca-bb7e-4efd-8d20-a6c9f9a05b28 tempest-AttachVolumeTestJSON-1986652723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-914dbc04-6c7c-4d80-bd5a-e5c2e3eaf787 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:10 devstack sudo[101806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-914dbc04-6c7c-4d80-bd5a-e5c2e3eaf787 Aug 10 16:05:10 devstack sudo[101806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:10 devstack sudo[101802]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:10 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-587edc81-3ea1-4a8a-ab8d-3a7f95f26f06 tempest-VolumesGetTest-1343471577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-cdce88b1-482b-46df-a81a-fde43258d71d" returned: 0 in 0.365s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:10 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-587edc81-3ea1-4a8a-ab8d-3a7f95f26f06 tempest-VolumesGetTest-1343471577 None] <== create_volume: return (1333ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:05:10 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-587edc81-3ea1-4a8a-ab8d-3a7f95f26f06 tempest-VolumesGetTest-1343471577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.336s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:05:10 devstack cinder-volume[88641]: DEBUG dbcounter [-] [88641] Writing DB stats cinder:SELECT=176,cinder:INSERT=52,cinder:UPDATE=235,cinder:DELETE=20 {{(pid=88641) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 16:05:10 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-587edc81-3ea1-4a8a-ab8d-3a7f95f26f06 tempest-VolumesGetTest-1343471577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b40bf8bb-0bbe-47b6-ba05-8d07f3285741) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdce88b1-482b-46df-a81a-fde43258d71d', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:05:10 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-587edc81-3ea1-4a8a-ab8d-3a7f95f26f06 tempest-VolumesGetTest-1343471577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31534bc9-b078-4203-9b45-57b7fff47c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:05:10 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-587edc81-3ea1-4a8a-ab8d-3a7f95f26f06 tempest-VolumesGetTest-1343471577 None] Volume volume-cdce88b1-482b-46df-a81a-fde43258d71d (cdce88b1-482b-46df-a81a-fde43258d71d): created successfully Aug 10 16:05:10 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-587edc81-3ea1-4a8a-ab8d-3a7f95f26f06 tempest-VolumesGetTest-1343471577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31534bc9-b078-4203-9b45-57b7fff47c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:05:10 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-587edc81-3ea1-4a8a-ab8d-3a7f95f26f06 tempest-VolumesGetTest-1343471577 None] Flow 'volume_create_manager' (badae735-1dad-44de-9881-b4e3aa6427d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:05:10 devstack sudo[101806]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:10 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4b5c66ca-bb7e-4efd-8d20-a6c9f9a05b28 tempest-AttachVolumeTestJSON-1986652723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-914dbc04-6c7c-4d80-bd5a-e5c2e3eaf787" returned: 0 in 0.378s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:10 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-587edc81-3ea1-4a8a-ab8d-3a7f95f26f06 tempest-VolumesGetTest-1343471577 None] Created volume successfully. Aug 10 16:05:10 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-4b5c66ca-bb7e-4efd-8d20-a6c9f9a05b28 tempest-AttachVolumeTestJSON-1986652723 None] Lock "cinder-quobyte-914dbc04-6c7c-4d80-bd5a-e5c2e3eaf787" released by "delete_volume" :: held 1.293s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:05:10 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-4b5c66ca-bb7e-4efd-8d20-a6c9f9a05b28 tempest-AttachVolumeTestJSON-1986652723 None] Created reservations ['cf3a1226-b2b1-4266-b118-8310900e61b7', '3ecc43c3-e845-446d-80ea-13845697032f', '9d26145c-56a2-4f85-8067-a754df6e0c21', 'bae53772-d4b5-45be-b848-3adb678d2e99'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:05:10 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-4b5c66ca-bb7e-4efd-8d20-a6c9f9a05b28 tempest-AttachVolumeTestJSON-1986652723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:05:10 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-4b5c66ca-bb7e-4efd-8d20-a6c9f9a05b28 tempest-AttachVolumeTestJSON-1986652723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:05:10 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-4b5c66ca-bb7e-4efd-8d20-a6c9f9a05b28 tempest-AttachVolumeTestJSON-1986652723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:05:10 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-4b5c66ca-bb7e-4efd-8d20-a6c9f9a05b28 tempest-AttachVolumeTestJSON-1986652723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:05:10 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-4b5c66ca-bb7e-4efd-8d20-a6c9f9a05b28 tempest-AttachVolumeTestJSON-1986652723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:05:10 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4b5c66ca-bb7e-4efd-8d20-a6c9f9a05b28 tempest-AttachVolumeTestJSON-1986652723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:10 devstack sudo[101826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:05:10 devstack sudo[101826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:10 devstack sudo[101826]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:10 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4b5c66ca-bb7e-4efd-8d20-a6c9f9a05b28 tempest-AttachVolumeTestJSON-1986652723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.323s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:10 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-4b5c66ca-bb7e-4efd-8d20-a6c9f9a05b28 tempest-AttachVolumeTestJSON-1986652723 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:05:10 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-4b5c66ca-bb7e-4efd-8d20-a6c9f9a05b28 tempest-AttachVolumeTestJSON-1986652723 None] Deleted volume successfully. Aug 10 16:05:10 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-4b5c66ca-bb7e-4efd-8d20-a6c9f9a05b28 tempest-AttachVolumeTestJSON-1986652723 None] Lock "cinder-914dbc04-6c7c-4d80-bd5a-e5c2e3eaf787-delete_volume" released by "delete_volume" :: held 2.060s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:05:11 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-265fcf9a-5251-4094-9eb4-90f81a771a4b tempest-VolumesGetTest-1343471577 None] Acquiring lock "cinder-cdce88b1-482b-46df-a81a-fde43258d71d-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:05:11 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-265fcf9a-5251-4094-9eb4-90f81a771a4b tempest-VolumesGetTest-1343471577 None] Lock "cinder-cdce88b1-482b-46df-a81a-fde43258d71d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:05:11 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-265fcf9a-5251-4094-9eb4-90f81a771a4b tempest-VolumesGetTest-1343471577 None] Acquiring lock "cinder-quobyte-cdce88b1-482b-46df-a81a-fde43258d71d" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:05:11 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-265fcf9a-5251-4094-9eb4-90f81a771a4b tempest-VolumesGetTest-1343471577 None] Lock "cinder-quobyte-cdce88b1-482b-46df-a81a-fde43258d71d" acquired by "delete_volume" :: waited 0.019s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:05:11 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb07289-2c92-48ac-9bb2-00fd5189ac4b]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:05:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-265fcf9a-5251-4094-9eb4-90f81a771a4b tempest-VolumesGetTest-1343471577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-cdce88b1-482b-46df-a81a-fde43258d71d {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:11 devstack sudo[101829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-cdce88b1-482b-46df-a81a-fde43258d71d Aug 10 16:05:11 devstack sudo[101829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:11 devstack sudo[101829]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-265fcf9a-5251-4094-9eb4-90f81a771a4b tempest-VolumesGetTest-1343471577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-cdce88b1-482b-46df-a81a-fde43258d71d" returned: 0 in 0.525s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-265fcf9a-5251-4094-9eb4-90f81a771a4b tempest-VolumesGetTest-1343471577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-cdce88b1-482b-46df-a81a-fde43258d71d {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:11 devstack sudo[101836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-cdce88b1-482b-46df-a81a-fde43258d71d Aug 10 16:05:11 devstack sudo[101836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:12 devstack sudo[101836]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:12 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-265fcf9a-5251-4094-9eb4-90f81a771a4b tempest-VolumesGetTest-1343471577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-cdce88b1-482b-46df-a81a-fde43258d71d" returned: 0 in 0.442s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:12 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-265fcf9a-5251-4094-9eb4-90f81a771a4b tempest-VolumesGetTest-1343471577 None] Lock "cinder-quobyte-cdce88b1-482b-46df-a81a-fde43258d71d" released by "delete_volume" :: held 1.033s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:05:12 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-265fcf9a-5251-4094-9eb4-90f81a771a4b tempest-VolumesGetTest-1343471577 None] Created reservations ['a1461dd0-a8c3-4e1f-8139-28e8f1921a1a', 'ae0eed04-da5b-4d24-bb80-998d81b9ba31', 'e09f3bb5-6b4f-42f1-b222-df255958e10f', '353d0152-d7be-4260-8a25-1041dcd7ce56'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:05:12 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-265fcf9a-5251-4094-9eb4-90f81a771a4b tempest-VolumesGetTest-1343471577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:05:12 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-265fcf9a-5251-4094-9eb4-90f81a771a4b tempest-VolumesGetTest-1343471577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:05:12 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-265fcf9a-5251-4094-9eb4-90f81a771a4b tempest-VolumesGetTest-1343471577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:05:12 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-265fcf9a-5251-4094-9eb4-90f81a771a4b tempest-VolumesGetTest-1343471577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:05:12 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-265fcf9a-5251-4094-9eb4-90f81a771a4b tempest-VolumesGetTest-1343471577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:05:12 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-265fcf9a-5251-4094-9eb4-90f81a771a4b tempest-VolumesGetTest-1343471577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:12 devstack sudo[101840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:05:12 devstack sudo[101840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:12 devstack sudo[101840]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:12 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-265fcf9a-5251-4094-9eb4-90f81a771a4b tempest-VolumesGetTest-1343471577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.451s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:12 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-265fcf9a-5251-4094-9eb4-90f81a771a4b tempest-VolumesGetTest-1343471577 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:05:12 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-265fcf9a-5251-4094-9eb4-90f81a771a4b tempest-VolumesGetTest-1343471577 None] Deleted volume successfully. Aug 10 16:05:12 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-265fcf9a-5251-4094-9eb4-90f81a771a4b tempest-VolumesGetTest-1343471577 None] Lock "cinder-cdce88b1-482b-46df-a81a-fde43258d71d-delete_volume" released by "delete_volume" :: held 1.916s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:05:13 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-af0e0580-793b-4779-b436-57f6ff0ec3af tempest-VolumesGetTest-1343471577 None] Acquiring lock "cinder-c642651a-ef85-4f97-96e6-6cedb44553af-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:05:13 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-af0e0580-793b-4779-b436-57f6ff0ec3af tempest-VolumesGetTest-1343471577 None] Lock "cinder-c642651a-ef85-4f97-96e6-6cedb44553af-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:05:13 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-af0e0580-793b-4779-b436-57f6ff0ec3af tempest-VolumesGetTest-1343471577 None] Acquiring lock "cinder-quobyte-c642651a-ef85-4f97-96e6-6cedb44553af" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:05:13 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-af0e0580-793b-4779-b436-57f6ff0ec3af tempest-VolumesGetTest-1343471577 None] Lock "cinder-quobyte-c642651a-ef85-4f97-96e6-6cedb44553af" acquired by "delete_volume" :: waited 0.050s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:05:13 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a0e42cb-12bd-4240-b44c-5da6fadcadef]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:05:13 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-af0e0580-793b-4779-b436-57f6ff0ec3af tempest-VolumesGetTest-1343471577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c642651a-ef85-4f97-96e6-6cedb44553af {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:13 devstack sudo[101844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c642651a-ef85-4f97-96e6-6cedb44553af Aug 10 16:05:13 devstack sudo[101844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:14 devstack sudo[101844]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:14 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-af0e0580-793b-4779-b436-57f6ff0ec3af tempest-VolumesGetTest-1343471577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c642651a-ef85-4f97-96e6-6cedb44553af" returned: 0 in 0.517s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:14 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-af0e0580-793b-4779-b436-57f6ff0ec3af tempest-VolumesGetTest-1343471577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c642651a-ef85-4f97-96e6-6cedb44553af {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:14 devstack sudo[101849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c642651a-ef85-4f97-96e6-6cedb44553af Aug 10 16:05:14 devstack sudo[101849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:14 devstack sudo[101849]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:14 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-af0e0580-793b-4779-b436-57f6ff0ec3af tempest-VolumesGetTest-1343471577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c642651a-ef85-4f97-96e6-6cedb44553af" returned: 0 in 0.316s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:14 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-af0e0580-793b-4779-b436-57f6ff0ec3af tempest-VolumesGetTest-1343471577 None] Lock "cinder-quobyte-c642651a-ef85-4f97-96e6-6cedb44553af" released by "delete_volume" :: held 0.923s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:05:14 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-af0e0580-793b-4779-b436-57f6ff0ec3af tempest-VolumesGetTest-1343471577 None] Created reservations ['57e91c01-77e5-4291-8d4f-f18eecf6b217', '59d9a8cb-bf47-4c75-8b37-42ebb9b181d8', '2b47c285-21f2-48e5-a0f5-012240e02d41', 'fdbd292c-f064-4709-8b29-0d311afb44e3'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:05:14 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-af0e0580-793b-4779-b436-57f6ff0ec3af tempest-VolumesGetTest-1343471577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:05:14 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-af0e0580-793b-4779-b436-57f6ff0ec3af tempest-VolumesGetTest-1343471577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:05:14 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-af0e0580-793b-4779-b436-57f6ff0ec3af tempest-VolumesGetTest-1343471577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:05:14 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-af0e0580-793b-4779-b436-57f6ff0ec3af tempest-VolumesGetTest-1343471577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:05:14 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-af0e0580-793b-4779-b436-57f6ff0ec3af tempest-VolumesGetTest-1343471577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:05:14 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-af0e0580-793b-4779-b436-57f6ff0ec3af tempest-VolumesGetTest-1343471577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:14 devstack sudo[101852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:05:14 devstack sudo[101852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:15 devstack sudo[101852]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:15 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-af0e0580-793b-4779-b436-57f6ff0ec3af tempest-VolumesGetTest-1343471577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.458s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:15 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-af0e0580-793b-4779-b436-57f6ff0ec3af tempest-VolumesGetTest-1343471577 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:05:15 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-af0e0580-793b-4779-b436-57f6ff0ec3af tempest-VolumesGetTest-1343471577 None] Deleted volume successfully. Aug 10 16:05:15 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-af0e0580-793b-4779-b436-57f6ff0ec3af tempest-VolumesGetTest-1343471577 None] Lock "cinder-c642651a-ef85-4f97-96e6-6cedb44553af-delete_volume" released by "delete_volume" :: held 1.838s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:05:16 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-20f47f0e-d0dc-4c74-8e69-9f3b051290c7 tempest-VolumesGetTest-1343471577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:05:16 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-20f47f0e-d0dc-4c74-8e69-9f3b051290c7 tempest-VolumesGetTest-1343471577 None] Flow 'volume_create_manager' (e7f4015a-26e6-458c-ac19-f967dadc9a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:05:16 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-20f47f0e-d0dc-4c74-8e69-9f3b051290c7 tempest-VolumesGetTest-1343471577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2bf3fb0-1967-4a5b-9997-e7759bba8905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:05:16 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-20f47f0e-d0dc-4c74-8e69-9f3b051290c7 tempest-VolumesGetTest-1343471577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2bf3fb0-1967-4a5b-9997-e7759bba8905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-117720891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46755b28-7543-4bbb-9ad8-96fc817a56a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e7031fd1bb44cf0a04e7115662ddae4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:05:16Z,use_quota=True,user_id='7f39fba2cc494ee4ae204aeae406bec5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:05:16 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-20f47f0e-d0dc-4c74-8e69-9f3b051290c7 tempest-VolumesGetTest-1343471577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dde6edd-3459-4b16-9084-e7914ab2ccf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:05:16 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-20f47f0e-d0dc-4c74-8e69-9f3b051290c7 tempest-VolumesGetTest-1343471577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dde6edd-3459-4b16-9084-e7914ab2ccf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:05:16 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-20f47f0e-d0dc-4c74-8e69-9f3b051290c7 tempest-VolumesGetTest-1343471577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5ed0089-b6da-400c-80bb-7808330cd6c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:05:16 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-20f47f0e-d0dc-4c74-8e69-9f3b051290c7 tempest-VolumesGetTest-1343471577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5ed0089-b6da-400c-80bb-7808330cd6c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46755b28-7543-4bbb-9ad8-96fc817a56a2', 'volume_name': 'volume-46755b28-7543-4bbb-9ad8-96fc817a56a2', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:05:16 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-20f47f0e-d0dc-4c74-8e69-9f3b051290c7 tempest-VolumesGetTest-1343471577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76683234-c231-430d-9188-e948e4157eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:05:16 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-20f47f0e-d0dc-4c74-8e69-9f3b051290c7 tempest-VolumesGetTest-1343471577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76683234-c231-430d-9188-e948e4157eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:05:16 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-20f47f0e-d0dc-4c74-8e69-9f3b051290c7 tempest-VolumesGetTest-1343471577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a076403e-4bef-4d98-b792-a0164bbded67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:05:16 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-20f47f0e-d0dc-4c74-8e69-9f3b051290c7 tempest-VolumesGetTest-1343471577 None] Volume 46755b28-7543-4bbb-9ad8-96fc817a56a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46755b28-7543-4bbb-9ad8-96fc817a56a2', 'volume_size': 1} Aug 10 16:05:16 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-20f47f0e-d0dc-4c74-8e69-9f3b051290c7 tempest-VolumesGetTest-1343471577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:05:16 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-20f47f0e-d0dc-4c74-8e69-9f3b051290c7 tempest-VolumesGetTest-1343471577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:05:16 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-20f47f0e-d0dc-4c74-8e69-9f3b051290c7 tempest-VolumesGetTest-1343471577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-117720891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46755b28-7543-4bbb-9ad8-96fc817a56a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e7031fd1bb44cf0a04e7115662ddae4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:05:16Z,use_quota=True,user_id='7f39fba2cc494ee4ae204aeae406bec5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:05:16 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-20f47f0e-d0dc-4c74-8e69-9f3b051290c7 tempest-VolumesGetTest-1343471577 None] Creating volume 46755b28-7543-4bbb-9ad8-96fc817a56a2 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:05:16 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-20f47f0e-d0dc-4c74-8e69-9f3b051290c7 tempest-VolumesGetTest-1343471577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:05:16 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-20f47f0e-d0dc-4c74-8e69-9f3b051290c7 tempest-VolumesGetTest-1343471577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:05:16 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-20f47f0e-d0dc-4c74-8e69-9f3b051290c7 tempest-VolumesGetTest-1343471577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:05:16 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-20f47f0e-d0dc-4c74-8e69-9f3b051290c7 tempest-VolumesGetTest-1343471577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:05:16 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-20f47f0e-d0dc-4c74-8e69-9f3b051290c7 tempest-VolumesGetTest-1343471577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:05:16 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-20f47f0e-d0dc-4c74-8e69-9f3b051290c7 tempest-VolumesGetTest-1343471577 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:05:16 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-20f47f0e-d0dc-4c74-8e69-9f3b051290c7 tempest-VolumesGetTest-1343471577 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:05:16 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-20f47f0e-d0dc-4c74-8e69-9f3b051290c7 tempest-VolumesGetTest-1343471577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-46755b28-7543-4bbb-9ad8-96fc817a56a2 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:16 devstack sudo[101855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-46755b28-7543-4bbb-9ad8-96fc817a56a2 1073741824 Aug 10 16:05:16 devstack sudo[101855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:17 devstack sudo[101855]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-20f47f0e-d0dc-4c74-8e69-9f3b051290c7 tempest-VolumesGetTest-1343471577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-46755b28-7543-4bbb-9ad8-96fc817a56a2 1073741824" returned: 0 in 0.709s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-20f47f0e-d0dc-4c74-8e69-9f3b051290c7 tempest-VolumesGetTest-1343471577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-46755b28-7543-4bbb-9ad8-96fc817a56a2 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:17 devstack sudo[101861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-46755b28-7543-4bbb-9ad8-96fc817a56a2 Aug 10 16:05:17 devstack sudo[101861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:17 devstack sudo[101861]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-20f47f0e-d0dc-4c74-8e69-9f3b051290c7 tempest-VolumesGetTest-1343471577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-46755b28-7543-4bbb-9ad8-96fc817a56a2" returned: 0 in 0.476s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:17 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-20f47f0e-d0dc-4c74-8e69-9f3b051290c7 tempest-VolumesGetTest-1343471577 None] <== create_volume: return (1270ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:05:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-20f47f0e-d0dc-4c74-8e69-9f3b051290c7 tempest-VolumesGetTest-1343471577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.275s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:05:17 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-20f47f0e-d0dc-4c74-8e69-9f3b051290c7 tempest-VolumesGetTest-1343471577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a076403e-4bef-4d98-b792-a0164bbded67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46755b28-7543-4bbb-9ad8-96fc817a56a2', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:05:17 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-20f47f0e-d0dc-4c74-8e69-9f3b051290c7 tempest-VolumesGetTest-1343471577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7372a0d8-acf9-4cb3-8d76-88af36c8335c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:05:18 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-20f47f0e-d0dc-4c74-8e69-9f3b051290c7 tempest-VolumesGetTest-1343471577 None] Volume volume-46755b28-7543-4bbb-9ad8-96fc817a56a2 (46755b28-7543-4bbb-9ad8-96fc817a56a2): created successfully Aug 10 16:05:18 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-20f47f0e-d0dc-4c74-8e69-9f3b051290c7 tempest-VolumesGetTest-1343471577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7372a0d8-acf9-4cb3-8d76-88af36c8335c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:05:18 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-20f47f0e-d0dc-4c74-8e69-9f3b051290c7 tempest-VolumesGetTest-1343471577 None] Flow 'volume_create_manager' (e7f4015a-26e6-458c-ac19-f967dadc9a5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:05:18 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-20f47f0e-d0dc-4c74-8e69-9f3b051290c7 tempest-VolumesGetTest-1343471577 None] Created volume successfully. Aug 10 16:05:19 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bbdfbce-21ea-444c-8af6-f4b82fbbdc14 tempest-VolumesGetTest-1343471577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:05:19 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-7bbdfbce-21ea-444c-8af6-f4b82fbbdc14 tempest-VolumesGetTest-1343471577 None] Flow 'volume_create_manager' (7aaf5862-63cc-47a7-8a54-d121d4c9c081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:05:19 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-7bbdfbce-21ea-444c-8af6-f4b82fbbdc14 tempest-VolumesGetTest-1343471577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1636c157-5f80-4343-a270-87502cfeada0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:05:19 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-7bbdfbce-21ea-444c-8af6-f4b82fbbdc14 tempest-VolumesGetTest-1343471577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1636c157-5f80-4343-a270-87502cfeada0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:05:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-236048078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13f4d2f1-a32e-4653-b431-589ca8dc8332,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8e7031fd1bb44cf0a04e7115662ddae4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:05:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=46755b28-7543-4bbb-9ad8-96fc817a56a2,status='creating',terminated_at=None,updated_at=2026-08-10T14:05:19Z,use_quota=True,user_id='7f39fba2cc494ee4ae204aeae406bec5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:05:19 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-7bbdfbce-21ea-444c-8af6-f4b82fbbdc14 tempest-VolumesGetTest-1343471577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a43b0dc-8be2-4d03-a296-384203f7229f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:05:19 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-7bbdfbce-21ea-444c-8af6-f4b82fbbdc14 tempest-VolumesGetTest-1343471577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a43b0dc-8be2-4d03-a296-384203f7229f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:05:19 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-7bbdfbce-21ea-444c-8af6-f4b82fbbdc14 tempest-VolumesGetTest-1343471577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e3698b5-472b-45a5-9bc9-5a7ea9fe7e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:05:19 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-7bbdfbce-21ea-444c-8af6-f4b82fbbdc14 tempest-VolumesGetTest-1343471577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e3698b5-472b-45a5-9bc9-5a7ea9fe7e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '13f4d2f1-a32e-4653-b431-589ca8dc8332', 'volume_name': 'volume-13f4d2f1-a32e-4653-b431-589ca8dc8332', 'volume_size': 1, 'source_volid': '46755b28-7543-4bbb-9ad8-96fc817a56a2', 'source_volstatus': 'available'}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:05:19 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-7bbdfbce-21ea-444c-8af6-f4b82fbbdc14 tempest-VolumesGetTest-1343471577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0ffd3bf-a398-4e38-8093-e5d6542f742f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:05:19 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-7bbdfbce-21ea-444c-8af6-f4b82fbbdc14 tempest-VolumesGetTest-1343471577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0ffd3bf-a398-4e38-8093-e5d6542f742f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:05:19 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-7bbdfbce-21ea-444c-8af6-f4b82fbbdc14 tempest-VolumesGetTest-1343471577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff9e24a2-2800-4c9c-b6b3-972c044c6320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:05:19 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-7bbdfbce-21ea-444c-8af6-f4b82fbbdc14 tempest-VolumesGetTest-1343471577 None] Volume 13f4d2f1-a32e-4653-b431-589ca8dc8332: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-13f4d2f1-a32e-4653-b431-589ca8dc8332', 'volume_size': 1, 'source_volid': '46755b28-7543-4bbb-9ad8-96fc817a56a2', 'source_volstatus': 'available'} Aug 10 16:05:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-7bbdfbce-21ea-444c-8af6-f4b82fbbdc14 tempest-VolumesGetTest-1343471577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:05:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-7bbdfbce-21ea-444c-8af6-f4b82fbbdc14 tempest-VolumesGetTest-1343471577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:05:19 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-7bbdfbce-21ea-444c-8af6-f4b82fbbdc14 tempest-VolumesGetTest-1343471577 None] Cloning volume 46755b28-7543-4bbb-9ad8-96fc817a56a2 to volume 13f4d2f1-a32e-4653-b431-589ca8dc8332 Aug 10 16:05:19 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-7bbdfbce-21ea-444c-8af6-f4b82fbbdc14 tempest-VolumesGetTest-1343471577 None] Creating offline snapshot e0d420e5-6fba-4d4f-aaa0-629b6fe63403 of volume 46755b28-7543-4bbb-9ad8-96fc817a56a2 {{(pid=88641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 16:05:19 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[dddfb60f-144e-46d2-9ae8-674d53587071]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:05:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7bbdfbce-21ea-444c-8af6-f4b82fbbdc14 tempest-VolumesGetTest-1343471577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-46755b28-7543-4bbb-9ad8-96fc817a56a2 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:19 devstack sudo[101866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-46755b28-7543-4bbb-9ad8-96fc817a56a2 Aug 10 16:05:19 devstack sudo[101866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:19 devstack sudo[101866]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7bbdfbce-21ea-444c-8af6-f4b82fbbdc14 tempest-VolumesGetTest-1343471577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-46755b28-7543-4bbb-9ad8-96fc817a56a2" returned: 0 in 0.400s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7bbdfbce-21ea-444c-8af6-f4b82fbbdc14 tempest-VolumesGetTest-1343471577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-46755b28-7543-4bbb-9ad8-96fc817a56a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-46755b28-7543-4bbb-9ad8-96fc817a56a2.e0d420e5-6fba-4d4f-aaa0-629b6fe63403 1G {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:19 devstack sudo[101871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-46755b28-7543-4bbb-9ad8-96fc817a56a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-46755b28-7543-4bbb-9ad8-96fc817a56a2.e0d420e5-6fba-4d4f-aaa0-629b6fe63403 1G Aug 10 16:05:19 devstack sudo[101871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:20 devstack sudo[101871]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:20 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7bbdfbce-21ea-444c-8af6-f4b82fbbdc14 tempest-VolumesGetTest-1343471577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-46755b28-7543-4bbb-9ad8-96fc817a56a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-46755b28-7543-4bbb-9ad8-96fc817a56a2.e0d420e5-6fba-4d4f-aaa0-629b6fe63403 1G" returned: 0 in 0.453s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:20 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7bbdfbce-21ea-444c-8af6-f4b82fbbdc14 tempest-VolumesGetTest-1343471577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46755b28-7543-4bbb-9ad8-96fc817a56a2 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-46755b28-7543-4bbb-9ad8-96fc817a56a2.e0d420e5-6fba-4d4f-aaa0-629b6fe63403 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:20 devstack sudo[101877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46755b28-7543-4bbb-9ad8-96fc817a56a2 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-46755b28-7543-4bbb-9ad8-96fc817a56a2.e0d420e5-6fba-4d4f-aaa0-629b6fe63403 Aug 10 16:05:20 devstack sudo[101877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:20 devstack sudo[101877]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:20 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7bbdfbce-21ea-444c-8af6-f4b82fbbdc14 tempest-VolumesGetTest-1343471577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46755b28-7543-4bbb-9ad8-96fc817a56a2 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-46755b28-7543-4bbb-9ad8-96fc817a56a2.e0d420e5-6fba-4d4f-aaa0-629b6fe63403" returned: 0 in 0.304s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:20 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-7bbdfbce-21ea-444c-8af6-f4b82fbbdc14 tempest-VolumesGetTest-1343471577 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-46755b28-7543-4bbb-9ad8-96fc817a56a2.e0d420e5-6fba-4d4f-aaa0-629b6fe63403 is being set with open permissions: ugo+rw Aug 10 16:05:20 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7bbdfbce-21ea-444c-8af6-f4b82fbbdc14 tempest-VolumesGetTest-1343471577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-46755b28-7543-4bbb-9ad8-96fc817a56a2.e0d420e5-6fba-4d4f-aaa0-629b6fe63403 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:20 devstack sudo[101883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-46755b28-7543-4bbb-9ad8-96fc817a56a2.e0d420e5-6fba-4d4f-aaa0-629b6fe63403 Aug 10 16:05:20 devstack sudo[101883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:20 devstack sudo[101883]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:20 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7bbdfbce-21ea-444c-8af6-f4b82fbbdc14 tempest-VolumesGetTest-1343471577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-46755b28-7543-4bbb-9ad8-96fc817a56a2.e0d420e5-6fba-4d4f-aaa0-629b6fe63403" returned: 0 in 0.274s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:20 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7bbdfbce-21ea-444c-8af6-f4b82fbbdc14 tempest-VolumesGetTest-1343471577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-46755b28-7543-4bbb-9ad8-96fc817a56a2.info {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:20 devstack sudo[101886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-46755b28-7543-4bbb-9ad8-96fc817a56a2.info Aug 10 16:05:20 devstack sudo[101886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:21 devstack sudo[101886]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:21 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7bbdfbce-21ea-444c-8af6-f4b82fbbdc14 tempest-VolumesGetTest-1343471577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-46755b28-7543-4bbb-9ad8-96fc817a56a2.info" returned: 0 in 0.280s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:21 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-7bbdfbce-21ea-444c-8af6-f4b82fbbdc14 tempest-VolumesGetTest-1343471577 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-46755b28-7543-4bbb-9ad8-96fc817a56a2.info is being set with open permissions: ugo+rw Aug 10 16:05:21 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7bbdfbce-21ea-444c-8af6-f4b82fbbdc14 tempest-VolumesGetTest-1343471577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-46755b28-7543-4bbb-9ad8-96fc817a56a2.info {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:21 devstack sudo[101889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-46755b28-7543-4bbb-9ad8-96fc817a56a2.info Aug 10 16:05:21 devstack sudo[101889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:21 devstack sudo[101889]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:21 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7bbdfbce-21ea-444c-8af6-f4b82fbbdc14 tempest-VolumesGetTest-1343471577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-46755b28-7543-4bbb-9ad8-96fc817a56a2.info" returned: 0 in 0.265s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:21 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-7bbdfbce-21ea-444c-8af6-f4b82fbbdc14 tempest-VolumesGetTest-1343471577 None] Acquiring lock "cinder-quobyte-13f4d2f1-a32e-4653-b431-589ca8dc8332" by "_copy_volume_from_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:05:21 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-7bbdfbce-21ea-444c-8af6-f4b82fbbdc14 tempest-VolumesGetTest-1343471577 None] Lock "cinder-quobyte-13f4d2f1-a32e-4653-b431-589ca8dc8332" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:05:21 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-7bbdfbce-21ea-444c-8af6-f4b82fbbdc14 tempest-VolumesGetTest-1343471577 None] snapshot: e0d420e5-6fba-4d4f-aaa0-629b6fe63403, volume: 13f4d2f1-a32e-4653-b431-589ca8dc8332, {{(pid=88641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 10 16:05:21 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-7bbdfbce-21ea-444c-8af6-f4b82fbbdc14 tempest-VolumesGetTest-1343471577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:05:21 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-7bbdfbce-21ea-444c-8af6-f4b82fbbdc14 tempest-VolumesGetTest-1343471577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:05:21 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-7bbdfbce-21ea-444c-8af6-f4b82fbbdc14 tempest-VolumesGetTest-1343471577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:05:21 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-7bbdfbce-21ea-444c-8af6-f4b82fbbdc14 tempest-VolumesGetTest-1343471577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:05:21 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-7bbdfbce-21ea-444c-8af6-f4b82fbbdc14 tempest-VolumesGetTest-1343471577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:05:21 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[3489f23f-220f-4f57-a54e-98eb2f5834ca]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:05:21 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7bbdfbce-21ea-444c-8af6-f4b82fbbdc14 tempest-VolumesGetTest-1343471577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-46755b28-7543-4bbb-9ad8-96fc817a56a2.e0d420e5-6fba-4d4f-aaa0-629b6fe63403 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:21 devstack sudo[101894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-46755b28-7543-4bbb-9ad8-96fc817a56a2.e0d420e5-6fba-4d4f-aaa0-629b6fe63403 Aug 10 16:05:21 devstack sudo[101894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:21 devstack sudo[101894]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:21 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7bbdfbce-21ea-444c-8af6-f4b82fbbdc14 tempest-VolumesGetTest-1343471577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-46755b28-7543-4bbb-9ad8-96fc817a56a2.e0d420e5-6fba-4d4f-aaa0-629b6fe63403" returned: 0 in 0.422s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:21 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-7bbdfbce-21ea-444c-8af6-f4b82fbbdc14 tempest-VolumesGetTest-1343471577 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46755b28-7543-4bbb-9ad8-96fc817a56a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 16:05:21 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[0675f9d2-f441-4e05-901b-65dc75c7f895]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:05:21 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7bbdfbce-21ea-444c-8af6-f4b82fbbdc14 tempest-VolumesGetTest-1343471577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-46755b28-7543-4bbb-9ad8-96fc817a56a2 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:21 devstack sudo[101900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-46755b28-7543-4bbb-9ad8-96fc817a56a2 Aug 10 16:05:21 devstack sudo[101900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:22 devstack sudo[101900]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7bbdfbce-21ea-444c-8af6-f4b82fbbdc14 tempest-VolumesGetTest-1343471577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-46755b28-7543-4bbb-9ad8-96fc817a56a2" returned: 0 in 0.385s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:22 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-7bbdfbce-21ea-444c-8af6-f4b82fbbdc14 tempest-VolumesGetTest-1343471577 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-46755b28-7543-4bbb-9ad8-96fc817a56a2 {{(pid=88641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 10 16:05:22 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-7bbdfbce-21ea-444c-8af6-f4b82fbbdc14 tempest-VolumesGetTest-1343471577 None] Creating direct copy from snapshot {{(pid=88641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 10 16:05:22 devstack cinder-volume[88641]: DEBUG cinder.utils [None req-7bbdfbce-21ea-444c-8af6-f4b82fbbdc14 tempest-VolumesGetTest-1343471577 None] Path /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-13f4d2f1-a32e-4653-b431-589ca8dc8332 not found in is_blk_device check {{(pid=88641) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 10 16:05:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7bbdfbce-21ea-444c-8af6-f4b82fbbdc14 tempest-VolumesGetTest-1343471577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-46755b28-7543-4bbb-9ad8-96fc817a56a2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-13f4d2f1-a32e-4653-b431-589ca8dc8332 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:22 devstack sudo[101906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-46755b28-7543-4bbb-9ad8-96fc817a56a2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-13f4d2f1-a32e-4653-b431-589ca8dc8332 Aug 10 16:05:22 devstack sudo[101906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:28 devstack sudo[101906]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:28 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7bbdfbce-21ea-444c-8af6-f4b82fbbdc14 tempest-VolumesGetTest-1343471577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-46755b28-7543-4bbb-9ad8-96fc817a56a2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-13f4d2f1-a32e-4653-b431-589ca8dc8332" returned: 0 in 6.105s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:28 devstack cinder-volume[88641]: DEBUG cinder.image.image_utils [None req-7bbdfbce-21ea-444c-8af6-f4b82fbbdc14 tempest-VolumesGetTest-1343471577 None] Image conversion details: src /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-46755b28-7543-4bbb-9ad8-96fc817a56a2, size 1024.00 MB, duration 6.11 sec, destination /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-13f4d2f1-a32e-4653-b431-589ca8dc8332 {{(pid=88641) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 10 16:05:28 devstack cinder-volume[88641]: INFO cinder.image.image_utils [None req-7bbdfbce-21ea-444c-8af6-f4b82fbbdc14 tempest-VolumesGetTest-1343471577 None] Converted 1024.00 MB image at 167.69 MB/s Aug 10 16:05:28 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-7bbdfbce-21ea-444c-8af6-f4b82fbbdc14 tempest-VolumesGetTest-1343471577 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-13f4d2f1-a32e-4653-b431-589ca8dc8332 is being set with open permissions: ugo+rw Aug 10 16:05:28 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7bbdfbce-21ea-444c-8af6-f4b82fbbdc14 tempest-VolumesGetTest-1343471577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-13f4d2f1-a32e-4653-b431-589ca8dc8332 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:28 devstack sudo[101948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-13f4d2f1-a32e-4653-b431-589ca8dc8332 Aug 10 16:05:28 devstack sudo[101948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:28 devstack sudo[101948]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:28 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7bbdfbce-21ea-444c-8af6-f4b82fbbdc14 tempest-VolumesGetTest-1343471577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-13f4d2f1-a32e-4653-b431-589ca8dc8332" returned: 0 in 0.250s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:28 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-7bbdfbce-21ea-444c-8af6-f4b82fbbdc14 tempest-VolumesGetTest-1343471577 None] Lock "cinder-quobyte-13f4d2f1-a32e-4653-b431-589ca8dc8332" released by "_copy_volume_from_snapshot" :: held 7.252s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:05:28 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-7bbdfbce-21ea-444c-8af6-f4b82fbbdc14 tempest-VolumesGetTest-1343471577 None] Acquiring lock "cinder-quobyte-e0d420e5-6fba-4d4f-aaa0-629b6fe63403" by "_delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:05:28 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-7bbdfbce-21ea-444c-8af6-f4b82fbbdc14 tempest-VolumesGetTest-1343471577 None] Lock "cinder-quobyte-e0d420e5-6fba-4d4f-aaa0-629b6fe63403" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:05:28 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-7bbdfbce-21ea-444c-8af6-f4b82fbbdc14 tempest-VolumesGetTest-1343471577 None] Deleting offline snapshot e0d420e5-6fba-4d4f-aaa0-629b6fe63403 of volume 46755b28-7543-4bbb-9ad8-96fc817a56a2 {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 16:05:28 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-7bbdfbce-21ea-444c-8af6-f4b82fbbdc14 tempest-VolumesGetTest-1343471577 None] snapshot_file for this snap is: volume-46755b28-7543-4bbb-9ad8-96fc817a56a2.e0d420e5-6fba-4d4f-aaa0-629b6fe63403 {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 16:05:28 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[1479ed2e-fdbc-4ead-8f89-46b9f05fc571]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:05:28 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7bbdfbce-21ea-444c-8af6-f4b82fbbdc14 tempest-VolumesGetTest-1343471577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-46755b28-7543-4bbb-9ad8-96fc817a56a2.e0d420e5-6fba-4d4f-aaa0-629b6fe63403 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:28 devstack sudo[101951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-46755b28-7543-4bbb-9ad8-96fc817a56a2.e0d420e5-6fba-4d4f-aaa0-629b6fe63403 Aug 10 16:05:28 devstack sudo[101951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:29 devstack sudo[101951]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:29 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7bbdfbce-21ea-444c-8af6-f4b82fbbdc14 tempest-VolumesGetTest-1343471577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-46755b28-7543-4bbb-9ad8-96fc817a56a2.e0d420e5-6fba-4d4f-aaa0-629b6fe63403" returned: 0 in 0.364s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:29 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-7bbdfbce-21ea-444c-8af6-f4b82fbbdc14 tempest-VolumesGetTest-1343471577 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46755b28-7543-4bbb-9ad8-96fc817a56a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 16:05:29 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a575777-b84a-4f8d-9ba5-dd496a46dba4]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:05:29 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7bbdfbce-21ea-444c-8af6-f4b82fbbdc14 tempest-VolumesGetTest-1343471577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-46755b28-7543-4bbb-9ad8-96fc817a56a2 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:29 devstack sudo[101956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-46755b28-7543-4bbb-9ad8-96fc817a56a2 Aug 10 16:05:29 devstack sudo[101956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:29 devstack sudo[101956]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:29 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7bbdfbce-21ea-444c-8af6-f4b82fbbdc14 tempest-VolumesGetTest-1343471577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-46755b28-7543-4bbb-9ad8-96fc817a56a2" returned: 0 in 0.531s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:29 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7bbdfbce-21ea-444c-8af6-f4b82fbbdc14 tempest-VolumesGetTest-1343471577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-46755b28-7543-4bbb-9ad8-96fc817a56a2.e0d420e5-6fba-4d4f-aaa0-629b6fe63403 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:29 devstack sudo[101961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-46755b28-7543-4bbb-9ad8-96fc817a56a2.e0d420e5-6fba-4d4f-aaa0-629b6fe63403 Aug 10 16:05:29 devstack sudo[101961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:29 devstack sudo[101961]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:29 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7bbdfbce-21ea-444c-8af6-f4b82fbbdc14 tempest-VolumesGetTest-1343471577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-46755b28-7543-4bbb-9ad8-96fc817a56a2.e0d420e5-6fba-4d4f-aaa0-629b6fe63403" returned: 0 in 0.345s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:29 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7bbdfbce-21ea-444c-8af6-f4b82fbbdc14 tempest-VolumesGetTest-1343471577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-46755b28-7543-4bbb-9ad8-96fc817a56a2.e0d420e5-6fba-4d4f-aaa0-629b6fe63403 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:29 devstack sudo[101966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-46755b28-7543-4bbb-9ad8-96fc817a56a2.e0d420e5-6fba-4d4f-aaa0-629b6fe63403 Aug 10 16:05:29 devstack sudo[101966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:30 devstack sudo[101966]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:30 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7bbdfbce-21ea-444c-8af6-f4b82fbbdc14 tempest-VolumesGetTest-1343471577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-46755b28-7543-4bbb-9ad8-96fc817a56a2.e0d420e5-6fba-4d4f-aaa0-629b6fe63403" returned: 0 in 0.258s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:30 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-7bbdfbce-21ea-444c-8af6-f4b82fbbdc14 tempest-VolumesGetTest-1343471577 None] Lock "cinder-quobyte-e0d420e5-6fba-4d4f-aaa0-629b6fe63403" released by "_delete_snapshot" :: held 1.594s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:05:30 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-7bbdfbce-21ea-444c-8af6-f4b82fbbdc14 tempest-VolumesGetTest-1343471577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.038s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:05:30 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-7bbdfbce-21ea-444c-8af6-f4b82fbbdc14 tempest-VolumesGetTest-1343471577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff9e24a2-2800-4c9c-b6b3-972c044c6320) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13f4d2f1-a32e-4653-b431-589ca8dc8332', 'volume_size': 1, 'source_volid': '46755b28-7543-4bbb-9ad8-96fc817a56a2', 'source_volstatus': 'available'}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:05:30 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-7bbdfbce-21ea-444c-8af6-f4b82fbbdc14 tempest-VolumesGetTest-1343471577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f65f0e97-2543-414a-9b18-e601f6cea144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:05:30 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-7bbdfbce-21ea-444c-8af6-f4b82fbbdc14 tempest-VolumesGetTest-1343471577 None] Volume volume-13f4d2f1-a32e-4653-b431-589ca8dc8332 (13f4d2f1-a32e-4653-b431-589ca8dc8332): created successfully Aug 10 16:05:30 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-7bbdfbce-21ea-444c-8af6-f4b82fbbdc14 tempest-VolumesGetTest-1343471577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f65f0e97-2543-414a-9b18-e601f6cea144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:05:30 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-7bbdfbce-21ea-444c-8af6-f4b82fbbdc14 tempest-VolumesGetTest-1343471577 None] Flow 'volume_create_manager' (7aaf5862-63cc-47a7-8a54-d121d4c9c081) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:05:30 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-7bbdfbce-21ea-444c-8af6-f4b82fbbdc14 tempest-VolumesGetTest-1343471577 None] Created volume successfully. Aug 10 16:05:30 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-132637ca-94b8-4420-aba4-0e0e59414196 tempest-GroupsV314Test-458715218 None] Group tempest-GroupsV314Test-Group-618680030: creating Aug 10 16:05:30 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-132637ca-94b8-4420-aba4-0e0e59414196 tempest-GroupsV314Test-458715218 None] Group tempest-GroupsV314Test-Group-618680030: created successfully Aug 10 16:05:30 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-132637ca-94b8-4420-aba4-0e0e59414196 tempest-GroupsV314Test-458715218 None] Create group completed successfully. Aug 10 16:05:31 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-7eb3ddb6-c975-4382-a566-79cbc87af410 tempest-VolumesGetTest-1343471577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:05:31 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-7eb3ddb6-c975-4382-a566-79cbc87af410 tempest-VolumesGetTest-1343471577 None] Flow 'volume_create_manager' (3f36e29f-5160-4eee-8563-a7c8afce9fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:05:31 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-7eb3ddb6-c975-4382-a566-79cbc87af410 tempest-VolumesGetTest-1343471577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41648c33-0a95-4e3e-8358-24adb3aa116e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:05:31 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-7eb3ddb6-c975-4382-a566-79cbc87af410 tempest-VolumesGetTest-1343471577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41648c33-0a95-4e3e-8358-24adb3aa116e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:05:31Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1003477808',display_name='tempest-VolumesGetTest-Volume-2111161070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e16f0f1f-a698-4230-8890-f0c333760148,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e7031fd1bb44cf0a04e7115662ddae4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:05:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:05:31Z,use_quota=True,user_id='7f39fba2cc494ee4ae204aeae406bec5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:05:31 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-7eb3ddb6-c975-4382-a566-79cbc87af410 tempest-VolumesGetTest-1343471577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b567b24f-92ff-4c78-8f90-5ca1f72a0e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:05:31 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-7eb3ddb6-c975-4382-a566-79cbc87af410 tempest-VolumesGetTest-1343471577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b567b24f-92ff-4c78-8f90-5ca1f72a0e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:05:31 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-7eb3ddb6-c975-4382-a566-79cbc87af410 tempest-VolumesGetTest-1343471577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdd73569-a464-427e-afa0-2ae520bcca3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:05:31 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-7eb3ddb6-c975-4382-a566-79cbc87af410 tempest-VolumesGetTest-1343471577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdd73569-a464-427e-afa0-2ae520bcca3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e16f0f1f-a698-4230-8890-f0c333760148', 'volume_name': 'volume-e16f0f1f-a698-4230-8890-f0c333760148', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:05:31 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-7eb3ddb6-c975-4382-a566-79cbc87af410 tempest-VolumesGetTest-1343471577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a150656-2a86-4bba-91fb-f1cd319de7db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:05:31 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-7eb3ddb6-c975-4382-a566-79cbc87af410 tempest-VolumesGetTest-1343471577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a150656-2a86-4bba-91fb-f1cd319de7db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:05:31 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-7eb3ddb6-c975-4382-a566-79cbc87af410 tempest-VolumesGetTest-1343471577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (206af198-83fc-40ca-b4a3-ecf5255bea85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:05:31 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-7eb3ddb6-c975-4382-a566-79cbc87af410 tempest-VolumesGetTest-1343471577 None] Volume e16f0f1f-a698-4230-8890-f0c333760148: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e16f0f1f-a698-4230-8890-f0c333760148', 'volume_size': 1} Aug 10 16:05:31 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-7eb3ddb6-c975-4382-a566-79cbc87af410 tempest-VolumesGetTest-1343471577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:05:31 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-7eb3ddb6-c975-4382-a566-79cbc87af410 tempest-VolumesGetTest-1343471577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:05:31 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-7eb3ddb6-c975-4382-a566-79cbc87af410 tempest-VolumesGetTest-1343471577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:05:31Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1003477808',display_name='tempest-VolumesGetTest-Volume-2111161070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e16f0f1f-a698-4230-8890-f0c333760148,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e7031fd1bb44cf0a04e7115662ddae4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:05:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:05:31Z,use_quota=True,user_id='7f39fba2cc494ee4ae204aeae406bec5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:05:31 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-7eb3ddb6-c975-4382-a566-79cbc87af410 tempest-VolumesGetTest-1343471577 None] Creating volume e16f0f1f-a698-4230-8890-f0c333760148 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:05:31 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-7eb3ddb6-c975-4382-a566-79cbc87af410 tempest-VolumesGetTest-1343471577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:05:31 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-7eb3ddb6-c975-4382-a566-79cbc87af410 tempest-VolumesGetTest-1343471577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:05:31 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-7eb3ddb6-c975-4382-a566-79cbc87af410 tempest-VolumesGetTest-1343471577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:05:31 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-7eb3ddb6-c975-4382-a566-79cbc87af410 tempest-VolumesGetTest-1343471577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:05:31 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-7eb3ddb6-c975-4382-a566-79cbc87af410 tempest-VolumesGetTest-1343471577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:05:31 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-7eb3ddb6-c975-4382-a566-79cbc87af410 tempest-VolumesGetTest-1343471577 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:05:31 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-7eb3ddb6-c975-4382-a566-79cbc87af410 tempest-VolumesGetTest-1343471577 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:05:31 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7eb3ddb6-c975-4382-a566-79cbc87af410 tempest-VolumesGetTest-1343471577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-e16f0f1f-a698-4230-8890-f0c333760148 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:31 devstack sudo[101969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-e16f0f1f-a698-4230-8890-f0c333760148 1073741824 Aug 10 16:05:31 devstack sudo[101969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:31 devstack sudo[101969]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:31 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7eb3ddb6-c975-4382-a566-79cbc87af410 tempest-VolumesGetTest-1343471577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-e16f0f1f-a698-4230-8890-f0c333760148 1073741824" returned: 0 in 0.404s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:31 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7eb3ddb6-c975-4382-a566-79cbc87af410 tempest-VolumesGetTest-1343471577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-e16f0f1f-a698-4230-8890-f0c333760148 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:31 devstack sudo[101975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-e16f0f1f-a698-4230-8890-f0c333760148 Aug 10 16:05:31 devstack sudo[101975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:31 devstack sudo[101975]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:31 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7eb3ddb6-c975-4382-a566-79cbc87af410 tempest-VolumesGetTest-1343471577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-e16f0f1f-a698-4230-8890-f0c333760148" returned: 0 in 0.241s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:31 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-7eb3ddb6-c975-4382-a566-79cbc87af410 tempest-VolumesGetTest-1343471577 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:05:31 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-7eb3ddb6-c975-4382-a566-79cbc87af410 tempest-VolumesGetTest-1343471577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:05:31 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-7eb3ddb6-c975-4382-a566-79cbc87af410 tempest-VolumesGetTest-1343471577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (206af198-83fc-40ca-b4a3-ecf5255bea85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e16f0f1f-a698-4230-8890-f0c333760148', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:05:31 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-7eb3ddb6-c975-4382-a566-79cbc87af410 tempest-VolumesGetTest-1343471577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59886807-3932-4663-9386-571cba96d894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:05:31 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-7eb3ddb6-c975-4382-a566-79cbc87af410 tempest-VolumesGetTest-1343471577 None] Volume volume-e16f0f1f-a698-4230-8890-f0c333760148 (e16f0f1f-a698-4230-8890-f0c333760148): created successfully Aug 10 16:05:31 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-7eb3ddb6-c975-4382-a566-79cbc87af410 tempest-VolumesGetTest-1343471577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59886807-3932-4663-9386-571cba96d894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:05:31 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-7eb3ddb6-c975-4382-a566-79cbc87af410 tempest-VolumesGetTest-1343471577 None] Flow 'volume_create_manager' (3f36e29f-5160-4eee-8563-a7c8afce9fad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:05:31 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-7eb3ddb6-c975-4382-a566-79cbc87af410 tempest-VolumesGetTest-1343471577 None] Created volume successfully. Aug 10 16:05:32 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b8abfd6-86fe-4cd7-a617-8236da4d25c2 tempest-GroupsV314Test-458715218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:05:32 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-1b8abfd6-86fe-4cd7-a617-8236da4d25c2 tempest-GroupsV314Test-458715218 None] Flow 'volume_create_manager' (5beb63ca-ee57-4959-b092-db4762ececa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:05:32 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-1b8abfd6-86fe-4cd7-a617-8236da4d25c2 tempest-GroupsV314Test-458715218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8420a3d2-47ea-41de-a3d7-7dc4756d0566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:05:32 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-1b8abfd6-86fe-4cd7-a617-8236da4d25c2 tempest-GroupsV314Test-458715218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8420a3d2-47ea-41de-a3d7-7dc4756d0566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:05:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1100974529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dbc510c3-f549-4da3-ac46-0d51b2df183f,host='devstack@QuobyteHD#QuobyteHD',id=b6db0b26-e83d-4b22-b5d3-acde60ac3b53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2435487d256c4a93b738225016ebfa92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:05:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:05:32Z,use_quota=True,user_id='f7c5780700854649a22e2f3e89c07db7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e27b37f6-1d8f-42fe-bf20-09a6fd6aefda),volume_type_id=e27b37f6-1d8f-42fe-bf20-09a6fd6aefda)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:05:32 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-1b8abfd6-86fe-4cd7-a617-8236da4d25c2 tempest-GroupsV314Test-458715218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d7bcaad-5397-4030-a31e-79a3249924e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:05:32 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-1b8abfd6-86fe-4cd7-a617-8236da4d25c2 tempest-GroupsV314Test-458715218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d7bcaad-5397-4030-a31e-79a3249924e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:05:32 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-1b8abfd6-86fe-4cd7-a617-8236da4d25c2 tempest-GroupsV314Test-458715218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57ee01d7-943a-4a04-8eca-223a85d44b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:05:32 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-1b8abfd6-86fe-4cd7-a617-8236da4d25c2 tempest-GroupsV314Test-458715218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57ee01d7-943a-4a04-8eca-223a85d44b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6db0b26-e83d-4b22-b5d3-acde60ac3b53', 'volume_name': 'volume-b6db0b26-e83d-4b22-b5d3-acde60ac3b53', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:05:32 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-1b8abfd6-86fe-4cd7-a617-8236da4d25c2 tempest-GroupsV314Test-458715218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6f3492d-a6cc-4f6f-9d9d-dd89507cdbe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:05:32 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-1b8abfd6-86fe-4cd7-a617-8236da4d25c2 tempest-GroupsV314Test-458715218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6f3492d-a6cc-4f6f-9d9d-dd89507cdbe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:05:32 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-1b8abfd6-86fe-4cd7-a617-8236da4d25c2 tempest-GroupsV314Test-458715218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7395b398-5a79-4cef-91a9-6459e1d76a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:05:32 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-1b8abfd6-86fe-4cd7-a617-8236da4d25c2 tempest-GroupsV314Test-458715218 None] Volume b6db0b26-e83d-4b22-b5d3-acde60ac3b53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6db0b26-e83d-4b22-b5d3-acde60ac3b53', 'volume_size': 1} Aug 10 16:05:32 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-1b8abfd6-86fe-4cd7-a617-8236da4d25c2 tempest-GroupsV314Test-458715218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:05:32 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-1b8abfd6-86fe-4cd7-a617-8236da4d25c2 tempest-GroupsV314Test-458715218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:05:32 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-1b8abfd6-86fe-4cd7-a617-8236da4d25c2 tempest-GroupsV314Test-458715218 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=dbc510c3-f549-4da3-ac46-0d51b2df183f,created_at=2026-08-10T14:05:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1100974529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dbc510c3-f549-4da3-ac46-0d51b2df183f,host='devstack@QuobyteHD#QuobyteHD',id=b6db0b26-e83d-4b22-b5d3-acde60ac3b53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2435487d256c4a93b738225016ebfa92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:05:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:05:32Z,use_quota=True,user_id='f7c5780700854649a22e2f3e89c07db7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e27b37f6-1d8f-42fe-bf20-09a6fd6aefda),volume_type_id=e27b37f6-1d8f-42fe-bf20-09a6fd6aefda)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:05:32 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-1b8abfd6-86fe-4cd7-a617-8236da4d25c2 tempest-GroupsV314Test-458715218 None] Creating volume b6db0b26-e83d-4b22-b5d3-acde60ac3b53 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:05:32 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-1b8abfd6-86fe-4cd7-a617-8236da4d25c2 tempest-GroupsV314Test-458715218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:05:32 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-1b8abfd6-86fe-4cd7-a617-8236da4d25c2 tempest-GroupsV314Test-458715218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:05:32 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-1b8abfd6-86fe-4cd7-a617-8236da4d25c2 tempest-GroupsV314Test-458715218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:05:32 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-1b8abfd6-86fe-4cd7-a617-8236da4d25c2 tempest-GroupsV314Test-458715218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:05:32 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-1b8abfd6-86fe-4cd7-a617-8236da4d25c2 tempest-GroupsV314Test-458715218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:05:32 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-1b8abfd6-86fe-4cd7-a617-8236da4d25c2 tempest-GroupsV314Test-458715218 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:05:32 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-1b8abfd6-86fe-4cd7-a617-8236da4d25c2 tempest-GroupsV314Test-458715218 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:05:32 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-1b8abfd6-86fe-4cd7-a617-8236da4d25c2 tempest-GroupsV314Test-458715218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6db0b26-e83d-4b22-b5d3-acde60ac3b53 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:32 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-36a887cd-683e-4dbf-af38-1adcdd3041c2 tempest-VolumesGetTest-1343471577 None] Acquiring lock "cinder-e16f0f1f-a698-4230-8890-f0c333760148-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:05:32 devstack sudo[101979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6db0b26-e83d-4b22-b5d3-acde60ac3b53 1073741824 Aug 10 16:05:32 devstack sudo[101979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:32 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-36a887cd-683e-4dbf-af38-1adcdd3041c2 tempest-VolumesGetTest-1343471577 None] Lock "cinder-e16f0f1f-a698-4230-8890-f0c333760148-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:05:32 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-36a887cd-683e-4dbf-af38-1adcdd3041c2 tempest-VolumesGetTest-1343471577 None] Acquiring lock "cinder-quobyte-e16f0f1f-a698-4230-8890-f0c333760148" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:05:32 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-36a887cd-683e-4dbf-af38-1adcdd3041c2 tempest-VolumesGetTest-1343471577 None] Lock "cinder-quobyte-e16f0f1f-a698-4230-8890-f0c333760148" acquired by "delete_volume" :: waited 0.013s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:05:32 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[63aa50fc-0ef0-4aff-a196-1f23536ed08d]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:05:32 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-36a887cd-683e-4dbf-af38-1adcdd3041c2 tempest-VolumesGetTest-1343471577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-e16f0f1f-a698-4230-8890-f0c333760148 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:32 devstack sudo[101981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-e16f0f1f-a698-4230-8890-f0c333760148 Aug 10 16:05:32 devstack sudo[101981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:32 devstack sudo[101979]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:32 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-1b8abfd6-86fe-4cd7-a617-8236da4d25c2 tempest-GroupsV314Test-458715218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6db0b26-e83d-4b22-b5d3-acde60ac3b53 1073741824" returned: 0 in 0.439s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:32 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-1b8abfd6-86fe-4cd7-a617-8236da4d25c2 tempest-GroupsV314Test-458715218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6db0b26-e83d-4b22-b5d3-acde60ac3b53 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:32 devstack sudo[101989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6db0b26-e83d-4b22-b5d3-acde60ac3b53 Aug 10 16:05:32 devstack sudo[101989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:32 devstack sudo[101981]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:32 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-36a887cd-683e-4dbf-af38-1adcdd3041c2 tempest-VolumesGetTest-1343471577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-e16f0f1f-a698-4230-8890-f0c333760148" returned: 0 in 0.402s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:32 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-36a887cd-683e-4dbf-af38-1adcdd3041c2 tempest-VolumesGetTest-1343471577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-e16f0f1f-a698-4230-8890-f0c333760148 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:32 devstack sudo[101991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-e16f0f1f-a698-4230-8890-f0c333760148 Aug 10 16:05:32 devstack sudo[101991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:33 devstack sudo[101989]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:33 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-1b8abfd6-86fe-4cd7-a617-8236da4d25c2 tempest-GroupsV314Test-458715218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6db0b26-e83d-4b22-b5d3-acde60ac3b53" returned: 0 in 0.245s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:33 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-1b8abfd6-86fe-4cd7-a617-8236da4d25c2 tempest-GroupsV314Test-458715218 None] <== create_volume: return (724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:05:33 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-1b8abfd6-86fe-4cd7-a617-8236da4d25c2 tempest-GroupsV314Test-458715218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.727s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:05:33 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-1b8abfd6-86fe-4cd7-a617-8236da4d25c2 tempest-GroupsV314Test-458715218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7395b398-5a79-4cef-91a9-6459e1d76a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6db0b26-e83d-4b22-b5d3-acde60ac3b53', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:05:33 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-1b8abfd6-86fe-4cd7-a617-8236da4d25c2 tempest-GroupsV314Test-458715218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dba840d8-39ed-4dc3-ba3a-61745c2ad8f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:05:33 devstack sudo[101991]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:33 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-36a887cd-683e-4dbf-af38-1adcdd3041c2 tempest-VolumesGetTest-1343471577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-e16f0f1f-a698-4230-8890-f0c333760148" returned: 0 in 0.242s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:33 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-1b8abfd6-86fe-4cd7-a617-8236da4d25c2 tempest-GroupsV314Test-458715218 None] Volume volume-b6db0b26-e83d-4b22-b5d3-acde60ac3b53 (b6db0b26-e83d-4b22-b5d3-acde60ac3b53): created successfully Aug 10 16:05:33 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-1b8abfd6-86fe-4cd7-a617-8236da4d25c2 tempest-GroupsV314Test-458715218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dba840d8-39ed-4dc3-ba3a-61745c2ad8f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:05:33 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-1b8abfd6-86fe-4cd7-a617-8236da4d25c2 tempest-GroupsV314Test-458715218 None] Flow 'volume_create_manager' (5beb63ca-ee57-4959-b092-db4762ececa7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:05:33 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-36a887cd-683e-4dbf-af38-1adcdd3041c2 tempest-VolumesGetTest-1343471577 None] Lock "cinder-quobyte-e16f0f1f-a698-4230-8890-f0c333760148" released by "delete_volume" :: held 0.692s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:05:33 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-1b8abfd6-86fe-4cd7-a617-8236da4d25c2 tempest-GroupsV314Test-458715218 None] Created volume successfully. Aug 10 16:05:33 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-36a887cd-683e-4dbf-af38-1adcdd3041c2 tempest-VolumesGetTest-1343471577 None] Created reservations ['13d3bb97-6408-448a-ae00-02fad5648534', '119903de-f3e8-4064-a6ab-ef262d954768', '1c5f5d96-0a1b-44b6-ac29-f878093c3de2', 'ce5e9342-85fb-4353-897a-e8872ae7c8d9'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:05:33 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-36a887cd-683e-4dbf-af38-1adcdd3041c2 tempest-VolumesGetTest-1343471577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:05:33 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-36a887cd-683e-4dbf-af38-1adcdd3041c2 tempest-VolumesGetTest-1343471577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:05:33 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-36a887cd-683e-4dbf-af38-1adcdd3041c2 tempest-VolumesGetTest-1343471577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:05:33 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-36a887cd-683e-4dbf-af38-1adcdd3041c2 tempest-VolumesGetTest-1343471577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:05:33 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-36a887cd-683e-4dbf-af38-1adcdd3041c2 tempest-VolumesGetTest-1343471577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:05:33 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-36a887cd-683e-4dbf-af38-1adcdd3041c2 tempest-VolumesGetTest-1343471577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:33 devstack sudo[101995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:05:33 devstack sudo[101995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:33 devstack sudo[101995]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:33 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-36a887cd-683e-4dbf-af38-1adcdd3041c2 tempest-VolumesGetTest-1343471577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.246s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:33 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-36a887cd-683e-4dbf-af38-1adcdd3041c2 tempest-VolumesGetTest-1343471577 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:05:33 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-36a887cd-683e-4dbf-af38-1adcdd3041c2 tempest-VolumesGetTest-1343471577 None] Deleted volume successfully. Aug 10 16:05:33 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-36a887cd-683e-4dbf-af38-1adcdd3041c2 tempest-VolumesGetTest-1343471577 None] Lock "cinder-e16f0f1f-a698-4230-8890-f0c333760148-delete_volume" released by "delete_volume" :: held 1.127s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:05:33 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-6d1c91ce-d3cd-4a83-bac3-f17338a8d988 tempest-VolumesGetTest-1343471577 None] Acquiring lock "cinder-13f4d2f1-a32e-4653-b431-589ca8dc8332-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:05:33 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-6d1c91ce-d3cd-4a83-bac3-f17338a8d988 tempest-VolumesGetTest-1343471577 None] Lock "cinder-13f4d2f1-a32e-4653-b431-589ca8dc8332-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:05:33 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-6d1c91ce-d3cd-4a83-bac3-f17338a8d988 tempest-VolumesGetTest-1343471577 None] Acquiring lock "cinder-quobyte-13f4d2f1-a32e-4653-b431-589ca8dc8332" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:05:33 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-6d1c91ce-d3cd-4a83-bac3-f17338a8d988 tempest-VolumesGetTest-1343471577 None] Lock "cinder-quobyte-13f4d2f1-a32e-4653-b431-589ca8dc8332" acquired by "delete_volume" :: waited 0.024s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:05:33 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[822f0b30-42a8-47e1-ae90-243165fba297]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:05:33 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6d1c91ce-d3cd-4a83-bac3-f17338a8d988 tempest-VolumesGetTest-1343471577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-13f4d2f1-a32e-4653-b431-589ca8dc8332 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:33 devstack sudo[101999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-13f4d2f1-a32e-4653-b431-589ca8dc8332 Aug 10 16:05:33 devstack sudo[101999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:34 devstack sudo[101999]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:34 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6d1c91ce-d3cd-4a83-bac3-f17338a8d988 tempest-VolumesGetTest-1343471577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-13f4d2f1-a32e-4653-b431-589ca8dc8332" returned: 0 in 0.424s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:34 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6d1c91ce-d3cd-4a83-bac3-f17338a8d988 tempest-VolumesGetTest-1343471577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-13f4d2f1-a32e-4653-b431-589ca8dc8332 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:34 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-261ef4eb-def6-49f5-aa92-d8c8fda5dd64 tempest-GroupsV314Test-458715218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:05:34 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-261ef4eb-def6-49f5-aa92-d8c8fda5dd64 tempest-GroupsV314Test-458715218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:05:34 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-261ef4eb-def6-49f5-aa92-d8c8fda5dd64 tempest-GroupsV314Test-458715218 None] Cloning volume b6db0b26-e83d-4b22-b5d3-acde60ac3b53 to volume da73100a-6e28-454e-8073-a8ae837493e2 Aug 10 16:05:34 devstack sudo[102005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-13f4d2f1-a32e-4653-b431-589ca8dc8332 Aug 10 16:05:34 devstack sudo[102005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:34 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-261ef4eb-def6-49f5-aa92-d8c8fda5dd64 tempest-GroupsV314Test-458715218 None] Creating offline snapshot 5b027b08-94ba-407f-b3ad-8d8dc312a18c of volume b6db0b26-e83d-4b22-b5d3-acde60ac3b53 {{(pid=88641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 16:05:34 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d04677-7783-4d7e-8c04-d0606fee3c7e]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:05:34 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-261ef4eb-def6-49f5-aa92-d8c8fda5dd64 tempest-GroupsV314Test-458715218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6db0b26-e83d-4b22-b5d3-acde60ac3b53 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:34 devstack sudo[102007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6db0b26-e83d-4b22-b5d3-acde60ac3b53 Aug 10 16:05:34 devstack sudo[102007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:34 devstack sudo[102005]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:34 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6d1c91ce-d3cd-4a83-bac3-f17338a8d988 tempest-VolumesGetTest-1343471577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-13f4d2f1-a32e-4653-b431-589ca8dc8332" returned: 0 in 0.270s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:34 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-6d1c91ce-d3cd-4a83-bac3-f17338a8d988 tempest-VolumesGetTest-1343471577 None] Lock "cinder-quobyte-13f4d2f1-a32e-4653-b431-589ca8dc8332" released by "delete_volume" :: held 0.764s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:05:34 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-6d1c91ce-d3cd-4a83-bac3-f17338a8d988 tempest-VolumesGetTest-1343471577 None] Created reservations ['7ea094fc-47e8-4a07-bf92-d8b0c48ff743', '8acbcbba-53bc-48f6-a49d-25dd79c9ad71', 'dd75ff48-c463-4ca1-b0d4-1067b166c1c0', 'de1f5a4b-b6a8-4196-8e96-95d2ff3a83a9'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:05:34 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-6d1c91ce-d3cd-4a83-bac3-f17338a8d988 tempest-VolumesGetTest-1343471577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:05:34 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-6d1c91ce-d3cd-4a83-bac3-f17338a8d988 tempest-VolumesGetTest-1343471577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:05:34 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-6d1c91ce-d3cd-4a83-bac3-f17338a8d988 tempest-VolumesGetTest-1343471577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:05:34 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-6d1c91ce-d3cd-4a83-bac3-f17338a8d988 tempest-VolumesGetTest-1343471577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:05:34 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-6d1c91ce-d3cd-4a83-bac3-f17338a8d988 tempest-VolumesGetTest-1343471577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:05:34 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6d1c91ce-d3cd-4a83-bac3-f17338a8d988 tempest-VolumesGetTest-1343471577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:34 devstack sudo[102013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:05:34 devstack sudo[102013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:34 devstack sudo[102007]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:34 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-261ef4eb-def6-49f5-aa92-d8c8fda5dd64 tempest-GroupsV314Test-458715218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6db0b26-e83d-4b22-b5d3-acde60ac3b53" returned: 0 in 0.388s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:34 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-261ef4eb-def6-49f5-aa92-d8c8fda5dd64 tempest-GroupsV314Test-458715218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6db0b26-e83d-4b22-b5d3-acde60ac3b53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6db0b26-e83d-4b22-b5d3-acde60ac3b53.5b027b08-94ba-407f-b3ad-8d8dc312a18c 1G {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:34 devstack sudo[102015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6db0b26-e83d-4b22-b5d3-acde60ac3b53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6db0b26-e83d-4b22-b5d3-acde60ac3b53.5b027b08-94ba-407f-b3ad-8d8dc312a18c 1G Aug 10 16:05:34 devstack sudo[102015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:34 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-29868f41-1955-4b3b-8395-736befdd655d tempest-VolumesGetTest-1343471577 None] Acquiring lock "cinder-46755b28-7543-4bbb-9ad8-96fc817a56a2-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:05:34 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-29868f41-1955-4b3b-8395-736befdd655d tempest-VolumesGetTest-1343471577 None] Lock "cinder-46755b28-7543-4bbb-9ad8-96fc817a56a2-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:05:34 devstack sudo[102013]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:34 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6d1c91ce-d3cd-4a83-bac3-f17338a8d988 tempest-VolumesGetTest-1343471577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.286s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:34 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-6d1c91ce-d3cd-4a83-bac3-f17338a8d988 tempest-VolumesGetTest-1343471577 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:05:34 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-6d1c91ce-d3cd-4a83-bac3-f17338a8d988 tempest-VolumesGetTest-1343471577 None] Deleted volume successfully. Aug 10 16:05:34 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-29868f41-1955-4b3b-8395-736befdd655d tempest-VolumesGetTest-1343471577 None] Acquiring lock "cinder-quobyte-46755b28-7543-4bbb-9ad8-96fc817a56a2" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:05:34 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-6d1c91ce-d3cd-4a83-bac3-f17338a8d988 tempest-VolumesGetTest-1343471577 None] Lock "cinder-13f4d2f1-a32e-4653-b431-589ca8dc8332-delete_volume" released by "delete_volume" :: held 1.308s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:05:34 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-29868f41-1955-4b3b-8395-736befdd655d tempest-VolumesGetTest-1343471577 None] Lock "cinder-quobyte-46755b28-7543-4bbb-9ad8-96fc817a56a2" acquired by "delete_volume" :: waited 0.016s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:05:34 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa10af43-8753-4b96-b2b9-71f0095a2f37]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:05:34 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-29868f41-1955-4b3b-8395-736befdd655d tempest-VolumesGetTest-1343471577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-46755b28-7543-4bbb-9ad8-96fc817a56a2 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:35 devstack sudo[102015]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:35 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-261ef4eb-def6-49f5-aa92-d8c8fda5dd64 tempest-GroupsV314Test-458715218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6db0b26-e83d-4b22-b5d3-acde60ac3b53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6db0b26-e83d-4b22-b5d3-acde60ac3b53.5b027b08-94ba-407f-b3ad-8d8dc312a18c 1G" returned: 0 in 0.462s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:35 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-261ef4eb-def6-49f5-aa92-d8c8fda5dd64 tempest-GroupsV314Test-458715218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6db0b26-e83d-4b22-b5d3-acde60ac3b53 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6db0b26-e83d-4b22-b5d3-acde60ac3b53.5b027b08-94ba-407f-b3ad-8d8dc312a18c {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:35 devstack sudo[102021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-46755b28-7543-4bbb-9ad8-96fc817a56a2 Aug 10 16:05:35 devstack sudo[102021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:35 devstack sudo[102024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6db0b26-e83d-4b22-b5d3-acde60ac3b53 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6db0b26-e83d-4b22-b5d3-acde60ac3b53.5b027b08-94ba-407f-b3ad-8d8dc312a18c Aug 10 16:05:35 devstack sudo[102024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:35 devstack sudo[102021]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:35 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-29868f41-1955-4b3b-8395-736befdd655d tempest-VolumesGetTest-1343471577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-46755b28-7543-4bbb-9ad8-96fc817a56a2" returned: 0 in 0.370s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:35 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-29868f41-1955-4b3b-8395-736befdd655d tempest-VolumesGetTest-1343471577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-46755b28-7543-4bbb-9ad8-96fc817a56a2 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:35 devstack sudo[102032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-46755b28-7543-4bbb-9ad8-96fc817a56a2 Aug 10 16:05:35 devstack sudo[102032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:35 devstack sudo[102024]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:35 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-261ef4eb-def6-49f5-aa92-d8c8fda5dd64 tempest-GroupsV314Test-458715218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6db0b26-e83d-4b22-b5d3-acde60ac3b53 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6db0b26-e83d-4b22-b5d3-acde60ac3b53.5b027b08-94ba-407f-b3ad-8d8dc312a18c" returned: 0 in 0.298s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:35 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-261ef4eb-def6-49f5-aa92-d8c8fda5dd64 tempest-GroupsV314Test-458715218 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6db0b26-e83d-4b22-b5d3-acde60ac3b53.5b027b08-94ba-407f-b3ad-8d8dc312a18c is being set with open permissions: ugo+rw: NotImplementedError Aug 10 16:05:35 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-261ef4eb-def6-49f5-aa92-d8c8fda5dd64 tempest-GroupsV314Test-458715218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6db0b26-e83d-4b22-b5d3-acde60ac3b53.5b027b08-94ba-407f-b3ad-8d8dc312a18c {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:35 devstack sudo[102034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6db0b26-e83d-4b22-b5d3-acde60ac3b53.5b027b08-94ba-407f-b3ad-8d8dc312a18c Aug 10 16:05:35 devstack sudo[102034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:35 devstack sudo[102032]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:35 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-29868f41-1955-4b3b-8395-736befdd655d tempest-VolumesGetTest-1343471577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-46755b28-7543-4bbb-9ad8-96fc817a56a2" returned: 0 in 0.293s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:35 devstack sudo[102034]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:35 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-261ef4eb-def6-49f5-aa92-d8c8fda5dd64 tempest-GroupsV314Test-458715218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6db0b26-e83d-4b22-b5d3-acde60ac3b53.5b027b08-94ba-407f-b3ad-8d8dc312a18c" returned: 0 in 0.274s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:35 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-29868f41-1955-4b3b-8395-736befdd655d tempest-VolumesGetTest-1343471577 None] Lock "cinder-quobyte-46755b28-7543-4bbb-9ad8-96fc817a56a2" released by "delete_volume" :: held 0.725s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:05:35 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-261ef4eb-def6-49f5-aa92-d8c8fda5dd64 tempest-GroupsV314Test-458715218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6db0b26-e83d-4b22-b5d3-acde60ac3b53.info {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:35 devstack sudo[102038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6db0b26-e83d-4b22-b5d3-acde60ac3b53.info Aug 10 16:05:35 devstack sudo[102038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:35 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-29868f41-1955-4b3b-8395-736befdd655d tempest-VolumesGetTest-1343471577 None] Created reservations ['30d40210-f797-4eff-8fb2-870c0f226644', 'ce9dfcd8-1b9c-4608-b311-3b4ac8ebaea1', '8b85ab1f-55c6-4641-9051-ea6ef73db9c7', '3fb786a1-1057-419a-b1dc-c45788d70146'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:05:35 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-29868f41-1955-4b3b-8395-736befdd655d tempest-VolumesGetTest-1343471577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:05:35 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-29868f41-1955-4b3b-8395-736befdd655d tempest-VolumesGetTest-1343471577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:05:35 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-29868f41-1955-4b3b-8395-736befdd655d tempest-VolumesGetTest-1343471577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:05:35 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-29868f41-1955-4b3b-8395-736befdd655d tempest-VolumesGetTest-1343471577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:05:35 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-29868f41-1955-4b3b-8395-736befdd655d tempest-VolumesGetTest-1343471577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:05:35 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-29868f41-1955-4b3b-8395-736befdd655d tempest-VolumesGetTest-1343471577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:35 devstack sudo[102040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:05:35 devstack sudo[102040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:35 devstack sudo[102038]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:35 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-261ef4eb-def6-49f5-aa92-d8c8fda5dd64 tempest-GroupsV314Test-458715218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6db0b26-e83d-4b22-b5d3-acde60ac3b53.info" returned: 0 in 0.291s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:35 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-261ef4eb-def6-49f5-aa92-d8c8fda5dd64 tempest-GroupsV314Test-458715218 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6db0b26-e83d-4b22-b5d3-acde60ac3b53.info is being set with open permissions: ugo+rw: NotImplementedError Aug 10 16:05:35 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-261ef4eb-def6-49f5-aa92-d8c8fda5dd64 tempest-GroupsV314Test-458715218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6db0b26-e83d-4b22-b5d3-acde60ac3b53.info {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:36 devstack sudo[102043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6db0b26-e83d-4b22-b5d3-acde60ac3b53.info Aug 10 16:05:36 devstack sudo[102043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:36 devstack sudo[102040]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-29868f41-1955-4b3b-8395-736befdd655d tempest-VolumesGetTest-1343471577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.284s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:36 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-29868f41-1955-4b3b-8395-736befdd655d tempest-VolumesGetTest-1343471577 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:05:36 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-29868f41-1955-4b3b-8395-736befdd655d tempest-VolumesGetTest-1343471577 None] Deleted volume successfully. Aug 10 16:05:36 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-29868f41-1955-4b3b-8395-736befdd655d tempest-VolumesGetTest-1343471577 None] Lock "cinder-46755b28-7543-4bbb-9ad8-96fc817a56a2-delete_volume" released by "delete_volume" :: held 1.296s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:05:36 devstack sudo[102043]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-261ef4eb-def6-49f5-aa92-d8c8fda5dd64 tempest-GroupsV314Test-458715218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6db0b26-e83d-4b22-b5d3-acde60ac3b53.info" returned: 0 in 0.290s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:36 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-261ef4eb-def6-49f5-aa92-d8c8fda5dd64 tempest-GroupsV314Test-458715218 None] Acquiring lock "cinder-quobyte-da73100a-6e28-454e-8073-a8ae837493e2" by "_copy_volume_from_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:05:36 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-261ef4eb-def6-49f5-aa92-d8c8fda5dd64 tempest-GroupsV314Test-458715218 None] Lock "cinder-quobyte-da73100a-6e28-454e-8073-a8ae837493e2" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:05:36 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-261ef4eb-def6-49f5-aa92-d8c8fda5dd64 tempest-GroupsV314Test-458715218 None] snapshot: 5b027b08-94ba-407f-b3ad-8d8dc312a18c, volume: da73100a-6e28-454e-8073-a8ae837493e2, {{(pid=88641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 10 16:05:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-261ef4eb-def6-49f5-aa92-d8c8fda5dd64 tempest-GroupsV314Test-458715218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:05:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-261ef4eb-def6-49f5-aa92-d8c8fda5dd64 tempest-GroupsV314Test-458715218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:05:36 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-261ef4eb-def6-49f5-aa92-d8c8fda5dd64 tempest-GroupsV314Test-458715218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:05:36 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-261ef4eb-def6-49f5-aa92-d8c8fda5dd64 tempest-GroupsV314Test-458715218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:05:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-261ef4eb-def6-49f5-aa92-d8c8fda5dd64 tempest-GroupsV314Test-458715218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:05:36 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e068bb-cc0f-48bb-b54c-c5442d85b987]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:05:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-261ef4eb-def6-49f5-aa92-d8c8fda5dd64 tempest-GroupsV314Test-458715218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6db0b26-e83d-4b22-b5d3-acde60ac3b53.5b027b08-94ba-407f-b3ad-8d8dc312a18c {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:36 devstack cinder-volume[88641]: DEBUG oslo_service.periodic_task [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88641) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 16:05:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:05:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:05:36 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:05:36 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:05:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:05:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:36 devstack sudo[102047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6db0b26-e83d-4b22-b5d3-acde60ac3b53.5b027b08-94ba-407f-b3ad-8d8dc312a18c Aug 10 16:05:36 devstack sudo[102047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:36 devstack sudo[102048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:05:36 devstack sudo[102048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:36 devstack sudo[102048]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.347s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:36 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:05:36 devstack cinder-volume[88641]: DEBUG oslo_service.periodic_task [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Running periodic task VolumeManager._thread_info {{(pid=88641) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 16:05:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] thread count: 28 {{(pid=88641) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 10 16:05:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] thread info: [<_MainThread(MainThread, started 127361545748608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88641) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 10 16:05:36 devstack sudo[102047]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-261ef4eb-def6-49f5-aa92-d8c8fda5dd64 tempest-GroupsV314Test-458715218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6db0b26-e83d-4b22-b5d3-acde60ac3b53.5b027b08-94ba-407f-b3ad-8d8dc312a18c" returned: 0 in 0.501s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:36 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-261ef4eb-def6-49f5-aa92-d8c8fda5dd64 tempest-GroupsV314Test-458715218 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6db0b26-e83d-4b22-b5d3-acde60ac3b53(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 16:05:36 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[45672d3b-963e-438e-a6d4-41252d271395]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:05:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-261ef4eb-def6-49f5-aa92-d8c8fda5dd64 tempest-GroupsV314Test-458715218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6db0b26-e83d-4b22-b5d3-acde60ac3b53 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:37 devstack sudo[102055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6db0b26-e83d-4b22-b5d3-acde60ac3b53 Aug 10 16:05:37 devstack sudo[102055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:37 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-a299f4f2-9fa0-4144-abd1-f499be87cebe tempest-VolumesGetTest-1343471577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:05:37 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-a299f4f2-9fa0-4144-abd1-f499be87cebe tempest-VolumesGetTest-1343471577 None] Flow 'volume_create_manager' (4dce6255-dfe0-40c4-8710-3d767d6f168e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:05:37 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-a299f4f2-9fa0-4144-abd1-f499be87cebe tempest-VolumesGetTest-1343471577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (782b2f33-56cb-4972-9c23-cbe02628157f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:05:37 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-a299f4f2-9fa0-4144-abd1-f499be87cebe tempest-VolumesGetTest-1343471577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (782b2f33-56cb-4972-9c23-cbe02628157f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:05:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1493936278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39df3d42-2ec7-41c0-b009-3099a3cbaac6,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8e7031fd1bb44cf0a04e7115662ddae4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:05:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:05:37Z,use_quota=True,user_id='7f39fba2cc494ee4ae204aeae406bec5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:05:37 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-a299f4f2-9fa0-4144-abd1-f499be87cebe tempest-VolumesGetTest-1343471577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f85e47d5-f62d-4837-be91-9b11f34ab32b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:05:37 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-a299f4f2-9fa0-4144-abd1-f499be87cebe tempest-VolumesGetTest-1343471577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f85e47d5-f62d-4837-be91-9b11f34ab32b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:05:37 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-a299f4f2-9fa0-4144-abd1-f499be87cebe tempest-VolumesGetTest-1343471577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (043dc03a-7b25-475a-949c-b514be448b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:05:37 devstack cinder-volume[88641]: DEBUG cinder.image.glance [None req-a299f4f2-9fa0-4144-abd1-f499be87cebe tempest-VolumesGetTest-1343471577 None] Creating Keystone auth plugin from conf {{(pid=88641) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 10 16:05:37 devstack sudo[102055]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-261ef4eb-def6-49f5-aa92-d8c8fda5dd64 tempest-GroupsV314Test-458715218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6db0b26-e83d-4b22-b5d3-acde60ac3b53" returned: 0 in 0.435s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:37 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-261ef4eb-def6-49f5-aa92-d8c8fda5dd64 tempest-GroupsV314Test-458715218 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6db0b26-e83d-4b22-b5d3-acde60ac3b53 {{(pid=88641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 10 16:05:37 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-261ef4eb-def6-49f5-aa92-d8c8fda5dd64 tempest-GroupsV314Test-458715218 None] Creating direct copy from snapshot {{(pid=88641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 10 16:05:37 devstack cinder-volume[88641]: DEBUG cinder.utils [None req-261ef4eb-def6-49f5-aa92-d8c8fda5dd64 tempest-GroupsV314Test-458715218 None] Path /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-da73100a-6e28-454e-8073-a8ae837493e2 not found in is_blk_device check {{(pid=88641) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 10 16:05:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-261ef4eb-def6-49f5-aa92-d8c8fda5dd64 tempest-GroupsV314Test-458715218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6db0b26-e83d-4b22-b5d3-acde60ac3b53 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-da73100a-6e28-454e-8073-a8ae837493e2 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:37 devstack sudo[102060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6db0b26-e83d-4b22-b5d3-acde60ac3b53 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-da73100a-6e28-454e-8073-a8ae837493e2 Aug 10 16:05:37 devstack sudo[102060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:37 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-a299f4f2-9fa0-4144-abd1-f499be87cebe tempest-VolumesGetTest-1343471577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (043dc03a-7b25-475a-949c-b514be448b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '39df3d42-2ec7-41c0-b009-3099a3cbaac6', 'volume_name': 'volume-39df3d42-2ec7-41c0-b009-3099a3cbaac6', 'volume_size': 1, 'image_id': '94d8702e-9652-4319-94ff-fc0294ea1b4b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/94d8702e-9652-4319-94ff-fc0294ea1b4b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9e18d747214f4822be3dc7f3bd0a3775', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '94d8702e-9652-4319-94ff-fc0294ea1b4b', 'created_at': datetime.datetime(2026, 8, 10, 13, 48, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 10, 13, 48, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/94d8702e-9652-4319-94ff-fc0294ea1b4b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:05:37 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-a299f4f2-9fa0-4144-abd1-f499be87cebe tempest-VolumesGetTest-1343471577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (751d9ceb-5c91-43a9-93e2-4402d19122ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:05:37 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-a299f4f2-9fa0-4144-abd1-f499be87cebe tempest-VolumesGetTest-1343471577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (751d9ceb-5c91-43a9-93e2-4402d19122ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:05:37 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-a299f4f2-9fa0-4144-abd1-f499be87cebe tempest-VolumesGetTest-1343471577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46c8bf3f-ea2c-406e-9c33-2db7bccbe308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:05:37 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-a299f4f2-9fa0-4144-abd1-f499be87cebe tempest-VolumesGetTest-1343471577 None] Volume 39df3d42-2ec7-41c0-b009-3099a3cbaac6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-39df3d42-2ec7-41c0-b009-3099a3cbaac6', 'volume_size': 1, 'image_id': '94d8702e-9652-4319-94ff-fc0294ea1b4b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/94d8702e-9652-4319-94ff-fc0294ea1b4b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9e18d747214f4822be3dc7f3bd0a3775', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '94d8702e-9652-4319-94ff-fc0294ea1b4b', 'created_at': datetime.datetime(2026, 8, 10, 13, 48, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 10, 13, 48, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/94d8702e-9652-4319-94ff-fc0294ea1b4b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 10 16:05:37 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-a299f4f2-9fa0-4144-abd1-f499be87cebe tempest-VolumesGetTest-1343471577 None] Trying to clone 39df3d42-2ec7-41c0-b009-3099a3cbaac6 from image 94d8702e-9652-4319-94ff-fc0294ea1b4b at location (None, [{'url': 'file:///opt/stack/data/glance/images/94d8702e-9652-4319-94ff-fc0294ea1b4b', 'metadata': {}}]). {{(pid=88641) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 10 16:05:37 devstack cinder-volume[88641]: DEBUG cinder.image.image_utils [None req-a299f4f2-9fa0-4144-abd1-f499be87cebe tempest-VolumesGetTest-1343471577 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_94d8702e-9652-4319-94ff-fc0294ea1b4b_r6b2s9v4devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88641) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 10 16:05:37 devstack cinder-volume[88641]: INFO cinder.image.image_utils [None req-a299f4f2-9fa0-4144-abd1-f499be87cebe tempest-VolumesGetTest-1343471577 None] Image download 20.69 MB at 20.69 MB/s Aug 10 16:05:38 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[26261f80-bcca-476d-b31c-36770160425c]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:05:38 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a299f4f2-9fa0-4144-abd1-f499be87cebe tempest-VolumesGetTest-1343471577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94d8702e-9652-4319-94ff-fc0294ea1b4b_r6b2s9v4devstack@QuobyteHD {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:38 devstack sudo[102073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94d8702e-9652-4319-94ff-fc0294ea1b4b_r6b2s9v4devstack@QuobyteHD Aug 10 16:05:38 devstack sudo[102073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:38 devstack sudo[102073]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:38 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a299f4f2-9fa0-4144-abd1-f499be87cebe tempest-VolumesGetTest-1343471577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94d8702e-9652-4319-94ff-fc0294ea1b4b_r6b2s9v4devstack@QuobyteHD" returned: 0 in 0.534s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:38 devstack cinder-volume[88641]: DEBUG cinder.image.image_utils [None req-a299f4f2-9fa0-4144-abd1-f499be87cebe tempest-VolumesGetTest-1343471577 None] Temporary image 94d8702e-9652-4319-94ff-fc0294ea1b4b is fetched for user 7f39fba2cc494ee4ae204aeae406bec5. {{(pid=88641) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 10 16:05:38 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e4c2d8f-f32b-4f93-953a-c9abd6b4b794]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:05:38 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a299f4f2-9fa0-4144-abd1-f499be87cebe tempest-VolumesGetTest-1343471577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94d8702e-9652-4319-94ff-fc0294ea1b4b_r6b2s9v4devstack@QuobyteHD {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:39 devstack sudo[102078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94d8702e-9652-4319-94ff-fc0294ea1b4b_r6b2s9v4devstack@QuobyteHD Aug 10 16:05:39 devstack sudo[102078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:39 devstack sudo[102078]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:39 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a299f4f2-9fa0-4144-abd1-f499be87cebe tempest-VolumesGetTest-1343471577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94d8702e-9652-4319-94ff-fc0294ea1b4b_r6b2s9v4devstack@QuobyteHD" returned: 0 in 0.685s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:39 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-a299f4f2-9fa0-4144-abd1-f499be87cebe tempest-VolumesGetTest-1343471577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:05:41 devstack sudo[102060]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:41 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-261ef4eb-def6-49f5-aa92-d8c8fda5dd64 tempest-GroupsV314Test-458715218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6db0b26-e83d-4b22-b5d3-acde60ac3b53 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-da73100a-6e28-454e-8073-a8ae837493e2" returned: 0 in 4.504s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:41 devstack cinder-volume[88641]: DEBUG cinder.image.image_utils [None req-261ef4eb-def6-49f5-aa92-d8c8fda5dd64 tempest-GroupsV314Test-458715218 None] Image conversion details: src /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6db0b26-e83d-4b22-b5d3-acde60ac3b53, size 1024.00 MB, duration 4.51 sec, destination /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-da73100a-6e28-454e-8073-a8ae837493e2 {{(pid=88641) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 10 16:05:41 devstack cinder-volume[88641]: INFO cinder.image.image_utils [None req-261ef4eb-def6-49f5-aa92-d8c8fda5dd64 tempest-GroupsV314Test-458715218 None] Converted 1024.00 MB image at 227.29 MB/s Aug 10 16:05:41 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-261ef4eb-def6-49f5-aa92-d8c8fda5dd64 tempest-GroupsV314Test-458715218 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-da73100a-6e28-454e-8073-a8ae837493e2 is being set with open permissions: ugo+rw: NotImplementedError Aug 10 16:05:41 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-261ef4eb-def6-49f5-aa92-d8c8fda5dd64 tempest-GroupsV314Test-458715218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-da73100a-6e28-454e-8073-a8ae837493e2 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:41 devstack sudo[102086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-da73100a-6e28-454e-8073-a8ae837493e2 Aug 10 16:05:41 devstack sudo[102086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:42 devstack sudo[102086]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:42 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-261ef4eb-def6-49f5-aa92-d8c8fda5dd64 tempest-GroupsV314Test-458715218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-da73100a-6e28-454e-8073-a8ae837493e2" returned: 0 in 0.237s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:42 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-261ef4eb-def6-49f5-aa92-d8c8fda5dd64 tempest-GroupsV314Test-458715218 None] Lock "cinder-quobyte-da73100a-6e28-454e-8073-a8ae837493e2" released by "_copy_volume_from_snapshot" :: held 5.761s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:05:42 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-261ef4eb-def6-49f5-aa92-d8c8fda5dd64 tempest-GroupsV314Test-458715218 None] Acquiring lock "cinder-quobyte-5b027b08-94ba-407f-b3ad-8d8dc312a18c" by "_delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:05:42 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-261ef4eb-def6-49f5-aa92-d8c8fda5dd64 tempest-GroupsV314Test-458715218 None] Lock "cinder-quobyte-5b027b08-94ba-407f-b3ad-8d8dc312a18c" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:05:42 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-261ef4eb-def6-49f5-aa92-d8c8fda5dd64 tempest-GroupsV314Test-458715218 None] Deleting offline snapshot 5b027b08-94ba-407f-b3ad-8d8dc312a18c of volume b6db0b26-e83d-4b22-b5d3-acde60ac3b53 {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 16:05:42 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-261ef4eb-def6-49f5-aa92-d8c8fda5dd64 tempest-GroupsV314Test-458715218 None] snapshot_file for this snap is: volume-b6db0b26-e83d-4b22-b5d3-acde60ac3b53.5b027b08-94ba-407f-b3ad-8d8dc312a18c {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 16:05:42 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c03a8f-e287-4a61-a975-2c562cdbd6ab]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:05:42 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-261ef4eb-def6-49f5-aa92-d8c8fda5dd64 tempest-GroupsV314Test-458715218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6db0b26-e83d-4b22-b5d3-acde60ac3b53.5b027b08-94ba-407f-b3ad-8d8dc312a18c {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:42 devstack sudo[102090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6db0b26-e83d-4b22-b5d3-acde60ac3b53.5b027b08-94ba-407f-b3ad-8d8dc312a18c Aug 10 16:05:42 devstack sudo[102090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:42 devstack sudo[102090]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:42 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-261ef4eb-def6-49f5-aa92-d8c8fda5dd64 tempest-GroupsV314Test-458715218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6db0b26-e83d-4b22-b5d3-acde60ac3b53.5b027b08-94ba-407f-b3ad-8d8dc312a18c" returned: 0 in 0.351s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:42 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-261ef4eb-def6-49f5-aa92-d8c8fda5dd64 tempest-GroupsV314Test-458715218 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6db0b26-e83d-4b22-b5d3-acde60ac3b53(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 16:05:42 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4818296-f27a-441a-8781-345c4a36dd80]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:05:42 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-261ef4eb-def6-49f5-aa92-d8c8fda5dd64 tempest-GroupsV314Test-458715218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6db0b26-e83d-4b22-b5d3-acde60ac3b53 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:42 devstack sudo[102095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6db0b26-e83d-4b22-b5d3-acde60ac3b53 Aug 10 16:05:42 devstack sudo[102095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:43 devstack sudo[102095]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:43 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-261ef4eb-def6-49f5-aa92-d8c8fda5dd64 tempest-GroupsV314Test-458715218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6db0b26-e83d-4b22-b5d3-acde60ac3b53" returned: 0 in 0.546s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:43 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-261ef4eb-def6-49f5-aa92-d8c8fda5dd64 tempest-GroupsV314Test-458715218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6db0b26-e83d-4b22-b5d3-acde60ac3b53.5b027b08-94ba-407f-b3ad-8d8dc312a18c {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:43 devstack sudo[102100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6db0b26-e83d-4b22-b5d3-acde60ac3b53.5b027b08-94ba-407f-b3ad-8d8dc312a18c Aug 10 16:05:43 devstack sudo[102100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:43 devstack sudo[102100]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:43 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-261ef4eb-def6-49f5-aa92-d8c8fda5dd64 tempest-GroupsV314Test-458715218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6db0b26-e83d-4b22-b5d3-acde60ac3b53.5b027b08-94ba-407f-b3ad-8d8dc312a18c" returned: 0 in 0.331s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:43 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-261ef4eb-def6-49f5-aa92-d8c8fda5dd64 tempest-GroupsV314Test-458715218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6db0b26-e83d-4b22-b5d3-acde60ac3b53.5b027b08-94ba-407f-b3ad-8d8dc312a18c {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:43 devstack sudo[102105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6db0b26-e83d-4b22-b5d3-acde60ac3b53.5b027b08-94ba-407f-b3ad-8d8dc312a18c Aug 10 16:05:43 devstack sudo[102105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:43 devstack sudo[102105]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:43 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-261ef4eb-def6-49f5-aa92-d8c8fda5dd64 tempest-GroupsV314Test-458715218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6db0b26-e83d-4b22-b5d3-acde60ac3b53.5b027b08-94ba-407f-b3ad-8d8dc312a18c" returned: 0 in 0.240s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:43 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-261ef4eb-def6-49f5-aa92-d8c8fda5dd64 tempest-GroupsV314Test-458715218 None] Lock "cinder-quobyte-5b027b08-94ba-407f-b3ad-8d8dc312a18c" released by "_delete_snapshot" :: held 1.567s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:05:43 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-261ef4eb-def6-49f5-aa92-d8c8fda5dd64 tempest-GroupsV314Test-458715218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.539s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:05:43 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-a299f4f2-9fa0-4144-abd1-f499be87cebe tempest-VolumesGetTest-1343471577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.165s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:05:43 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-a299f4f2-9fa0-4144-abd1-f499be87cebe tempest-VolumesGetTest-1343471577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:05:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1493936278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39df3d42-2ec7-41c0-b009-3099a3cbaac6,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8e7031fd1bb44cf0a04e7115662ddae4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:05:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:05:37Z,use_quota=True,user_id='7f39fba2cc494ee4ae204aeae406bec5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:05:43 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-a299f4f2-9fa0-4144-abd1-f499be87cebe tempest-VolumesGetTest-1343471577 None] Creating volume 39df3d42-2ec7-41c0-b009-3099a3cbaac6 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:05:43 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-a299f4f2-9fa0-4144-abd1-f499be87cebe tempest-VolumesGetTest-1343471577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:05:43 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-a299f4f2-9fa0-4144-abd1-f499be87cebe tempest-VolumesGetTest-1343471577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:05:43 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-a299f4f2-9fa0-4144-abd1-f499be87cebe tempest-VolumesGetTest-1343471577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:05:43 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-a299f4f2-9fa0-4144-abd1-f499be87cebe tempest-VolumesGetTest-1343471577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:05:43 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-a299f4f2-9fa0-4144-abd1-f499be87cebe tempest-VolumesGetTest-1343471577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:05:43 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-a299f4f2-9fa0-4144-abd1-f499be87cebe tempest-VolumesGetTest-1343471577 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:05:43 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-a299f4f2-9fa0-4144-abd1-f499be87cebe tempest-VolumesGetTest-1343471577 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:05:43 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a299f4f2-9fa0-4144-abd1-f499be87cebe tempest-VolumesGetTest-1343471577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-39df3d42-2ec7-41c0-b009-3099a3cbaac6 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:43 devstack sudo[102108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-39df3d42-2ec7-41c0-b009-3099a3cbaac6 1073741824 Aug 10 16:05:43 devstack sudo[102108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:43 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-261ef4eb-def6-49f5-aa92-d8c8fda5dd64 tempest-GroupsV314Test-458715218 None] Create group from source-group-dbc510c3-f549-4da3-ac46-0d51b2df183f completed successfully. Aug 10 16:05:44 devstack sudo[102108]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:44 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a299f4f2-9fa0-4144-abd1-f499be87cebe tempest-VolumesGetTest-1343471577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-39df3d42-2ec7-41c0-b009-3099a3cbaac6 1073741824" returned: 0 in 0.422s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:44 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a299f4f2-9fa0-4144-abd1-f499be87cebe tempest-VolumesGetTest-1343471577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-39df3d42-2ec7-41c0-b009-3099a3cbaac6 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:44 devstack sudo[102113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-39df3d42-2ec7-41c0-b009-3099a3cbaac6 Aug 10 16:05:44 devstack sudo[102113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:44 devstack sudo[102113]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:44 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a299f4f2-9fa0-4144-abd1-f499be87cebe tempest-VolumesGetTest-1343471577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-39df3d42-2ec7-41c0-b009-3099a3cbaac6" returned: 0 in 0.251s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:44 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-a299f4f2-9fa0-4144-abd1-f499be87cebe tempest-VolumesGetTest-1343471577 None] <== create_volume: return (710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:05:44 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-a299f4f2-9fa0-4144-abd1-f499be87cebe tempest-VolumesGetTest-1343471577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.713s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:05:44 devstack cinder-volume[88641]: DEBUG cinder.volume.volume_utils [None req-a299f4f2-9fa0-4144-abd1-f499be87cebe tempest-VolumesGetTest-1343471577 None] Attempting download of 94d8702e-9652-4319-94ff-fc0294ea1b4b ((None, [{'url': 'file:///opt/stack/data/glance/images/94d8702e-9652-4319-94ff-fc0294ea1b4b', 'metadata': {}}])) to volume 39df3d42-2ec7-41c0-b009-3099a3cbaac6. {{(pid=88641) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 10 16:05:44 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddee7d7f-93b3-4bf1-8ae0-bf564e0f791f]: (4, 'raw') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:05:44 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a299f4f2-9fa0-4144-abd1-f499be87cebe tempest-VolumesGetTest-1343471577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_94d8702e-9652-4319-94ff-fc0294ea1b4b_0ncw0tf_ {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:44 devstack sudo[102116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_94d8702e-9652-4319-94ff-fc0294ea1b4b_0ncw0tf_ Aug 10 16:05:44 devstack sudo[102116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:44 devstack sudo[102116]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:44 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a299f4f2-9fa0-4144-abd1-f499be87cebe tempest-VolumesGetTest-1343471577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_94d8702e-9652-4319-94ff-fc0294ea1b4b_0ncw0tf_" returned: 0 in 0.341s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:44 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a299f4f2-9fa0-4144-abd1-f499be87cebe tempest-VolumesGetTest-1343471577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_94d8702e-9652-4319-94ff-fc0294ea1b4b_0ncw0tf_ {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:44 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-17312143-f487-4b73-9e1d-f066223d68dc tempest-GroupsV314Test-458715218 None] Acquiring lock "cinder-quobyte-da73100a-6e28-454e-8073-a8ae837493e2" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:05:44 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-17312143-f487-4b73-9e1d-f066223d68dc tempest-GroupsV314Test-458715218 None] Lock "cinder-quobyte-da73100a-6e28-454e-8073-a8ae837493e2" acquired by "delete_volume" :: waited 0.018s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:05:44 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b470e3-d5a4-40e9-8731-1cb00ada26a1]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:05:44 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-17312143-f487-4b73-9e1d-f066223d68dc tempest-GroupsV314Test-458715218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-da73100a-6e28-454e-8073-a8ae837493e2 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:44 devstack sudo[102120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_94d8702e-9652-4319-94ff-fc0294ea1b4b_0ncw0tf_ Aug 10 16:05:44 devstack sudo[102120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:45 devstack sudo[102121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-da73100a-6e28-454e-8073-a8ae837493e2 Aug 10 16:05:45 devstack sudo[102121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:45 devstack sudo[102120]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:45 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a299f4f2-9fa0-4144-abd1-f499be87cebe tempest-VolumesGetTest-1343471577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_94d8702e-9652-4319-94ff-fc0294ea1b4b_0ncw0tf_" returned: 1 in 0.340s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:45 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a299f4f2-9fa0-4144-abd1-f499be87cebe tempest-VolumesGetTest-1343471577 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_94d8702e-9652-4319-94ff-fc0294ea1b4b_0ncw0tf_' failed. Not Retrying. {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 10 16:05:45 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[f08851b3-6a57-463f-bd69-5859af2785b2]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:05:45 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a299f4f2-9fa0-4144-abd1-f499be87cebe tempest-VolumesGetTest-1343471577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94d8702e-9652-4319-94ff-fc0294ea1b4b_r6b2s9v4devstack@QuobyteHD {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:45 devstack sudo[102121]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:45 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-17312143-f487-4b73-9e1d-f066223d68dc tempest-GroupsV314Test-458715218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-da73100a-6e28-454e-8073-a8ae837493e2" returned: 0 in 0.360s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:45 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-17312143-f487-4b73-9e1d-f066223d68dc tempest-GroupsV314Test-458715218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-da73100a-6e28-454e-8073-a8ae837493e2 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:45 devstack sudo[102126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94d8702e-9652-4319-94ff-fc0294ea1b4b_r6b2s9v4devstack@QuobyteHD Aug 10 16:05:45 devstack sudo[102126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:45 devstack sudo[102130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-da73100a-6e28-454e-8073-a8ae837493e2 Aug 10 16:05:45 devstack sudo[102130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:45 devstack sudo[102126]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:45 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a299f4f2-9fa0-4144-abd1-f499be87cebe tempest-VolumesGetTest-1343471577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94d8702e-9652-4319-94ff-fc0294ea1b4b_r6b2s9v4devstack@QuobyteHD" returned: 0 in 0.333s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:45 devstack cinder-volume[88641]: DEBUG cinder.image.image_utils [None req-a299f4f2-9fa0-4144-abd1-f499be87cebe tempest-VolumesGetTest-1343471577 None] 94d8702e-9652-4319-94ff-fc0294ea1b4b was qcow2, converting to qcow2 {{(pid=88641) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 10 16:05:45 devstack sudo[102130]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:45 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a299f4f2-9fa0-4144-abd1-f499be87cebe tempest-VolumesGetTest-1343471577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_94d8702e-9652-4319-94ff-fc0294ea1b4b_r6b2s9v4devstack@QuobyteHD /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-39df3d42-2ec7-41c0-b009-3099a3cbaac6 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:45 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-17312143-f487-4b73-9e1d-f066223d68dc tempest-GroupsV314Test-458715218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-da73100a-6e28-454e-8073-a8ae837493e2" returned: 0 in 0.254s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:45 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-17312143-f487-4b73-9e1d-f066223d68dc tempest-GroupsV314Test-458715218 None] Lock "cinder-quobyte-da73100a-6e28-454e-8073-a8ae837493e2" released by "delete_volume" :: held 0.659s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:05:45 devstack sudo[102137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_94d8702e-9652-4319-94ff-fc0294ea1b4b_r6b2s9v4devstack@QuobyteHD /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-39df3d42-2ec7-41c0-b009-3099a3cbaac6 Aug 10 16:05:45 devstack sudo[102137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:45 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-17312143-f487-4b73-9e1d-f066223d68dc tempest-GroupsV314Test-458715218 None] Created reservations ['920fa35d-c7f8-47f4-aac9-55567478a18d'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:05:45 devstack cinder-volume[88641]: WARNING cinder.quota [None req-17312143-f487-4b73-9e1d-f066223d68dc tempest-GroupsV314Test-458715218 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1696439829 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1696439829, it is now deprecated. Please use the default quota class for default quota. Aug 10 16:05:45 devstack cinder-volume[88641]: WARNING cinder.quota [None req-17312143-f487-4b73-9e1d-f066223d68dc tempest-GroupsV314Test-458715218 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1696439829 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1696439829, it is now deprecated. Please use the default quota class for default quota. Aug 10 16:05:45 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-17312143-f487-4b73-9e1d-f066223d68dc tempest-GroupsV314Test-458715218 None] Created reservations ['d4ac8414-5d75-485e-b97f-56ee8a40d111', '01a36851-a7d8-48fd-b26e-345cb53e6f82', 'bdb304e0-e7af-45bc-869b-cfedce7957f8', 'd82efb04-b689-4d29-b54f-8747644c02b5'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:05:45 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-17312143-f487-4b73-9e1d-f066223d68dc tempest-GroupsV314Test-458715218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:05:45 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-17312143-f487-4b73-9e1d-f066223d68dc tempest-GroupsV314Test-458715218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:05:45 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-17312143-f487-4b73-9e1d-f066223d68dc tempest-GroupsV314Test-458715218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:05:45 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-17312143-f487-4b73-9e1d-f066223d68dc tempest-GroupsV314Test-458715218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:05:45 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-17312143-f487-4b73-9e1d-f066223d68dc tempest-GroupsV314Test-458715218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:05:45 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-17312143-f487-4b73-9e1d-f066223d68dc tempest-GroupsV314Test-458715218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:45 devstack sudo[102142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:05:45 devstack sudo[102142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:46 devstack sudo[102142]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:46 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-17312143-f487-4b73-9e1d-f066223d68dc tempest-GroupsV314Test-458715218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.257s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:46 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-17312143-f487-4b73-9e1d-f066223d68dc tempest-GroupsV314Test-458715218 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:05:46 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-17312143-f487-4b73-9e1d-f066223d68dc tempest-GroupsV314Test-458715218 None] Delete group completed successfully. Aug 10 16:05:46 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-e53b105e-fc43-4ce7-b872-5032cf11c891 tempest-GroupsV314Test-458715218 None] Acquiring lock "cinder-quobyte-b6db0b26-e83d-4b22-b5d3-acde60ac3b53" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:05:46 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-e53b105e-fc43-4ce7-b872-5032cf11c891 tempest-GroupsV314Test-458715218 None] Lock "cinder-quobyte-b6db0b26-e83d-4b22-b5d3-acde60ac3b53" acquired by "delete_volume" :: waited 0.021s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:05:46 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7310e46-6c2c-4dc4-becf-8e1bed23111f]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:05:46 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e53b105e-fc43-4ce7-b872-5032cf11c891 tempest-GroupsV314Test-458715218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6db0b26-e83d-4b22-b5d3-acde60ac3b53 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:46 devstack sudo[102149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6db0b26-e83d-4b22-b5d3-acde60ac3b53 Aug 10 16:05:46 devstack sudo[102149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:46 devstack sudo[102149]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:46 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e53b105e-fc43-4ce7-b872-5032cf11c891 tempest-GroupsV314Test-458715218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6db0b26-e83d-4b22-b5d3-acde60ac3b53" returned: 0 in 0.423s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:46 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e53b105e-fc43-4ce7-b872-5032cf11c891 tempest-GroupsV314Test-458715218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6db0b26-e83d-4b22-b5d3-acde60ac3b53 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:46 devstack sudo[102154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6db0b26-e83d-4b22-b5d3-acde60ac3b53 Aug 10 16:05:46 devstack sudo[102154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:47 devstack sudo[102154]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:47 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e53b105e-fc43-4ce7-b872-5032cf11c891 tempest-GroupsV314Test-458715218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6db0b26-e83d-4b22-b5d3-acde60ac3b53" returned: 0 in 0.289s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:47 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-e53b105e-fc43-4ce7-b872-5032cf11c891 tempest-GroupsV314Test-458715218 None] Lock "cinder-quobyte-b6db0b26-e83d-4b22-b5d3-acde60ac3b53" released by "delete_volume" :: held 0.808s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:05:47 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-e53b105e-fc43-4ce7-b872-5032cf11c891 tempest-GroupsV314Test-458715218 None] Created reservations ['815edbc1-2aec-4260-a0b2-90667ed41108'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:05:47 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-e53b105e-fc43-4ce7-b872-5032cf11c891 tempest-GroupsV314Test-458715218 None] Created reservations ['8dd6e901-9ba7-4ddb-9b00-4946a423aad5', '1546d0f7-641b-4144-a7db-2e52456265af', '3296f8c2-36a3-4a22-b610-036e3f158ca9', '27165cff-9fdb-4731-8ed4-59b8d27d8f6d'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:05:47 devstack sudo[102137]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:47 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a299f4f2-9fa0-4144-abd1-f499be87cebe tempest-VolumesGetTest-1343471577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_94d8702e-9652-4319-94ff-fc0294ea1b4b_r6b2s9v4devstack@QuobyteHD /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-39df3d42-2ec7-41c0-b009-3099a3cbaac6" returned: 0 in 1.795s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:47 devstack cinder-volume[88641]: DEBUG cinder.image.image_utils [None req-a299f4f2-9fa0-4144-abd1-f499be87cebe tempest-VolumesGetTest-1343471577 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_94d8702e-9652-4319-94ff-fc0294ea1b4b_r6b2s9v4devstack@QuobyteHD, size 112.00 MB, duration 1.80 sec, destination /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-39df3d42-2ec7-41c0-b009-3099a3cbaac6 {{(pid=88641) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 10 16:05:47 devstack cinder-volume[88641]: INFO cinder.image.image_utils [None req-a299f4f2-9fa0-4144-abd1-f499be87cebe tempest-VolumesGetTest-1343471577 None] Converted 112.00 MB image at 62.37 MB/s Aug 10 16:05:47 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a299f4f2-9fa0-4144-abd1-f499be87cebe tempest-VolumesGetTest-1343471577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-39df3d42-2ec7-41c0-b009-3099a3cbaac6 1G {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:47 devstack sudo[102157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-39df3d42-2ec7-41c0-b009-3099a3cbaac6 1G Aug 10 16:05:47 devstack sudo[102157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:47 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-e53b105e-fc43-4ce7-b872-5032cf11c891 tempest-GroupsV314Test-458715218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:05:47 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-e53b105e-fc43-4ce7-b872-5032cf11c891 tempest-GroupsV314Test-458715218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:05:47 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-e53b105e-fc43-4ce7-b872-5032cf11c891 tempest-GroupsV314Test-458715218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:05:47 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-e53b105e-fc43-4ce7-b872-5032cf11c891 tempest-GroupsV314Test-458715218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:05:47 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-e53b105e-fc43-4ce7-b872-5032cf11c891 tempest-GroupsV314Test-458715218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:05:47 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e53b105e-fc43-4ce7-b872-5032cf11c891 tempest-GroupsV314Test-458715218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:47 devstack sudo[102159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:05:47 devstack sudo[102159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:47 devstack sudo[102157]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:47 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a299f4f2-9fa0-4144-abd1-f499be87cebe tempest-VolumesGetTest-1343471577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-39df3d42-2ec7-41c0-b009-3099a3cbaac6 1G" returned: 0 in 0.372s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:47 devstack cinder-volume[88641]: DEBUG cinder.volume.volume_utils [None req-a299f4f2-9fa0-4144-abd1-f499be87cebe tempest-VolumesGetTest-1343471577 None] Downloaded image 94d8702e-9652-4319-94ff-fc0294ea1b4b ((None, [{'url': 'file:///opt/stack/data/glance/images/94d8702e-9652-4319-94ff-fc0294ea1b4b', 'metadata': {}}])) to volume 39df3d42-2ec7-41c0-b009-3099a3cbaac6 successfully. {{(pid=88641) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 10 16:05:47 devstack sudo[102159]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:47 devstack cinder-volume[88641]: DEBUG cinder.image.image_utils [None req-a299f4f2-9fa0-4144-abd1-f499be87cebe tempest-VolumesGetTest-1343471577 None] Temporary image 94d8702e-9652-4319-94ff-fc0294ea1b4b for user 7f39fba2cc494ee4ae204aeae406bec5 is deleted. {{(pid=88641) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 10 16:05:47 devstack cinder-volume[88641]: DEBUG cinder.volume.volume_utils [None req-a299f4f2-9fa0-4144-abd1-f499be87cebe tempest-VolumesGetTest-1343471577 None] Marking volume 39df3d42-2ec7-41c0-b009-3099a3cbaac6 as bootable. {{(pid=88641) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 10 16:05:47 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e53b105e-fc43-4ce7-b872-5032cf11c891 tempest-GroupsV314Test-458715218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.303s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:47 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-e53b105e-fc43-4ce7-b872-5032cf11c891 tempest-GroupsV314Test-458715218 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:05:47 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-e53b105e-fc43-4ce7-b872-5032cf11c891 tempest-GroupsV314Test-458715218 None] Delete group completed successfully. Aug 10 16:05:47 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-a299f4f2-9fa0-4144-abd1-f499be87cebe tempest-VolumesGetTest-1343471577 None] Copying metadata from image 94d8702e-9652-4319-94ff-fc0294ea1b4b to 39df3d42-2ec7-41c0-b009-3099a3cbaac6. {{(pid=88641) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 10 16:05:47 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-a299f4f2-9fa0-4144-abd1-f499be87cebe tempest-VolumesGetTest-1343471577 None] Creating volume glance metadata for volume 39df3d42-2ec7-41c0-b009-3099a3cbaac6 backed by image 94d8702e-9652-4319-94ff-fc0294ea1b4b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '94d8702e-9652-4319-94ff-fc0294ea1b4b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88641) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 10 16:05:47 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-a299f4f2-9fa0-4144-abd1-f499be87cebe tempest-VolumesGetTest-1343471577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46c8bf3f-ea2c-406e-9c33-2db7bccbe308) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39df3d42-2ec7-41c0-b009-3099a3cbaac6', 'volume_size': 1, 'image_id': '94d8702e-9652-4319-94ff-fc0294ea1b4b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/94d8702e-9652-4319-94ff-fc0294ea1b4b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9e18d747214f4822be3dc7f3bd0a3775', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '94d8702e-9652-4319-94ff-fc0294ea1b4b', 'created_at': datetime.datetime(2026, 8, 10, 13, 48, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 10, 13, 48, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/94d8702e-9652-4319-94ff-fc0294ea1b4b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:05:47 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-a299f4f2-9fa0-4144-abd1-f499be87cebe tempest-VolumesGetTest-1343471577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd63e4b8-a042-45fd-b55c-890f469e6981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:05:47 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-a299f4f2-9fa0-4144-abd1-f499be87cebe tempest-VolumesGetTest-1343471577 None] Volume volume-39df3d42-2ec7-41c0-b009-3099a3cbaac6 (39df3d42-2ec7-41c0-b009-3099a3cbaac6): created successfully Aug 10 16:05:47 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-a299f4f2-9fa0-4144-abd1-f499be87cebe tempest-VolumesGetTest-1343471577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd63e4b8-a042-45fd-b55c-890f469e6981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:05:47 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-a299f4f2-9fa0-4144-abd1-f499be87cebe tempest-VolumesGetTest-1343471577 None] Flow 'volume_create_manager' (4dce6255-dfe0-40c4-8710-3d767d6f168e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:05:47 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-a299f4f2-9fa0-4144-abd1-f499be87cebe tempest-VolumesGetTest-1343471577 None] Created volume successfully. Aug 10 16:05:48 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-d033e857-47f5-4cae-b03f-e3af5b53e206 tempest-VolumesGetTest-1343471577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:05:48 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d033e857-47f5-4cae-b03f-e3af5b53e206 tempest-VolumesGetTest-1343471577 None] Flow 'volume_create_manager' (f1ec910b-ab2b-40e2-9612-d14e4da9cea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:05:48 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d033e857-47f5-4cae-b03f-e3af5b53e206 tempest-VolumesGetTest-1343471577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11d113c1-2e9b-4c30-a80b-d0f8b0317392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:05:48 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d033e857-47f5-4cae-b03f-e3af5b53e206 tempest-VolumesGetTest-1343471577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11d113c1-2e9b-4c30-a80b-d0f8b0317392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:05:48Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1699493982',display_name='tempest-VolumesGetTest-Volume-652729390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc5b370c-481e-4c8f-a27c-7b43282c4341,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e7031fd1bb44cf0a04e7115662ddae4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:05:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:05:49Z,use_quota=True,user_id='7f39fba2cc494ee4ae204aeae406bec5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:05:48 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d033e857-47f5-4cae-b03f-e3af5b53e206 tempest-VolumesGetTest-1343471577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1735680-02a1-4bbd-8dce-8e3d473808e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:05:48 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d033e857-47f5-4cae-b03f-e3af5b53e206 tempest-VolumesGetTest-1343471577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1735680-02a1-4bbd-8dce-8e3d473808e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:05:48 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d033e857-47f5-4cae-b03f-e3af5b53e206 tempest-VolumesGetTest-1343471577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f64c8ab-3385-42ab-9566-8b26a2e1218d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:05:48 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d033e857-47f5-4cae-b03f-e3af5b53e206 tempest-VolumesGetTest-1343471577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f64c8ab-3385-42ab-9566-8b26a2e1218d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc5b370c-481e-4c8f-a27c-7b43282c4341', 'volume_name': 'volume-bc5b370c-481e-4c8f-a27c-7b43282c4341', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:05:48 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d033e857-47f5-4cae-b03f-e3af5b53e206 tempest-VolumesGetTest-1343471577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c176da58-2047-4392-90d2-adef74457f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:05:48 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d033e857-47f5-4cae-b03f-e3af5b53e206 tempest-VolumesGetTest-1343471577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c176da58-2047-4392-90d2-adef74457f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:05:48 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d033e857-47f5-4cae-b03f-e3af5b53e206 tempest-VolumesGetTest-1343471577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d387d773-bdc0-44ca-8456-84fd9f90cb7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:05:48 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-d033e857-47f5-4cae-b03f-e3af5b53e206 tempest-VolumesGetTest-1343471577 None] Volume bc5b370c-481e-4c8f-a27c-7b43282c4341: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc5b370c-481e-4c8f-a27c-7b43282c4341', 'volume_size': 1} Aug 10 16:05:48 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-d033e857-47f5-4cae-b03f-e3af5b53e206 tempest-VolumesGetTest-1343471577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:05:48 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-d033e857-47f5-4cae-b03f-e3af5b53e206 tempest-VolumesGetTest-1343471577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:05:48 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-d033e857-47f5-4cae-b03f-e3af5b53e206 tempest-VolumesGetTest-1343471577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:05:48Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1699493982',display_name='tempest-VolumesGetTest-Volume-652729390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc5b370c-481e-4c8f-a27c-7b43282c4341,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e7031fd1bb44cf0a04e7115662ddae4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:05:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:05:49Z,use_quota=True,user_id='7f39fba2cc494ee4ae204aeae406bec5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:05:48 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-d033e857-47f5-4cae-b03f-e3af5b53e206 tempest-VolumesGetTest-1343471577 None] Creating volume bc5b370c-481e-4c8f-a27c-7b43282c4341 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:05:48 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-d033e857-47f5-4cae-b03f-e3af5b53e206 tempest-VolumesGetTest-1343471577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:05:48 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-d033e857-47f5-4cae-b03f-e3af5b53e206 tempest-VolumesGetTest-1343471577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:05:48 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-d033e857-47f5-4cae-b03f-e3af5b53e206 tempest-VolumesGetTest-1343471577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:05:48 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-d033e857-47f5-4cae-b03f-e3af5b53e206 tempest-VolumesGetTest-1343471577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:05:48 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-d033e857-47f5-4cae-b03f-e3af5b53e206 tempest-VolumesGetTest-1343471577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:05:48 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-d033e857-47f5-4cae-b03f-e3af5b53e206 tempest-VolumesGetTest-1343471577 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:05:48 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-d033e857-47f5-4cae-b03f-e3af5b53e206 tempest-VolumesGetTest-1343471577 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:05:48 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d033e857-47f5-4cae-b03f-e3af5b53e206 tempest-VolumesGetTest-1343471577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-bc5b370c-481e-4c8f-a27c-7b43282c4341 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:48 devstack sudo[102165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-bc5b370c-481e-4c8f-a27c-7b43282c4341 1073741824 Aug 10 16:05:48 devstack sudo[102165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:49 devstack sudo[102165]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:49 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d033e857-47f5-4cae-b03f-e3af5b53e206 tempest-VolumesGetTest-1343471577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-bc5b370c-481e-4c8f-a27c-7b43282c4341 1073741824" returned: 0 in 0.517s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:49 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d033e857-47f5-4cae-b03f-e3af5b53e206 tempest-VolumesGetTest-1343471577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-bc5b370c-481e-4c8f-a27c-7b43282c4341 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:49 devstack sudo[102175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-bc5b370c-481e-4c8f-a27c-7b43282c4341 Aug 10 16:05:49 devstack sudo[102175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:49 devstack sudo[102175]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:49 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d033e857-47f5-4cae-b03f-e3af5b53e206 tempest-VolumesGetTest-1343471577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-bc5b370c-481e-4c8f-a27c-7b43282c4341" returned: 0 in 0.340s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:49 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-d033e857-47f5-4cae-b03f-e3af5b53e206 tempest-VolumesGetTest-1343471577 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:05:49 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-d033e857-47f5-4cae-b03f-e3af5b53e206 tempest-VolumesGetTest-1343471577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:05:49 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d033e857-47f5-4cae-b03f-e3af5b53e206 tempest-VolumesGetTest-1343471577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d387d773-bdc0-44ca-8456-84fd9f90cb7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc5b370c-481e-4c8f-a27c-7b43282c4341', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:05:49 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d033e857-47f5-4cae-b03f-e3af5b53e206 tempest-VolumesGetTest-1343471577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a77f812f-ca05-4954-953a-f5c98f25b31e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:05:49 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-d033e857-47f5-4cae-b03f-e3af5b53e206 tempest-VolumesGetTest-1343471577 None] Volume volume-bc5b370c-481e-4c8f-a27c-7b43282c4341 (bc5b370c-481e-4c8f-a27c-7b43282c4341): created successfully Aug 10 16:05:49 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d033e857-47f5-4cae-b03f-e3af5b53e206 tempest-VolumesGetTest-1343471577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a77f812f-ca05-4954-953a-f5c98f25b31e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:05:49 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d033e857-47f5-4cae-b03f-e3af5b53e206 tempest-VolumesGetTest-1343471577 None] Flow 'volume_create_manager' (f1ec910b-ab2b-40e2-9612-d14e4da9cea6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:05:49 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-d033e857-47f5-4cae-b03f-e3af5b53e206 tempest-VolumesGetTest-1343471577 None] Created volume successfully. Aug 10 16:05:51 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-94f62ec1-4f56-4fbc-bef4-be5bdc2e6d49 tempest-VolumesGetTest-1343471577 None] Acquiring lock "cinder-bc5b370c-481e-4c8f-a27c-7b43282c4341-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:05:51 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-94f62ec1-4f56-4fbc-bef4-be5bdc2e6d49 tempest-VolumesGetTest-1343471577 None] Lock "cinder-bc5b370c-481e-4c8f-a27c-7b43282c4341-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:05:51 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-94f62ec1-4f56-4fbc-bef4-be5bdc2e6d49 tempest-VolumesGetTest-1343471577 None] Acquiring lock "cinder-quobyte-bc5b370c-481e-4c8f-a27c-7b43282c4341" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:05:51 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-94f62ec1-4f56-4fbc-bef4-be5bdc2e6d49 tempest-VolumesGetTest-1343471577 None] Lock "cinder-quobyte-bc5b370c-481e-4c8f-a27c-7b43282c4341" acquired by "delete_volume" :: waited 0.022s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:05:51 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84fa803-86dc-437c-ad48-5b05869ad2ea]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:05:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-94f62ec1-4f56-4fbc-bef4-be5bdc2e6d49 tempest-VolumesGetTest-1343471577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-bc5b370c-481e-4c8f-a27c-7b43282c4341 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:51 devstack sudo[102205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-bc5b370c-481e-4c8f-a27c-7b43282c4341 Aug 10 16:05:51 devstack sudo[102205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:51 devstack sudo[102205]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-94f62ec1-4f56-4fbc-bef4-be5bdc2e6d49 tempest-VolumesGetTest-1343471577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-bc5b370c-481e-4c8f-a27c-7b43282c4341" returned: 0 in 0.503s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-94f62ec1-4f56-4fbc-bef4-be5bdc2e6d49 tempest-VolumesGetTest-1343471577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-bc5b370c-481e-4c8f-a27c-7b43282c4341 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:51 devstack sudo[102210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-bc5b370c-481e-4c8f-a27c-7b43282c4341 Aug 10 16:05:51 devstack sudo[102210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:52 devstack sudo[102210]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-94f62ec1-4f56-4fbc-bef4-be5bdc2e6d49 tempest-VolumesGetTest-1343471577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-bc5b370c-481e-4c8f-a27c-7b43282c4341" returned: 0 in 0.338s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:52 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-94f62ec1-4f56-4fbc-bef4-be5bdc2e6d49 tempest-VolumesGetTest-1343471577 None] Lock "cinder-quobyte-bc5b370c-481e-4c8f-a27c-7b43282c4341" released by "delete_volume" :: held 0.917s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:05:52 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-94f62ec1-4f56-4fbc-bef4-be5bdc2e6d49 tempest-VolumesGetTest-1343471577 None] Created reservations ['fe89bca7-cea2-4f40-97b8-6d844ffc6e2e', '8cce4361-d8ef-48be-900c-2d8f233fb24e', '9b93ee22-9148-47b8-b2c8-3db81e9f3baf', '5e39ed22-26a5-4d0e-9b4b-72612d261959'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:05:52 devstack cinder-volume[88641]: INFO cinder.volume.manager [req-a67cf826-ea42-4e4f-83b7-ff80693ca258 req-ce2f52cf-fcbe-4f99-921e-a218d96b710b tempest-TestShelveInstance-1958992432 None] Terminate volume connection completed successfully. Aug 10 16:05:52 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [req-a67cf826-ea42-4e4f-83b7-ff80693ca258 req-ce2f52cf-fcbe-4f99-921e-a218d96b710b tempest-TestShelveInstance-1958992432 None] Deleting attachment 1340c287-b4bd-43b9-ba38-b9bb96290e85. {{(pid=88641) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 10 16:05:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-94f62ec1-4f56-4fbc-bef4-be5bdc2e6d49 tempest-VolumesGetTest-1343471577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:05:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-94f62ec1-4f56-4fbc-bef4-be5bdc2e6d49 tempest-VolumesGetTest-1343471577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:05:52 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-94f62ec1-4f56-4fbc-bef4-be5bdc2e6d49 tempest-VolumesGetTest-1343471577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:05:52 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-94f62ec1-4f56-4fbc-bef4-be5bdc2e6d49 tempest-VolumesGetTest-1343471577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:05:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-94f62ec1-4f56-4fbc-bef4-be5bdc2e6d49 tempest-VolumesGetTest-1343471577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:05:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-94f62ec1-4f56-4fbc-bef4-be5bdc2e6d49 tempest-VolumesGetTest-1343471577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:52 devstack sudo[102216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:05:52 devstack sudo[102216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:52 devstack cinder-volume[88641]: DEBUG cinder.coordination [req-a67cf826-ea42-4e4f-83b7-ff80693ca258 req-01e54174-9ff5-44e1-9be5-8b17844f9891 tempest-TestShelveInstance-1958992432 None] Acquiring lock "cinder-240f4272-f60e-42a3-9240-e677fd927ddc-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:05:52 devstack cinder-volume[88641]: DEBUG cinder.coordination [req-a67cf826-ea42-4e4f-83b7-ff80693ca258 req-01e54174-9ff5-44e1-9be5-8b17844f9891 tempest-TestShelveInstance-1958992432 None] Lock "cinder-240f4272-f60e-42a3-9240-e677fd927ddc-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:05:52 devstack cinder-volume[88641]: DEBUG cinder.coordination [req-a67cf826-ea42-4e4f-83b7-ff80693ca258 req-01e54174-9ff5-44e1-9be5-8b17844f9891 tempest-TestShelveInstance-1958992432 None] Acquiring lock "cinder-quobyte-240f4272-f60e-42a3-9240-e677fd927ddc" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:05:52 devstack cinder-volume[88641]: DEBUG cinder.coordination [req-a67cf826-ea42-4e4f-83b7-ff80693ca258 req-01e54174-9ff5-44e1-9be5-8b17844f9891 tempest-TestShelveInstance-1958992432 None] Lock "cinder-quobyte-240f4272-f60e-42a3-9240-e677fd927ddc" acquired by "delete_volume" :: waited 0.019s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:05:52 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffeb17a1-a261-4fe6-ba13-36a9e98e9af2]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:05:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [req-a67cf826-ea42-4e4f-83b7-ff80693ca258 req-01e54174-9ff5-44e1-9be5-8b17844f9891 tempest-TestShelveInstance-1958992432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-240f4272-f60e-42a3-9240-e677fd927ddc {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:52 devstack sudo[102216]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-94f62ec1-4f56-4fbc-bef4-be5bdc2e6d49 tempest-VolumesGetTest-1343471577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.313s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:52 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-94f62ec1-4f56-4fbc-bef4-be5bdc2e6d49 tempest-VolumesGetTest-1343471577 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:05:52 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-94f62ec1-4f56-4fbc-bef4-be5bdc2e6d49 tempest-VolumesGetTest-1343471577 None] Deleted volume successfully. Aug 10 16:05:52 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-94f62ec1-4f56-4fbc-bef4-be5bdc2e6d49 tempest-VolumesGetTest-1343471577 None] Lock "cinder-bc5b370c-481e-4c8f-a27c-7b43282c4341-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:05:52 devstack sudo[102219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-240f4272-f60e-42a3-9240-e677fd927ddc Aug 10 16:05:52 devstack sudo[102219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:53 devstack sudo[102219]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [req-a67cf826-ea42-4e4f-83b7-ff80693ca258 req-01e54174-9ff5-44e1-9be5-8b17844f9891 tempest-TestShelveInstance-1958992432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-240f4272-f60e-42a3-9240-e677fd927ddc" returned: 0 in 0.453s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [req-a67cf826-ea42-4e4f-83b7-ff80693ca258 req-01e54174-9ff5-44e1-9be5-8b17844f9891 tempest-TestShelveInstance-1958992432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-240f4272-f60e-42a3-9240-e677fd927ddc {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:53 devstack sudo[102224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-240f4272-f60e-42a3-9240-e677fd927ddc Aug 10 16:05:53 devstack sudo[102224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:53 devstack sudo[102224]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [req-a67cf826-ea42-4e4f-83b7-ff80693ca258 req-01e54174-9ff5-44e1-9be5-8b17844f9891 tempest-TestShelveInstance-1958992432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-240f4272-f60e-42a3-9240-e677fd927ddc" returned: 0 in 0.286s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:53 devstack cinder-volume[88641]: DEBUG cinder.coordination [req-a67cf826-ea42-4e4f-83b7-ff80693ca258 req-01e54174-9ff5-44e1-9be5-8b17844f9891 tempest-TestShelveInstance-1958992432 None] Lock "cinder-quobyte-240f4272-f60e-42a3-9240-e677fd927ddc" released by "delete_volume" :: held 0.820s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:05:53 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-3a4f7858-72af-43b5-a7ec-02d9b56f8832 tempest-VolumesGetTest-1343471577 None] Acquiring lock "cinder-39df3d42-2ec7-41c0-b009-3099a3cbaac6-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:05:53 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-3a4f7858-72af-43b5-a7ec-02d9b56f8832 tempest-VolumesGetTest-1343471577 None] Lock "cinder-39df3d42-2ec7-41c0-b009-3099a3cbaac6-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:05:53 devstack cinder-volume[88641]: DEBUG cinder.quota [req-a67cf826-ea42-4e4f-83b7-ff80693ca258 req-01e54174-9ff5-44e1-9be5-8b17844f9891 tempest-TestShelveInstance-1958992432 None] Created reservations ['594be53a-c295-48c6-a689-dbc98ac1e5df', 'b2747c2f-a5e5-48d1-bbe7-56d9d44cf28a', 'e8e8eae5-e3d8-4d0b-965b-8f9e00e03947', 'bef3d72b-6e15-4e84-8844-79f7b90ae6af'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:05:53 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-3a4f7858-72af-43b5-a7ec-02d9b56f8832 tempest-VolumesGetTest-1343471577 None] Acquiring lock "cinder-quobyte-39df3d42-2ec7-41c0-b009-3099a3cbaac6" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:05:53 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-3a4f7858-72af-43b5-a7ec-02d9b56f8832 tempest-VolumesGetTest-1343471577 None] Lock "cinder-quobyte-39df3d42-2ec7-41c0-b009-3099a3cbaac6" acquired by "delete_volume" :: waited 0.030s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:05:53 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b721511-b2e1-4cf8-8212-d0c89cdbafb5]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:05:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-3a4f7858-72af-43b5-a7ec-02d9b56f8832 tempest-VolumesGetTest-1343471577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-39df3d42-2ec7-41c0-b009-3099a3cbaac6 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-a67cf826-ea42-4e4f-83b7-ff80693ca258 req-01e54174-9ff5-44e1-9be5-8b17844f9891 tempest-TestShelveInstance-1958992432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:05:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-a67cf826-ea42-4e4f-83b7-ff80693ca258 req-01e54174-9ff5-44e1-9be5-8b17844f9891 tempest-TestShelveInstance-1958992432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:05:53 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [req-a67cf826-ea42-4e4f-83b7-ff80693ca258 req-01e54174-9ff5-44e1-9be5-8b17844f9891 tempest-TestShelveInstance-1958992432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:05:53 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [req-a67cf826-ea42-4e4f-83b7-ff80693ca258 req-01e54174-9ff5-44e1-9be5-8b17844f9891 tempest-TestShelveInstance-1958992432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:05:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-a67cf826-ea42-4e4f-83b7-ff80693ca258 req-01e54174-9ff5-44e1-9be5-8b17844f9891 tempest-TestShelveInstance-1958992432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:05:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [req-a67cf826-ea42-4e4f-83b7-ff80693ca258 req-01e54174-9ff5-44e1-9be5-8b17844f9891 tempest-TestShelveInstance-1958992432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:53 devstack sudo[102262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:05:53 devstack sudo[102262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:54 devstack sudo[102261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-39df3d42-2ec7-41c0-b009-3099a3cbaac6 Aug 10 16:05:54 devstack sudo[102261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:54 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-48a8d71b-29f2-40a2-9462-e9ee476b7179 tempest-SnapshotsActionsTest-563371099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:05:54 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-48a8d71b-29f2-40a2-9462-e9ee476b7179 tempest-SnapshotsActionsTest-563371099 None] Flow 'volume_create_manager' (9b212e03-c7a2-41d7-8e89-677f344bcbd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:05:54 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-48a8d71b-29f2-40a2-9462-e9ee476b7179 tempest-SnapshotsActionsTest-563371099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf0610f4-923a-4cb6-9940-8107e9b992d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:05:54 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-48a8d71b-29f2-40a2-9462-e9ee476b7179 tempest-SnapshotsActionsTest-563371099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf0610f4-923a-4cb6-9940-8107e9b992d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:05:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1692786041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1d127d8-4b1f-4309-9b71-98698e5dae7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25a8365f9ce44a0fbd5f5d5ef4358463',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:05:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:05:54Z,use_quota=True,user_id='8992485b12c0458d89ad086170ae6508',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:05:54 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-48a8d71b-29f2-40a2-9462-e9ee476b7179 tempest-SnapshotsActionsTest-563371099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4db789ba-54ff-494b-a5f1-6f860fca77b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:05:54 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-48a8d71b-29f2-40a2-9462-e9ee476b7179 tempest-SnapshotsActionsTest-563371099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4db789ba-54ff-494b-a5f1-6f860fca77b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:05:54 devstack sudo[102262]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:54 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-48a8d71b-29f2-40a2-9462-e9ee476b7179 tempest-SnapshotsActionsTest-563371099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11958c15-1fd0-44a4-8b7d-f156243243df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:05:54 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-48a8d71b-29f2-40a2-9462-e9ee476b7179 tempest-SnapshotsActionsTest-563371099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11958c15-1fd0-44a4-8b7d-f156243243df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1d127d8-4b1f-4309-9b71-98698e5dae7a', 'volume_name': 'volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:05:54 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-48a8d71b-29f2-40a2-9462-e9ee476b7179 tempest-SnapshotsActionsTest-563371099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (690be25c-e9e0-4b1f-9e03-9cdf9b454b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:05:54 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-48a8d71b-29f2-40a2-9462-e9ee476b7179 tempest-SnapshotsActionsTest-563371099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (690be25c-e9e0-4b1f-9e03-9cdf9b454b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:05:54 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-48a8d71b-29f2-40a2-9462-e9ee476b7179 tempest-SnapshotsActionsTest-563371099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75a4e1a1-aecf-4bc2-bb7d-a97be7b28759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:05:54 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-48a8d71b-29f2-40a2-9462-e9ee476b7179 tempest-SnapshotsActionsTest-563371099 None] Volume a1d127d8-4b1f-4309-9b71-98698e5dae7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a', 'volume_size': 1} Aug 10 16:05:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-48a8d71b-29f2-40a2-9462-e9ee476b7179 tempest-SnapshotsActionsTest-563371099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:05:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-48a8d71b-29f2-40a2-9462-e9ee476b7179 tempest-SnapshotsActionsTest-563371099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:05:54 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-48a8d71b-29f2-40a2-9462-e9ee476b7179 tempest-SnapshotsActionsTest-563371099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:05:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1692786041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1d127d8-4b1f-4309-9b71-98698e5dae7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25a8365f9ce44a0fbd5f5d5ef4358463',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:05:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:05:54Z,use_quota=True,user_id='8992485b12c0458d89ad086170ae6508',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:05:54 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-48a8d71b-29f2-40a2-9462-e9ee476b7179 tempest-SnapshotsActionsTest-563371099 None] Creating volume a1d127d8-4b1f-4309-9b71-98698e5dae7a {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:05:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-48a8d71b-29f2-40a2-9462-e9ee476b7179 tempest-SnapshotsActionsTest-563371099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:05:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-48a8d71b-29f2-40a2-9462-e9ee476b7179 tempest-SnapshotsActionsTest-563371099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:05:54 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-48a8d71b-29f2-40a2-9462-e9ee476b7179 tempest-SnapshotsActionsTest-563371099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:05:54 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-48a8d71b-29f2-40a2-9462-e9ee476b7179 tempest-SnapshotsActionsTest-563371099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:05:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-48a8d71b-29f2-40a2-9462-e9ee476b7179 tempest-SnapshotsActionsTest-563371099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:05:54 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-48a8d71b-29f2-40a2-9462-e9ee476b7179 tempest-SnapshotsActionsTest-563371099 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:05:54 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-48a8d71b-29f2-40a2-9462-e9ee476b7179 tempest-SnapshotsActionsTest-563371099 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:05:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-48a8d71b-29f2-40a2-9462-e9ee476b7179 tempest-SnapshotsActionsTest-563371099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [req-a67cf826-ea42-4e4f-83b7-ff80693ca258 req-01e54174-9ff5-44e1-9be5-8b17844f9891 tempest-TestShelveInstance-1958992432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.340s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:54 devstack cinder-volume[88641]: DEBUG cinder.manager [req-a67cf826-ea42-4e4f-83b7-ff80693ca258 req-01e54174-9ff5-44e1-9be5-8b17844f9891 tempest-TestShelveInstance-1958992432 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:05:54 devstack cinder-volume[88641]: INFO cinder.volume.manager [req-a67cf826-ea42-4e4f-83b7-ff80693ca258 req-01e54174-9ff5-44e1-9be5-8b17844f9891 tempest-TestShelveInstance-1958992432 None] Deleted volume successfully. Aug 10 16:05:54 devstack sudo[102268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a 1073741824 Aug 10 16:05:54 devstack sudo[102268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:54 devstack cinder-volume[88641]: DEBUG cinder.coordination [req-a67cf826-ea42-4e4f-83b7-ff80693ca258 req-01e54174-9ff5-44e1-9be5-8b17844f9891 tempest-TestShelveInstance-1958992432 None] Lock "cinder-240f4272-f60e-42a3-9240-e677fd927ddc-delete_volume" released by "delete_volume" :: held 1.518s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:05:54 devstack sudo[102261]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-3a4f7858-72af-43b5-a7ec-02d9b56f8832 tempest-VolumesGetTest-1343471577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-39df3d42-2ec7-41c0-b009-3099a3cbaac6" returned: 0 in 0.462s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-3a4f7858-72af-43b5-a7ec-02d9b56f8832 tempest-VolumesGetTest-1343471577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-39df3d42-2ec7-41c0-b009-3099a3cbaac6 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:54 devstack sudo[102273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-39df3d42-2ec7-41c0-b009-3099a3cbaac6 Aug 10 16:05:54 devstack sudo[102273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:54 devstack sudo[102273]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-3a4f7858-72af-43b5-a7ec-02d9b56f8832 tempest-VolumesGetTest-1343471577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-39df3d42-2ec7-41c0-b009-3099a3cbaac6" returned: 0 in 0.298s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:54 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-3a4f7858-72af-43b5-a7ec-02d9b56f8832 tempest-VolumesGetTest-1343471577 None] Lock "cinder-quobyte-39df3d42-2ec7-41c0-b009-3099a3cbaac6" released by "delete_volume" :: held 0.805s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:05:54 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-3a4f7858-72af-43b5-a7ec-02d9b56f8832 tempest-VolumesGetTest-1343471577 None] Created reservations ['8fe4af27-5a22-4580-bd8f-7b9055df9d20', '2a531e2c-d451-4675-b588-5b3a8e41d288', '0c7e4f6f-5eb3-4321-b18b-2466a18f78d1', '43f73817-23d2-4280-9624-7ae6f126ff42'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:05:54 devstack sudo[102268]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-48a8d71b-29f2-40a2-9462-e9ee476b7179 tempest-SnapshotsActionsTest-563371099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a 1073741824" returned: 0 in 0.504s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-48a8d71b-29f2-40a2-9462-e9ee476b7179 tempest-SnapshotsActionsTest-563371099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-3a4f7858-72af-43b5-a7ec-02d9b56f8832 tempest-VolumesGetTest-1343471577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:05:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-3a4f7858-72af-43b5-a7ec-02d9b56f8832 tempest-VolumesGetTest-1343471577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:05:54 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-3a4f7858-72af-43b5-a7ec-02d9b56f8832 tempest-VolumesGetTest-1343471577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:05:54 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-3a4f7858-72af-43b5-a7ec-02d9b56f8832 tempest-VolumesGetTest-1343471577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:05:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-3a4f7858-72af-43b5-a7ec-02d9b56f8832 tempest-VolumesGetTest-1343471577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:05:54 devstack sudo[102280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a Aug 10 16:05:54 devstack sudo[102280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-3a4f7858-72af-43b5-a7ec-02d9b56f8832 tempest-VolumesGetTest-1343471577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:54 devstack sudo[102282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:05:54 devstack sudo[102282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:55 devstack sudo[102280]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-48a8d71b-29f2-40a2-9462-e9ee476b7179 tempest-SnapshotsActionsTest-563371099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a" returned: 0 in 0.336s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:55 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-48a8d71b-29f2-40a2-9462-e9ee476b7179 tempest-SnapshotsActionsTest-563371099 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:05:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-48a8d71b-29f2-40a2-9462-e9ee476b7179 tempest-SnapshotsActionsTest-563371099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:05:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-48a8d71b-29f2-40a2-9462-e9ee476b7179 tempest-SnapshotsActionsTest-563371099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75a4e1a1-aecf-4bc2-bb7d-a97be7b28759) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:05:55 devstack sudo[102282]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-48a8d71b-29f2-40a2-9462-e9ee476b7179 tempest-SnapshotsActionsTest-563371099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1fe359b-8189-410b-be54-c7cdf84bd815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:05:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-3a4f7858-72af-43b5-a7ec-02d9b56f8832 tempest-VolumesGetTest-1343471577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.340s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:55 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-3a4f7858-72af-43b5-a7ec-02d9b56f8832 tempest-VolumesGetTest-1343471577 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:05:55 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-3a4f7858-72af-43b5-a7ec-02d9b56f8832 tempest-VolumesGetTest-1343471577 None] Deleted volume successfully. Aug 10 16:05:55 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-48a8d71b-29f2-40a2-9462-e9ee476b7179 tempest-SnapshotsActionsTest-563371099 None] Volume volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a (a1d127d8-4b1f-4309-9b71-98698e5dae7a): created successfully Aug 10 16:05:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-48a8d71b-29f2-40a2-9462-e9ee476b7179 tempest-SnapshotsActionsTest-563371099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1fe359b-8189-410b-be54-c7cdf84bd815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:05:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-48a8d71b-29f2-40a2-9462-e9ee476b7179 tempest-SnapshotsActionsTest-563371099 None] Flow 'volume_create_manager' (9b212e03-c7a2-41d7-8e89-677f344bcbd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:05:55 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-48a8d71b-29f2-40a2-9462-e9ee476b7179 tempest-SnapshotsActionsTest-563371099 None] Created volume successfully. Aug 10 16:05:55 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-3a4f7858-72af-43b5-a7ec-02d9b56f8832 tempest-VolumesGetTest-1343471577 None] Lock "cinder-39df3d42-2ec7-41c0-b009-3099a3cbaac6-delete_volume" released by "delete_volume" :: held 1.456s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:05:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-45d80128-5d61-4ca8-a7c4-fbd3a5280474 tempest-SnapshotsActionsTest-563371099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:05:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-45d80128-5d61-4ca8-a7c4-fbd3a5280474 tempest-SnapshotsActionsTest-563371099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:05:56 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-45d80128-5d61-4ca8-a7c4-fbd3a5280474 tempest-SnapshotsActionsTest-563371099 None] Creating offline snapshot 4e968a7c-3296-40bb-a468-b8e0bee026c9 of volume a1d127d8-4b1f-4309-9b71-98698e5dae7a {{(pid=88641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 16:05:56 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e48925-fb3b-4444-94cb-14defd2b8b4a]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:05:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-45d80128-5d61-4ca8-a7c4-fbd3a5280474 tempest-SnapshotsActionsTest-563371099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:56 devstack sudo[102287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a Aug 10 16:05:56 devstack sudo[102287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:56 devstack sudo[102287]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-45d80128-5d61-4ca8-a7c4-fbd3a5280474 tempest-SnapshotsActionsTest-563371099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a" returned: 0 in 0.428s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-45d80128-5d61-4ca8-a7c4-fbd3a5280474 tempest-SnapshotsActionsTest-563371099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.4e968a7c-3296-40bb-a468-b8e0bee026c9 1G {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:56 devstack sudo[102292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.4e968a7c-3296-40bb-a468-b8e0bee026c9 1G Aug 10 16:05:56 devstack sudo[102292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:57 devstack sudo[102292]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-45d80128-5d61-4ca8-a7c4-fbd3a5280474 tempest-SnapshotsActionsTest-563371099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.4e968a7c-3296-40bb-a468-b8e0bee026c9 1G" returned: 0 in 0.442s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-45d80128-5d61-4ca8-a7c4-fbd3a5280474 tempest-SnapshotsActionsTest-563371099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.4e968a7c-3296-40bb-a468-b8e0bee026c9 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:57 devstack sudo[102297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.4e968a7c-3296-40bb-a468-b8e0bee026c9 Aug 10 16:05:57 devstack sudo[102297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:57 devstack sudo[102297]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-45d80128-5d61-4ca8-a7c4-fbd3a5280474 tempest-SnapshotsActionsTest-563371099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.4e968a7c-3296-40bb-a468-b8e0bee026c9" returned: 0 in 0.379s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:57 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-45d80128-5d61-4ca8-a7c4-fbd3a5280474 tempest-SnapshotsActionsTest-563371099 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.4e968a7c-3296-40bb-a468-b8e0bee026c9 is being set with open permissions: ugo+rw Aug 10 16:05:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-45d80128-5d61-4ca8-a7c4-fbd3a5280474 tempest-SnapshotsActionsTest-563371099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.4e968a7c-3296-40bb-a468-b8e0bee026c9 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:57 devstack sudo[102303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.4e968a7c-3296-40bb-a468-b8e0bee026c9 Aug 10 16:05:57 devstack sudo[102303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:57 devstack sudo[102303]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-45d80128-5d61-4ca8-a7c4-fbd3a5280474 tempest-SnapshotsActionsTest-563371099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.4e968a7c-3296-40bb-a468-b8e0bee026c9" returned: 0 in 0.249s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-45d80128-5d61-4ca8-a7c4-fbd3a5280474 tempest-SnapshotsActionsTest-563371099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.info {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:58 devstack sudo[102306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.info Aug 10 16:05:58 devstack sudo[102306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:58 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba505c43-b6b0-4b57-ac85-263814f3723d tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:05:58 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-ba505c43-b6b0-4b57-ac85-263814f3723d tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] Flow 'volume_create_manager' (91535e5a-0afa-4313-b304-37a68f04c871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:05:58 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-ba505c43-b6b0-4b57-ac85-263814f3723d tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f67fac26-3031-4edb-a637-4888d1f452e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:05:58 devstack sudo[102306]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:58 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-ba505c43-b6b0-4b57-ac85-263814f3723d tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f67fac26-3031-4edb-a637-4888d1f452e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:05:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1442332633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa6ba3ca-1cc2-42e4-b5fa-1fb333ef4d77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16c000a721554e03ae497bb10488644f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:05:58Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:05:58Z,use_quota=True,user_id='b873f9282eb9489997d4eaa7122d2891',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:05:58 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-ba505c43-b6b0-4b57-ac85-263814f3723d tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88717fe1-797c-46df-a512-e0c77c1af737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:05:58 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-ba505c43-b6b0-4b57-ac85-263814f3723d tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88717fe1-797c-46df-a512-e0c77c1af737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:05:58 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-ba505c43-b6b0-4b57-ac85-263814f3723d tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c6a1d48-7a19-433b-84e0-e13b34b9e97c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:05:58 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-ba505c43-b6b0-4b57-ac85-263814f3723d tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c6a1d48-7a19-433b-84e0-e13b34b9e97c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa6ba3ca-1cc2-42e4-b5fa-1fb333ef4d77', 'volume_name': 'volume-fa6ba3ca-1cc2-42e4-b5fa-1fb333ef4d77', 'volume_size': 2}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:05:58 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-ba505c43-b6b0-4b57-ac85-263814f3723d tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0401a723-407d-4fc0-9098-c7bc8cb6bdd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:05:58 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-ba505c43-b6b0-4b57-ac85-263814f3723d tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0401a723-407d-4fc0-9098-c7bc8cb6bdd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:05:58 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-ba505c43-b6b0-4b57-ac85-263814f3723d tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7c67aee-7ed2-44bb-89e0-a964e0d0a0e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:05:58 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-ba505c43-b6b0-4b57-ac85-263814f3723d tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] Volume fa6ba3ca-1cc2-42e4-b5fa-1fb333ef4d77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa6ba3ca-1cc2-42e4-b5fa-1fb333ef4d77', 'volume_size': 2} Aug 10 16:05:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-ba505c43-b6b0-4b57-ac85-263814f3723d tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:05:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-45d80128-5d61-4ca8-a7c4-fbd3a5280474 tempest-SnapshotsActionsTest-563371099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.info" returned: 0 in 0.300s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:58 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-45d80128-5d61-4ca8-a7c4-fbd3a5280474 tempest-SnapshotsActionsTest-563371099 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.info is being set with open permissions: ugo+rw Aug 10 16:05:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-45d80128-5d61-4ca8-a7c4-fbd3a5280474 tempest-SnapshotsActionsTest-563371099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.info {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:58 devstack sudo[102309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.info Aug 10 16:05:58 devstack sudo[102309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:58 devstack sudo[102309]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-45d80128-5d61-4ca8-a7c4-fbd3a5280474 tempest-SnapshotsActionsTest-563371099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.info" returned: 0 in 0.264s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-45d80128-5d61-4ca8-a7c4-fbd3a5280474 tempest-SnapshotsActionsTest-563371099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.197s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:05:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-ba505c43-b6b0-4b57-ac85-263814f3723d tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.316s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:05:58 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-ba505c43-b6b0-4b57-ac85-263814f3723d tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:05:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1442332633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa6ba3ca-1cc2-42e4-b5fa-1fb333ef4d77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16c000a721554e03ae497bb10488644f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:05:58Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:05:58Z,use_quota=True,user_id='b873f9282eb9489997d4eaa7122d2891',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:05:58 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-ba505c43-b6b0-4b57-ac85-263814f3723d tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] Creating volume fa6ba3ca-1cc2-42e4-b5fa-1fb333ef4d77 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:05:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-ba505c43-b6b0-4b57-ac85-263814f3723d tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:05:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-ba505c43-b6b0-4b57-ac85-263814f3723d tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:05:58 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-ba505c43-b6b0-4b57-ac85-263814f3723d tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:05:58 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-ba505c43-b6b0-4b57-ac85-263814f3723d tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:05:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-ba505c43-b6b0-4b57-ac85-263814f3723d tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:05:58 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-ba505c43-b6b0-4b57-ac85-263814f3723d tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:05:58 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-ba505c43-b6b0-4b57-ac85-263814f3723d tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:05:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ba505c43-b6b0-4b57-ac85-263814f3723d tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-fa6ba3ca-1cc2-42e4-b5fa-1fb333ef4d77 2147483648 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:58 devstack sudo[102312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-fa6ba3ca-1cc2-42e4-b5fa-1fb333ef4d77 2147483648 Aug 10 16:05:58 devstack sudo[102312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:58 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-45d80128-5d61-4ca8-a7c4-fbd3a5280474 tempest-SnapshotsActionsTest-563371099 None] Create snapshot completed successfully Aug 10 16:05:59 devstack sudo[102312]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:59 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ba505c43-b6b0-4b57-ac85-263814f3723d tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-fa6ba3ca-1cc2-42e4-b5fa-1fb333ef4d77 2147483648" returned: 0 in 0.513s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:59 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ba505c43-b6b0-4b57-ac85-263814f3723d tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-fa6ba3ca-1cc2-42e4-b5fa-1fb333ef4d77 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:05:59 devstack sudo[102318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-fa6ba3ca-1cc2-42e4-b5fa-1fb333ef4d77 Aug 10 16:05:59 devstack sudo[102318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:05:59 devstack sudo[102318]: pam_unix(sudo:session): session closed for user root Aug 10 16:05:59 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ba505c43-b6b0-4b57-ac85-263814f3723d tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-fa6ba3ca-1cc2-42e4-b5fa-1fb333ef4d77" returned: 0 in 0.300s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:05:59 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-ba505c43-b6b0-4b57-ac85-263814f3723d tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:05:59 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-ba505c43-b6b0-4b57-ac85-263814f3723d tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:05:59 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-ba505c43-b6b0-4b57-ac85-263814f3723d tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7c67aee-7ed2-44bb-89e0-a964e0d0a0e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa6ba3ca-1cc2-42e4-b5fa-1fb333ef4d77', 'volume_size': 2}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:05:59 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-ba505c43-b6b0-4b57-ac85-263814f3723d tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ec635f2-3fc1-4a68-9a6f-7debf2e1ae19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:05:59 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-ba505c43-b6b0-4b57-ac85-263814f3723d tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] Volume volume-fa6ba3ca-1cc2-42e4-b5fa-1fb333ef4d77 (fa6ba3ca-1cc2-42e4-b5fa-1fb333ef4d77): created successfully Aug 10 16:05:59 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-ba505c43-b6b0-4b57-ac85-263814f3723d tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ec635f2-3fc1-4a68-9a6f-7debf2e1ae19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:05:59 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-ba505c43-b6b0-4b57-ac85-263814f3723d tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] Flow 'volume_create_manager' (91535e5a-0afa-4313-b304-37a68f04c871) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:05:59 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-ba505c43-b6b0-4b57-ac85-263814f3723d tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] Created volume successfully. Aug 10 16:06:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-f2f30877-d32b-4fc0-83fb-ca79d4bf0c8a tempest-SnapshotsActionsTest-563371099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:06:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-f2f30877-d32b-4fc0-83fb-ca79d4bf0c8a tempest-SnapshotsActionsTest-563371099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:06:00 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-f2f30877-d32b-4fc0-83fb-ca79d4bf0c8a tempest-SnapshotsActionsTest-563371099 None] Creating offline snapshot a1745f41-5ac3-47f7-a0d0-fd910ae15b4f of volume a1d127d8-4b1f-4309-9b71-98698e5dae7a {{(pid=88641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 16:06:00 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[43955f49-3b56-4f9f-b3ff-9ea6218f01b4]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:06:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-f2f30877-d32b-4fc0-83fb-ca79d4bf0c8a tempest-SnapshotsActionsTest-563371099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.4e968a7c-3296-40bb-a468-b8e0bee026c9 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:00 devstack sudo[102322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.4e968a7c-3296-40bb-a468-b8e0bee026c9 Aug 10 16:06:00 devstack sudo[102322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-ac64c213-82ae-47f5-8c36-1af73ec93710 tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:06:00 devstack sudo[102322]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-f2f30877-d32b-4fc0-83fb-ca79d4bf0c8a tempest-SnapshotsActionsTest-563371099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.4e968a7c-3296-40bb-a468-b8e0bee026c9" returned: 0 in 0.403s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:00 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-f2f30877-d32b-4fc0-83fb-ca79d4bf0c8a tempest-SnapshotsActionsTest-563371099 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 16:06:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-f2f30877-d32b-4fc0-83fb-ca79d4bf0c8a tempest-SnapshotsActionsTest-563371099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.4e968a7c-3296-40bb-a468-b8e0bee026c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.a1745f41-5ac3-47f7-a0d0-fd910ae15b4f 1G {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:00 devstack sudo[102327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.4e968a7c-3296-40bb-a468-b8e0bee026c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.a1745f41-5ac3-47f7-a0d0-fd910ae15b4f 1G Aug 10 16:06:00 devstack sudo[102327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:01 devstack sudo[102327]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:01 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-f2f30877-d32b-4fc0-83fb-ca79d4bf0c8a tempest-SnapshotsActionsTest-563371099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.4e968a7c-3296-40bb-a468-b8e0bee026c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.a1745f41-5ac3-47f7-a0d0-fd910ae15b4f 1G" returned: 0 in 0.468s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:01 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-f2f30877-d32b-4fc0-83fb-ca79d4bf0c8a tempest-SnapshotsActionsTest-563371099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.4e968a7c-3296-40bb-a468-b8e0bee026c9 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.a1745f41-5ac3-47f7-a0d0-fd910ae15b4f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:01 devstack sudo[102333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.4e968a7c-3296-40bb-a468-b8e0bee026c9 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.a1745f41-5ac3-47f7-a0d0-fd910ae15b4f Aug 10 16:06:01 devstack sudo[102333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:01 devstack sudo[102333]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:01 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-f2f30877-d32b-4fc0-83fb-ca79d4bf0c8a tempest-SnapshotsActionsTest-563371099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.4e968a7c-3296-40bb-a468-b8e0bee026c9 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.a1745f41-5ac3-47f7-a0d0-fd910ae15b4f" returned: 0 in 0.289s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:01 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-f2f30877-d32b-4fc0-83fb-ca79d4bf0c8a tempest-SnapshotsActionsTest-563371099 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.a1745f41-5ac3-47f7-a0d0-fd910ae15b4f is being set with open permissions: ugo+rw Aug 10 16:06:01 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-f2f30877-d32b-4fc0-83fb-ca79d4bf0c8a tempest-SnapshotsActionsTest-563371099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.a1745f41-5ac3-47f7-a0d0-fd910ae15b4f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:01 devstack sudo[102338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.a1745f41-5ac3-47f7-a0d0-fd910ae15b4f Aug 10 16:06:01 devstack sudo[102338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:01 devstack sudo[102338]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:01 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-f2f30877-d32b-4fc0-83fb-ca79d4bf0c8a tempest-SnapshotsActionsTest-563371099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.a1745f41-5ac3-47f7-a0d0-fd910ae15b4f" returned: 0 in 0.251s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:01 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-f2f30877-d32b-4fc0-83fb-ca79d4bf0c8a tempest-SnapshotsActionsTest-563371099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.530s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:06:01 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-ac64c213-82ae-47f5-8c36-1af73ec93710 tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.140s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:06:01 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-ac64c213-82ae-47f5-8c36-1af73ec93710 tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] Creating offline snapshot 14caca6f-a85e-402a-9cbe-0de8449a8370 of volume fa6ba3ca-1cc2-42e4-b5fa-1fb333ef4d77 {{(pid=88641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 16:06:01 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-f2f30877-d32b-4fc0-83fb-ca79d4bf0c8a tempest-SnapshotsActionsTest-563371099 None] Create snapshot completed successfully Aug 10 16:06:01 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e93bb2-56ad-4dfa-8a58-e77a040d71d2]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:06:01 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ac64c213-82ae-47f5-8c36-1af73ec93710 tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-fa6ba3ca-1cc2-42e4-b5fa-1fb333ef4d77 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:01 devstack sudo[102341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-fa6ba3ca-1cc2-42e4-b5fa-1fb333ef4d77 Aug 10 16:06:01 devstack sudo[102341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:02 devstack sudo[102341]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ac64c213-82ae-47f5-8c36-1af73ec93710 tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-fa6ba3ca-1cc2-42e4-b5fa-1fb333ef4d77" returned: 0 in 0.390s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ac64c213-82ae-47f5-8c36-1af73ec93710 tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-fa6ba3ca-1cc2-42e4-b5fa-1fb333ef4d77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-fa6ba3ca-1cc2-42e4-b5fa-1fb333ef4d77.14caca6f-a85e-402a-9cbe-0de8449a8370 2G {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:02 devstack sudo[102347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-fa6ba3ca-1cc2-42e4-b5fa-1fb333ef4d77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-fa6ba3ca-1cc2-42e4-b5fa-1fb333ef4d77.14caca6f-a85e-402a-9cbe-0de8449a8370 2G Aug 10 16:06:02 devstack sudo[102347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:02 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-20185c7e-09a9-42ed-88d8-411ddd3c9f1a tempest-SnapshotsActionsTest-1239710851 None] Acquiring lock "cinder-a1745f41-5ac3-47f7-a0d0-fd910ae15b4f-delete_snapshot" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:06:02 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-20185c7e-09a9-42ed-88d8-411ddd3c9f1a tempest-SnapshotsActionsTest-1239710851 None] Lock "cinder-a1745f41-5ac3-47f7-a0d0-fd910ae15b4f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:06:02 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-20185c7e-09a9-42ed-88d8-411ddd3c9f1a tempest-SnapshotsActionsTest-1239710851 None] Acquiring lock "cinder-quobyte-a1d127d8-4b1f-4309-9b71-98698e5dae7a" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:06:02 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-20185c7e-09a9-42ed-88d8-411ddd3c9f1a tempest-SnapshotsActionsTest-1239710851 None] Lock "cinder-quobyte-a1d127d8-4b1f-4309-9b71-98698e5dae7a" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:06:02 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-20185c7e-09a9-42ed-88d8-411ddd3c9f1a tempest-SnapshotsActionsTest-1239710851 None] Acquiring lock "cinder-quobyte-a1745f41-5ac3-47f7-a0d0-fd910ae15b4f" by "_delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:06:02 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-20185c7e-09a9-42ed-88d8-411ddd3c9f1a tempest-SnapshotsActionsTest-1239710851 None] Lock "cinder-quobyte-a1745f41-5ac3-47f7-a0d0-fd910ae15b4f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:06:02 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-20185c7e-09a9-42ed-88d8-411ddd3c9f1a tempest-SnapshotsActionsTest-1239710851 None] Deleting offline snapshot a1745f41-5ac3-47f7-a0d0-fd910ae15b4f of volume a1d127d8-4b1f-4309-9b71-98698e5dae7a {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 16:06:02 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-20185c7e-09a9-42ed-88d8-411ddd3c9f1a tempest-SnapshotsActionsTest-1239710851 None] snapshot_file for this snap is: volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.a1745f41-5ac3-47f7-a0d0-fd910ae15b4f {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 16:06:02 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[007dd2df-1f5d-4c4b-99af-c898f44e0f98]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:06:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-20185c7e-09a9-42ed-88d8-411ddd3c9f1a tempest-SnapshotsActionsTest-1239710851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.a1745f41-5ac3-47f7-a0d0-fd910ae15b4f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:02 devstack sudo[102352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.a1745f41-5ac3-47f7-a0d0-fd910ae15b4f Aug 10 16:06:02 devstack sudo[102352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:02 devstack sudo[102347]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ac64c213-82ae-47f5-8c36-1af73ec93710 tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-fa6ba3ca-1cc2-42e4-b5fa-1fb333ef4d77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-fa6ba3ca-1cc2-42e4-b5fa-1fb333ef4d77.14caca6f-a85e-402a-9cbe-0de8449a8370 2G" returned: 0 in 0.435s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ac64c213-82ae-47f5-8c36-1af73ec93710 tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa6ba3ca-1cc2-42e4-b5fa-1fb333ef4d77 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-fa6ba3ca-1cc2-42e4-b5fa-1fb333ef4d77.14caca6f-a85e-402a-9cbe-0de8449a8370 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:02 devstack sudo[102354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa6ba3ca-1cc2-42e4-b5fa-1fb333ef4d77 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-fa6ba3ca-1cc2-42e4-b5fa-1fb333ef4d77.14caca6f-a85e-402a-9cbe-0de8449a8370 Aug 10 16:06:02 devstack sudo[102354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:02 devstack sudo[102352]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-20185c7e-09a9-42ed-88d8-411ddd3c9f1a tempest-SnapshotsActionsTest-1239710851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.a1745f41-5ac3-47f7-a0d0-fd910ae15b4f" returned: 0 in 0.404s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:02 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-20185c7e-09a9-42ed-88d8-411ddd3c9f1a tempest-SnapshotsActionsTest-1239710851 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 16:06:02 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd89dbef-57fe-43e4-90a7-83702f086394]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:06:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-20185c7e-09a9-42ed-88d8-411ddd3c9f1a tempest-SnapshotsActionsTest-1239710851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.4e968a7c-3296-40bb-a468-b8e0bee026c9 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:02 devstack sudo[102354]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ac64c213-82ae-47f5-8c36-1af73ec93710 tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa6ba3ca-1cc2-42e4-b5fa-1fb333ef4d77 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-fa6ba3ca-1cc2-42e4-b5fa-1fb333ef4d77.14caca6f-a85e-402a-9cbe-0de8449a8370" returned: 0 in 0.336s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:02 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-ac64c213-82ae-47f5-8c36-1af73ec93710 tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-fa6ba3ca-1cc2-42e4-b5fa-1fb333ef4d77.14caca6f-a85e-402a-9cbe-0de8449a8370 is being set with open permissions: ugo+rw Aug 10 16:06:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ac64c213-82ae-47f5-8c36-1af73ec93710 tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-fa6ba3ca-1cc2-42e4-b5fa-1fb333ef4d77.14caca6f-a85e-402a-9cbe-0de8449a8370 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:02 devstack sudo[102364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-fa6ba3ca-1cc2-42e4-b5fa-1fb333ef4d77.14caca6f-a85e-402a-9cbe-0de8449a8370 Aug 10 16:06:02 devstack sudo[102364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:02 devstack sudo[102363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.4e968a7c-3296-40bb-a468-b8e0bee026c9 Aug 10 16:06:02 devstack sudo[102363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:03 devstack sudo[102364]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ac64c213-82ae-47f5-8c36-1af73ec93710 tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-fa6ba3ca-1cc2-42e4-b5fa-1fb333ef4d77.14caca6f-a85e-402a-9cbe-0de8449a8370" returned: 0 in 0.316s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ac64c213-82ae-47f5-8c36-1af73ec93710 tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-fa6ba3ca-1cc2-42e4-b5fa-1fb333ef4d77.info {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:03 devstack sudo[102372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-fa6ba3ca-1cc2-42e4-b5fa-1fb333ef4d77.info Aug 10 16:06:03 devstack sudo[102372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:03 devstack sudo[102363]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-20185c7e-09a9-42ed-88d8-411ddd3c9f1a tempest-SnapshotsActionsTest-1239710851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.4e968a7c-3296-40bb-a468-b8e0bee026c9" returned: 0 in 0.445s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:03 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-20185c7e-09a9-42ed-88d8-411ddd3c9f1a tempest-SnapshotsActionsTest-1239710851 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 16:06:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-20185c7e-09a9-42ed-88d8-411ddd3c9f1a tempest-SnapshotsActionsTest-1239710851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.a1745f41-5ac3-47f7-a0d0-fd910ae15b4f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:03 devstack sudo[102374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.a1745f41-5ac3-47f7-a0d0-fd910ae15b4f Aug 10 16:06:03 devstack sudo[102374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:03 devstack sudo[102372]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ac64c213-82ae-47f5-8c36-1af73ec93710 tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-fa6ba3ca-1cc2-42e4-b5fa-1fb333ef4d77.info" returned: 0 in 0.311s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:03 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-ac64c213-82ae-47f5-8c36-1af73ec93710 tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-fa6ba3ca-1cc2-42e4-b5fa-1fb333ef4d77.info is being set with open permissions: ugo+rw Aug 10 16:06:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ac64c213-82ae-47f5-8c36-1af73ec93710 tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-fa6ba3ca-1cc2-42e4-b5fa-1fb333ef4d77.info {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:03 devstack sudo[102379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-fa6ba3ca-1cc2-42e4-b5fa-1fb333ef4d77.info Aug 10 16:06:03 devstack sudo[102379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:03 devstack sudo[102374]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-20185c7e-09a9-42ed-88d8-411ddd3c9f1a tempest-SnapshotsActionsTest-1239710851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.a1745f41-5ac3-47f7-a0d0-fd910ae15b4f" returned: 0 in 0.473s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-20185c7e-09a9-42ed-88d8-411ddd3c9f1a tempest-SnapshotsActionsTest-1239710851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.a1745f41-5ac3-47f7-a0d0-fd910ae15b4f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:03 devstack sudo[102384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.a1745f41-5ac3-47f7-a0d0-fd910ae15b4f Aug 10 16:06:03 devstack sudo[102384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:03 devstack sudo[102379]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ac64c213-82ae-47f5-8c36-1af73ec93710 tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-fa6ba3ca-1cc2-42e4-b5fa-1fb333ef4d77.info" returned: 0 in 0.306s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-ac64c213-82ae-47f5-8c36-1af73ec93710 tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.216s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:06:03 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-ac64c213-82ae-47f5-8c36-1af73ec93710 tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] Create snapshot completed successfully Aug 10 16:06:04 devstack sudo[102384]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-20185c7e-09a9-42ed-88d8-411ddd3c9f1a tempest-SnapshotsActionsTest-1239710851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.a1745f41-5ac3-47f7-a0d0-fd910ae15b4f" returned: 0 in 0.322s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:04 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-20185c7e-09a9-42ed-88d8-411ddd3c9f1a tempest-SnapshotsActionsTest-1239710851 None] Lock "cinder-quobyte-a1745f41-5ac3-47f7-a0d0-fd910ae15b4f" released by "_delete_snapshot" :: held 1.762s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:06:04 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-20185c7e-09a9-42ed-88d8-411ddd3c9f1a tempest-SnapshotsActionsTest-1239710851 None] Lock "cinder-quobyte-a1d127d8-4b1f-4309-9b71-98698e5dae7a" released by "delete_snapshot" :: held 1.785s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:06:04 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-20185c7e-09a9-42ed-88d8-411ddd3c9f1a tempest-SnapshotsActionsTest-1239710851 None] Created reservations ['2810d1f3-8590-4678-a660-d6e639c681be', 'ab7fabab-a298-4c40-955e-ac228ca740b6', '2348b2a3-1db1-4515-b596-47d663297423', 'e3336605-c4d6-43c5-9f8c-f7b628cb5639'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:06:04 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-20185c7e-09a9-42ed-88d8-411ddd3c9f1a tempest-SnapshotsActionsTest-1239710851 None] Delete snapshot completed successfully. Aug 10 16:06:04 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-20185c7e-09a9-42ed-88d8-411ddd3c9f1a tempest-SnapshotsActionsTest-1239710851 None] Lock "cinder-a1745f41-5ac3-47f7-a0d0-fd910ae15b4f-delete_snapshot" released by "delete_snapshot" :: held 1.947s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:06:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-3bfe1803-ff5d-4199-a9be-d9227fe48523 tempest-SnapshotsActionsTest-563371099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:06:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-3bfe1803-ff5d-4199-a9be-d9227fe48523 tempest-SnapshotsActionsTest-563371099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:06:04 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-1517a1ce-c50c-4a8a-9122-42648f8deefc tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] Acquiring lock "cinder-14caca6f-a85e-402a-9cbe-0de8449a8370-delete_snapshot" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:06:04 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-3bfe1803-ff5d-4199-a9be-d9227fe48523 tempest-SnapshotsActionsTest-563371099 None] Creating offline snapshot 33b4879d-3260-49af-a599-e1f6b0389688 of volume a1d127d8-4b1f-4309-9b71-98698e5dae7a {{(pid=88641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 16:06:04 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-1517a1ce-c50c-4a8a-9122-42648f8deefc tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] Lock "cinder-14caca6f-a85e-402a-9cbe-0de8449a8370-delete_snapshot" acquired by "delete_snapshot" :: waited 0.065s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:06:04 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-1517a1ce-c50c-4a8a-9122-42648f8deefc tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] Acquiring lock "cinder-quobyte-fa6ba3ca-1cc2-42e4-b5fa-1fb333ef4d77" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:06:04 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e60d7e-ec7d-4be0-9b65-75b070918f48]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:06:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-3bfe1803-ff5d-4199-a9be-d9227fe48523 tempest-SnapshotsActionsTest-563371099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.4e968a7c-3296-40bb-a468-b8e0bee026c9 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:04 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-1517a1ce-c50c-4a8a-9122-42648f8deefc tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] Lock "cinder-quobyte-fa6ba3ca-1cc2-42e4-b5fa-1fb333ef4d77" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:06:04 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-1517a1ce-c50c-4a8a-9122-42648f8deefc tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] Acquiring lock "cinder-quobyte-14caca6f-a85e-402a-9cbe-0de8449a8370" by "_delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:06:04 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-1517a1ce-c50c-4a8a-9122-42648f8deefc tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] Lock "cinder-quobyte-14caca6f-a85e-402a-9cbe-0de8449a8370" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:06:04 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-1517a1ce-c50c-4a8a-9122-42648f8deefc tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] Deleting offline snapshot 14caca6f-a85e-402a-9cbe-0de8449a8370 of volume fa6ba3ca-1cc2-42e4-b5fa-1fb333ef4d77 {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 16:06:04 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-1517a1ce-c50c-4a8a-9122-42648f8deefc tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] snapshot_file for this snap is: volume-fa6ba3ca-1cc2-42e4-b5fa-1fb333ef4d77.14caca6f-a85e-402a-9cbe-0de8449a8370 {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 16:06:04 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[5632966c-f58a-465d-b7d6-b504dd6cc424]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:06:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-1517a1ce-c50c-4a8a-9122-42648f8deefc tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-fa6ba3ca-1cc2-42e4-b5fa-1fb333ef4d77.14caca6f-a85e-402a-9cbe-0de8449a8370 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:05 devstack sudo[102388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.4e968a7c-3296-40bb-a468-b8e0bee026c9 Aug 10 16:06:05 devstack sudo[102388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:05 devstack sudo[102389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-fa6ba3ca-1cc2-42e4-b5fa-1fb333ef4d77.14caca6f-a85e-402a-9cbe-0de8449a8370 Aug 10 16:06:05 devstack sudo[102389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:05 devstack sudo[102388]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:05 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-3bfe1803-ff5d-4199-a9be-d9227fe48523 tempest-SnapshotsActionsTest-563371099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.4e968a7c-3296-40bb-a468-b8e0bee026c9" returned: 0 in 0.403s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:05 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-3bfe1803-ff5d-4199-a9be-d9227fe48523 tempest-SnapshotsActionsTest-563371099 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 16:06:05 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-3bfe1803-ff5d-4199-a9be-d9227fe48523 tempest-SnapshotsActionsTest-563371099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.4e968a7c-3296-40bb-a468-b8e0bee026c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.33b4879d-3260-49af-a599-e1f6b0389688 1G {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:05 devstack sudo[102397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.4e968a7c-3296-40bb-a468-b8e0bee026c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.33b4879d-3260-49af-a599-e1f6b0389688 1G Aug 10 16:06:05 devstack sudo[102397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:05 devstack sudo[102389]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:05 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-1517a1ce-c50c-4a8a-9122-42648f8deefc tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-fa6ba3ca-1cc2-42e4-b5fa-1fb333ef4d77.14caca6f-a85e-402a-9cbe-0de8449a8370" returned: 0 in 0.409s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:05 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-1517a1ce-c50c-4a8a-9122-42648f8deefc tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa6ba3ca-1cc2-42e4-b5fa-1fb333ef4d77(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 16:06:05 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[91df94e3-1d59-4c8e-83ad-17b81f99088c]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:06:05 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-1517a1ce-c50c-4a8a-9122-42648f8deefc tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-fa6ba3ca-1cc2-42e4-b5fa-1fb333ef4d77 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:05 devstack sudo[102407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-fa6ba3ca-1cc2-42e4-b5fa-1fb333ef4d77 Aug 10 16:06:05 devstack sudo[102407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:05 devstack sudo[102397]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:05 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-3bfe1803-ff5d-4199-a9be-d9227fe48523 tempest-SnapshotsActionsTest-563371099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.4e968a7c-3296-40bb-a468-b8e0bee026c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.33b4879d-3260-49af-a599-e1f6b0389688 1G" returned: 0 in 0.499s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:05 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-3bfe1803-ff5d-4199-a9be-d9227fe48523 tempest-SnapshotsActionsTest-563371099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.4e968a7c-3296-40bb-a468-b8e0bee026c9 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.33b4879d-3260-49af-a599-e1f6b0389688 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:05 devstack sudo[102415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.4e968a7c-3296-40bb-a468-b8e0bee026c9 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.33b4879d-3260-49af-a599-e1f6b0389688 Aug 10 16:06:05 devstack sudo[102415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:05 devstack sudo[102407]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:05 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-1517a1ce-c50c-4a8a-9122-42648f8deefc tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-fa6ba3ca-1cc2-42e4-b5fa-1fb333ef4d77" returned: 0 in 0.466s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:05 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-1517a1ce-c50c-4a8a-9122-42648f8deefc tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-fa6ba3ca-1cc2-42e4-b5fa-1fb333ef4d77.14caca6f-a85e-402a-9cbe-0de8449a8370 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:05 devstack sudo[102419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-fa6ba3ca-1cc2-42e4-b5fa-1fb333ef4d77.14caca6f-a85e-402a-9cbe-0de8449a8370 Aug 10 16:06:05 devstack sudo[102419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:06 devstack sudo[102415]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:06 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-3bfe1803-ff5d-4199-a9be-d9227fe48523 tempest-SnapshotsActionsTest-563371099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.4e968a7c-3296-40bb-a468-b8e0bee026c9 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.33b4879d-3260-49af-a599-e1f6b0389688" returned: 0 in 0.361s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:06 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-3bfe1803-ff5d-4199-a9be-d9227fe48523 tempest-SnapshotsActionsTest-563371099 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.33b4879d-3260-49af-a599-e1f6b0389688 is being set with open permissions: ugo+rw Aug 10 16:06:06 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-3bfe1803-ff5d-4199-a9be-d9227fe48523 tempest-SnapshotsActionsTest-563371099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.33b4879d-3260-49af-a599-e1f6b0389688 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:06 devstack sudo[102426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.33b4879d-3260-49af-a599-e1f6b0389688 Aug 10 16:06:06 devstack sudo[102426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:06 devstack sudo[102419]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:06 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-1517a1ce-c50c-4a8a-9122-42648f8deefc tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-fa6ba3ca-1cc2-42e4-b5fa-1fb333ef4d77.14caca6f-a85e-402a-9cbe-0de8449a8370" returned: 0 in 0.410s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:06 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-1517a1ce-c50c-4a8a-9122-42648f8deefc tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-fa6ba3ca-1cc2-42e4-b5fa-1fb333ef4d77.14caca6f-a85e-402a-9cbe-0de8449a8370 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:06 devstack sudo[102430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-fa6ba3ca-1cc2-42e4-b5fa-1fb333ef4d77.14caca6f-a85e-402a-9cbe-0de8449a8370 Aug 10 16:06:06 devstack sudo[102430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:06 devstack sudo[102426]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:06 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-3bfe1803-ff5d-4199-a9be-d9227fe48523 tempest-SnapshotsActionsTest-563371099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.33b4879d-3260-49af-a599-e1f6b0389688" returned: 0 in 0.286s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:06 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-3bfe1803-ff5d-4199-a9be-d9227fe48523 tempest-SnapshotsActionsTest-563371099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.681s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:06:06 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-3bfe1803-ff5d-4199-a9be-d9227fe48523 tempest-SnapshotsActionsTest-563371099 None] Create snapshot completed successfully Aug 10 16:06:06 devstack sudo[102430]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:06 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-1517a1ce-c50c-4a8a-9122-42648f8deefc tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-fa6ba3ca-1cc2-42e4-b5fa-1fb333ef4d77.14caca6f-a85e-402a-9cbe-0de8449a8370" returned: 0 in 0.278s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:06 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-1517a1ce-c50c-4a8a-9122-42648f8deefc tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] Lock "cinder-quobyte-14caca6f-a85e-402a-9cbe-0de8449a8370" released by "_delete_snapshot" :: held 1.692s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:06:06 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-1517a1ce-c50c-4a8a-9122-42648f8deefc tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] Lock "cinder-quobyte-fa6ba3ca-1cc2-42e4-b5fa-1fb333ef4d77" released by "delete_snapshot" :: held 1.718s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:06:06 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-1517a1ce-c50c-4a8a-9122-42648f8deefc tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] Created reservations ['357bddab-bac1-4dc2-a06c-bdf6e63f685f', 'f0e7043f-b0e7-40ea-a973-72e431d5ebd9', '274c6518-249e-4524-ad6b-0a9a86a3fef0', '3bd568d3-f263-416a-a923-54ee4d7f80a8'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:06:06 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-1517a1ce-c50c-4a8a-9122-42648f8deefc tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] Delete snapshot completed successfully. Aug 10 16:06:06 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-1517a1ce-c50c-4a8a-9122-42648f8deefc tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] Lock "cinder-14caca6f-a85e-402a-9cbe-0de8449a8370-delete_snapshot" released by "delete_snapshot" :: held 1.878s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:06:07 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-79944fdd-3b38-4c21-9f77-4668df7bd06a tempest-SnapshotsActionsTest-1239710851 None] Acquiring lock "cinder-33b4879d-3260-49af-a599-e1f6b0389688-delete_snapshot" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:06:07 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-79944fdd-3b38-4c21-9f77-4668df7bd06a tempest-SnapshotsActionsTest-1239710851 None] Lock "cinder-33b4879d-3260-49af-a599-e1f6b0389688-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:06:07 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-79944fdd-3b38-4c21-9f77-4668df7bd06a tempest-SnapshotsActionsTest-1239710851 None] Acquiring lock "cinder-quobyte-a1d127d8-4b1f-4309-9b71-98698e5dae7a" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:06:07 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-79944fdd-3b38-4c21-9f77-4668df7bd06a tempest-SnapshotsActionsTest-1239710851 None] Lock "cinder-quobyte-a1d127d8-4b1f-4309-9b71-98698e5dae7a" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:06:07 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-79944fdd-3b38-4c21-9f77-4668df7bd06a tempest-SnapshotsActionsTest-1239710851 None] Acquiring lock "cinder-quobyte-33b4879d-3260-49af-a599-e1f6b0389688" by "_delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:06:07 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-de96467e-cfb3-4315-bb94-c9b63b8b9dfe tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] Acquiring lock "cinder-fa6ba3ca-1cc2-42e4-b5fa-1fb333ef4d77-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:06:07 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-79944fdd-3b38-4c21-9f77-4668df7bd06a tempest-SnapshotsActionsTest-1239710851 None] Lock "cinder-quobyte-33b4879d-3260-49af-a599-e1f6b0389688" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:06:07 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-79944fdd-3b38-4c21-9f77-4668df7bd06a tempest-SnapshotsActionsTest-1239710851 None] Deleting offline snapshot 33b4879d-3260-49af-a599-e1f6b0389688 of volume a1d127d8-4b1f-4309-9b71-98698e5dae7a {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 16:06:07 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-79944fdd-3b38-4c21-9f77-4668df7bd06a tempest-SnapshotsActionsTest-1239710851 None] snapshot_file for this snap is: volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.33b4879d-3260-49af-a599-e1f6b0389688 {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 16:06:07 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-de96467e-cfb3-4315-bb94-c9b63b8b9dfe tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] Lock "cinder-fa6ba3ca-1cc2-42e4-b5fa-1fb333ef4d77-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:06:07 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[932dc70b-33c6-4e33-9b9b-08f97bd9c576]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:06:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-79944fdd-3b38-4c21-9f77-4668df7bd06a tempest-SnapshotsActionsTest-1239710851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.33b4879d-3260-49af-a599-e1f6b0389688 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:07 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-de96467e-cfb3-4315-bb94-c9b63b8b9dfe tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] Acquiring lock "cinder-quobyte-fa6ba3ca-1cc2-42e4-b5fa-1fb333ef4d77" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:06:07 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-de96467e-cfb3-4315-bb94-c9b63b8b9dfe tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] Lock "cinder-quobyte-fa6ba3ca-1cc2-42e4-b5fa-1fb333ef4d77" acquired by "delete_volume" :: waited 0.020s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:06:07 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ad0050-49b4-4ad1-bc2b-fbb1d9850ff0]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:06:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-de96467e-cfb3-4315-bb94-c9b63b8b9dfe tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-fa6ba3ca-1cc2-42e4-b5fa-1fb333ef4d77 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:07 devstack sudo[102434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.33b4879d-3260-49af-a599-e1f6b0389688 Aug 10 16:06:07 devstack sudo[102434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:07 devstack sudo[102436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-fa6ba3ca-1cc2-42e4-b5fa-1fb333ef4d77 Aug 10 16:06:07 devstack sudo[102436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:07 devstack sudo[102434]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-79944fdd-3b38-4c21-9f77-4668df7bd06a tempest-SnapshotsActionsTest-1239710851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.33b4879d-3260-49af-a599-e1f6b0389688" returned: 0 in 0.410s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:07 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-79944fdd-3b38-4c21-9f77-4668df7bd06a tempest-SnapshotsActionsTest-1239710851 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 16:06:07 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b8fbe1-f931-4fcc-bffa-a7233ab02921]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:06:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-79944fdd-3b38-4c21-9f77-4668df7bd06a tempest-SnapshotsActionsTest-1239710851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.4e968a7c-3296-40bb-a468-b8e0bee026c9 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:07 devstack sudo[102436]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-de96467e-cfb3-4315-bb94-c9b63b8b9dfe tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-fa6ba3ca-1cc2-42e4-b5fa-1fb333ef4d77" returned: 0 in 0.421s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-de96467e-cfb3-4315-bb94-c9b63b8b9dfe tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-fa6ba3ca-1cc2-42e4-b5fa-1fb333ef4d77 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:07 devstack sudo[102446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-fa6ba3ca-1cc2-42e4-b5fa-1fb333ef4d77 Aug 10 16:06:07 devstack sudo[102446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:07 devstack sudo[102444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.4e968a7c-3296-40bb-a468-b8e0bee026c9 Aug 10 16:06:07 devstack sudo[102444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:07 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-58f10d41-8903-4064-aecf-d5e568f9631b tempest-CreateVolumesFromSnapshotTest-432970862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:06:07 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-58f10d41-8903-4064-aecf-d5e568f9631b tempest-CreateVolumesFromSnapshotTest-432970862 None] Flow 'volume_create_manager' (cfcb2da5-2e72-4083-a9bd-27021dd4613c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:06:07 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-58f10d41-8903-4064-aecf-d5e568f9631b tempest-CreateVolumesFromSnapshotTest-432970862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (215dcbc7-2e8f-4160-9083-ee344b38e754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:06:07 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-58f10d41-8903-4064-aecf-d5e568f9631b tempest-CreateVolumesFromSnapshotTest-432970862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (215dcbc7-2e8f-4160-9083-ee344b38e754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:06:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-868502032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=059752c8-e711-4af3-853c-aa8a3385f4a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1daf45bb02544a5288c8946ce028f200',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:06:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:06:08Z,use_quota=True,user_id='0ce77c6415aa405bab2501e2913943dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:06:07 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-58f10d41-8903-4064-aecf-d5e568f9631b tempest-CreateVolumesFromSnapshotTest-432970862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df4f91a0-201c-40d0-8072-0e5664b94f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:06:07 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-58f10d41-8903-4064-aecf-d5e568f9631b tempest-CreateVolumesFromSnapshotTest-432970862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df4f91a0-201c-40d0-8072-0e5664b94f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:06:07 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-58f10d41-8903-4064-aecf-d5e568f9631b tempest-CreateVolumesFromSnapshotTest-432970862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e33f0145-b1be-47cd-a234-e79766443131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:06:07 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-58f10d41-8903-4064-aecf-d5e568f9631b tempest-CreateVolumesFromSnapshotTest-432970862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e33f0145-b1be-47cd-a234-e79766443131) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '059752c8-e711-4af3-853c-aa8a3385f4a6', 'volume_name': 'volume-059752c8-e711-4af3-853c-aa8a3385f4a6', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:06:07 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-58f10d41-8903-4064-aecf-d5e568f9631b tempest-CreateVolumesFromSnapshotTest-432970862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b684d4e-a7e1-4479-af94-f309ba724d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:06:07 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-58f10d41-8903-4064-aecf-d5e568f9631b tempest-CreateVolumesFromSnapshotTest-432970862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b684d4e-a7e1-4479-af94-f309ba724d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:06:07 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-58f10d41-8903-4064-aecf-d5e568f9631b tempest-CreateVolumesFromSnapshotTest-432970862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7656b063-204d-4860-bf2a-5c18da06d07e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:06:07 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-58f10d41-8903-4064-aecf-d5e568f9631b tempest-CreateVolumesFromSnapshotTest-432970862 None] Volume 059752c8-e711-4af3-853c-aa8a3385f4a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-059752c8-e711-4af3-853c-aa8a3385f4a6', 'volume_size': 1} Aug 10 16:06:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-58f10d41-8903-4064-aecf-d5e568f9631b tempest-CreateVolumesFromSnapshotTest-432970862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:06:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-58f10d41-8903-4064-aecf-d5e568f9631b tempest-CreateVolumesFromSnapshotTest-432970862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:06:07 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-58f10d41-8903-4064-aecf-d5e568f9631b tempest-CreateVolumesFromSnapshotTest-432970862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:06:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-868502032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=059752c8-e711-4af3-853c-aa8a3385f4a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1daf45bb02544a5288c8946ce028f200',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:06:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:06:08Z,use_quota=True,user_id='0ce77c6415aa405bab2501e2913943dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:06:07 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-58f10d41-8903-4064-aecf-d5e568f9631b tempest-CreateVolumesFromSnapshotTest-432970862 None] Creating volume 059752c8-e711-4af3-853c-aa8a3385f4a6 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:06:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-58f10d41-8903-4064-aecf-d5e568f9631b tempest-CreateVolumesFromSnapshotTest-432970862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:06:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-58f10d41-8903-4064-aecf-d5e568f9631b tempest-CreateVolumesFromSnapshotTest-432970862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:06:07 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-58f10d41-8903-4064-aecf-d5e568f9631b tempest-CreateVolumesFromSnapshotTest-432970862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:06:07 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-58f10d41-8903-4064-aecf-d5e568f9631b tempest-CreateVolumesFromSnapshotTest-432970862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:06:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-58f10d41-8903-4064-aecf-d5e568f9631b tempest-CreateVolumesFromSnapshotTest-432970862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:06:07 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-58f10d41-8903-4064-aecf-d5e568f9631b tempest-CreateVolumesFromSnapshotTest-432970862 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:06:07 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-58f10d41-8903-4064-aecf-d5e568f9631b tempest-CreateVolumesFromSnapshotTest-432970862 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:06:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-58f10d41-8903-4064-aecf-d5e568f9631b tempest-CreateVolumesFromSnapshotTest-432970862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-059752c8-e711-4af3-853c-aa8a3385f4a6 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:07 devstack sudo[102449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-059752c8-e711-4af3-853c-aa8a3385f4a6 1073741824 Aug 10 16:06:07 devstack sudo[102449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:08 devstack sudo[102446]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-de96467e-cfb3-4315-bb94-c9b63b8b9dfe tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-fa6ba3ca-1cc2-42e4-b5fa-1fb333ef4d77" returned: 0 in 0.281s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:08 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-de96467e-cfb3-4315-bb94-c9b63b8b9dfe tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] Lock "cinder-quobyte-fa6ba3ca-1cc2-42e4-b5fa-1fb333ef4d77" released by "delete_volume" :: held 0.780s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:06:08 devstack sudo[102444]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-79944fdd-3b38-4c21-9f77-4668df7bd06a tempest-SnapshotsActionsTest-1239710851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.4e968a7c-3296-40bb-a468-b8e0bee026c9" returned: 0 in 0.411s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:08 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-79944fdd-3b38-4c21-9f77-4668df7bd06a tempest-SnapshotsActionsTest-1239710851 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 16:06:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-79944fdd-3b38-4c21-9f77-4668df7bd06a tempest-SnapshotsActionsTest-1239710851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.33b4879d-3260-49af-a599-e1f6b0389688 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:08 devstack sudo[102455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.33b4879d-3260-49af-a599-e1f6b0389688 Aug 10 16:06:08 devstack sudo[102455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:08 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-de96467e-cfb3-4315-bb94-c9b63b8b9dfe tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] Created reservations ['cd240ff2-1264-44d3-8885-26ebb70b6d7b', '14430574-4ed7-47aa-a8ec-5d3ea6c9c6c3', '1f45fcb8-287c-4e71-87f7-193839df0799', 'a1ed13d8-bdf5-4160-b812-99394fcc1643'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:06:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-de96467e-cfb3-4315-bb94-c9b63b8b9dfe tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:06:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-de96467e-cfb3-4315-bb94-c9b63b8b9dfe tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:06:08 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-de96467e-cfb3-4315-bb94-c9b63b8b9dfe tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:06:08 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-de96467e-cfb3-4315-bb94-c9b63b8b9dfe tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:06:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-de96467e-cfb3-4315-bb94-c9b63b8b9dfe tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:06:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-de96467e-cfb3-4315-bb94-c9b63b8b9dfe tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:08 devstack sudo[102459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:06:08 devstack sudo[102459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:08 devstack sudo[102449]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-58f10d41-8903-4064-aecf-d5e568f9631b tempest-CreateVolumesFromSnapshotTest-432970862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-059752c8-e711-4af3-853c-aa8a3385f4a6 1073741824" returned: 0 in 0.513s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:08 devstack sudo[102459]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-de96467e-cfb3-4315-bb94-c9b63b8b9dfe tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.279s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:08 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-de96467e-cfb3-4315-bb94-c9b63b8b9dfe tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:06:08 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-de96467e-cfb3-4315-bb94-c9b63b8b9dfe tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] Deleted volume successfully. Aug 10 16:06:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-58f10d41-8903-4064-aecf-d5e568f9631b tempest-CreateVolumesFromSnapshotTest-432970862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-059752c8-e711-4af3-853c-aa8a3385f4a6 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:08 devstack sudo[102466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-059752c8-e711-4af3-853c-aa8a3385f4a6 Aug 10 16:06:08 devstack sudo[102466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:08 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-de96467e-cfb3-4315-bb94-c9b63b8b9dfe tempest-VolumesSnapshotNegativeTestJSON-1058443379 None] Lock "cinder-fa6ba3ca-1cc2-42e4-b5fa-1fb333ef4d77-delete_volume" released by "delete_volume" :: held 1.350s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:06:08 devstack sudo[102455]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-79944fdd-3b38-4c21-9f77-4668df7bd06a tempest-SnapshotsActionsTest-1239710851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.33b4879d-3260-49af-a599-e1f6b0389688" returned: 0 in 0.495s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-79944fdd-3b38-4c21-9f77-4668df7bd06a tempest-SnapshotsActionsTest-1239710851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.33b4879d-3260-49af-a599-e1f6b0389688 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:08 devstack sudo[102468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.33b4879d-3260-49af-a599-e1f6b0389688 Aug 10 16:06:08 devstack sudo[102468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:08 devstack sudo[102466]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-58f10d41-8903-4064-aecf-d5e568f9631b tempest-CreateVolumesFromSnapshotTest-432970862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-059752c8-e711-4af3-853c-aa8a3385f4a6" returned: 0 in 0.300s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:08 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-58f10d41-8903-4064-aecf-d5e568f9631b tempest-CreateVolumesFromSnapshotTest-432970862 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:06:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-58f10d41-8903-4064-aecf-d5e568f9631b tempest-CreateVolumesFromSnapshotTest-432970862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:06:08 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-58f10d41-8903-4064-aecf-d5e568f9631b tempest-CreateVolumesFromSnapshotTest-432970862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7656b063-204d-4860-bf2a-5c18da06d07e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-059752c8-e711-4af3-853c-aa8a3385f4a6', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:06:08 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-58f10d41-8903-4064-aecf-d5e568f9631b tempest-CreateVolumesFromSnapshotTest-432970862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a81a733e-74d8-41fc-a04a-e38195c86707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:06:08 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-58f10d41-8903-4064-aecf-d5e568f9631b tempest-CreateVolumesFromSnapshotTest-432970862 None] Volume volume-059752c8-e711-4af3-853c-aa8a3385f4a6 (059752c8-e711-4af3-853c-aa8a3385f4a6): created successfully Aug 10 16:06:08 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-58f10d41-8903-4064-aecf-d5e568f9631b tempest-CreateVolumesFromSnapshotTest-432970862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a81a733e-74d8-41fc-a04a-e38195c86707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:06:08 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-58f10d41-8903-4064-aecf-d5e568f9631b tempest-CreateVolumesFromSnapshotTest-432970862 None] Flow 'volume_create_manager' (cfcb2da5-2e72-4083-a9bd-27021dd4613c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:06:08 devstack sudo[102468]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-79944fdd-3b38-4c21-9f77-4668df7bd06a tempest-SnapshotsActionsTest-1239710851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.33b4879d-3260-49af-a599-e1f6b0389688" returned: 0 in 0.297s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:08 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-58f10d41-8903-4064-aecf-d5e568f9631b tempest-CreateVolumesFromSnapshotTest-432970862 None] Created volume successfully. Aug 10 16:06:08 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-79944fdd-3b38-4c21-9f77-4668df7bd06a tempest-SnapshotsActionsTest-1239710851 None] Lock "cinder-quobyte-33b4879d-3260-49af-a599-e1f6b0389688" released by "_delete_snapshot" :: held 1.764s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:06:08 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-79944fdd-3b38-4c21-9f77-4668df7bd06a tempest-SnapshotsActionsTest-1239710851 None] Lock "cinder-quobyte-a1d127d8-4b1f-4309-9b71-98698e5dae7a" released by "delete_snapshot" :: held 1.807s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:06:08 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-79944fdd-3b38-4c21-9f77-4668df7bd06a tempest-SnapshotsActionsTest-1239710851 None] Created reservations ['83435b92-031e-4e8d-b4c6-9640cc89a552', 'db14eb51-a4ff-418c-af0a-db3ad4492e2b', 'eb965de7-6d86-439a-935a-7147783888d4', 'fbeaa1bf-ffb8-4635-8e5d-6e232d2a70f9'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:06:09 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-79944fdd-3b38-4c21-9f77-4668df7bd06a tempest-SnapshotsActionsTest-1239710851 None] Delete snapshot completed successfully. Aug 10 16:06:09 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-79944fdd-3b38-4c21-9f77-4668df7bd06a tempest-SnapshotsActionsTest-1239710851 None] Lock "cinder-33b4879d-3260-49af-a599-e1f6b0389688-delete_snapshot" released by "delete_snapshot" :: held 1.949s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:06:09 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-d856f961-7811-456b-a12e-26bdd934f16d tempest-SnapshotsActionsTest-563371099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:06:09 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-d856f961-7811-456b-a12e-26bdd934f16d tempest-SnapshotsActionsTest-563371099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:06:09 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-d856f961-7811-456b-a12e-26bdd934f16d tempest-SnapshotsActionsTest-563371099 None] Creating offline snapshot 24ce1d4a-6542-40dc-8e7b-4ff1004a4c0c of volume a1d127d8-4b1f-4309-9b71-98698e5dae7a {{(pid=88641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 16:06:09 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[292db0ae-ec97-486b-a631-5980b80fbc6a]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:06:09 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d856f961-7811-456b-a12e-26bdd934f16d tempest-SnapshotsActionsTest-563371099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.4e968a7c-3296-40bb-a468-b8e0bee026c9 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:09 devstack sudo[102472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.4e968a7c-3296-40bb-a468-b8e0bee026c9 Aug 10 16:06:09 devstack sudo[102472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:10 devstack sudo[102472]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:10 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d856f961-7811-456b-a12e-26bdd934f16d tempest-SnapshotsActionsTest-563371099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.4e968a7c-3296-40bb-a468-b8e0bee026c9" returned: 0 in 0.413s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:10 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-d856f961-7811-456b-a12e-26bdd934f16d tempest-SnapshotsActionsTest-563371099 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 16:06:10 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d856f961-7811-456b-a12e-26bdd934f16d tempest-SnapshotsActionsTest-563371099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.4e968a7c-3296-40bb-a468-b8e0bee026c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.24ce1d4a-6542-40dc-8e7b-4ff1004a4c0c 1G {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:10 devstack sudo[102477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.4e968a7c-3296-40bb-a468-b8e0bee026c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.24ce1d4a-6542-40dc-8e7b-4ff1004a4c0c 1G Aug 10 16:06:10 devstack sudo[102477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:10 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-b4f8f150-b3e7-4307-825a-d2fdaac8f643 tempest-CreateVolumesFromSnapshotTest-432970862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:06:10 devstack sudo[102477]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:10 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d856f961-7811-456b-a12e-26bdd934f16d tempest-SnapshotsActionsTest-563371099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.4e968a7c-3296-40bb-a468-b8e0bee026c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.24ce1d4a-6542-40dc-8e7b-4ff1004a4c0c 1G" returned: 0 in 0.459s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:10 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d856f961-7811-456b-a12e-26bdd934f16d tempest-SnapshotsActionsTest-563371099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.4e968a7c-3296-40bb-a468-b8e0bee026c9 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.24ce1d4a-6542-40dc-8e7b-4ff1004a4c0c {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:10 devstack sudo[102483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.4e968a7c-3296-40bb-a468-b8e0bee026c9 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.24ce1d4a-6542-40dc-8e7b-4ff1004a4c0c Aug 10 16:06:10 devstack sudo[102483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:10 devstack sudo[102483]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:10 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d856f961-7811-456b-a12e-26bdd934f16d tempest-SnapshotsActionsTest-563371099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.4e968a7c-3296-40bb-a468-b8e0bee026c9 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.24ce1d4a-6542-40dc-8e7b-4ff1004a4c0c" returned: 0 in 0.304s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:10 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-d856f961-7811-456b-a12e-26bdd934f16d tempest-SnapshotsActionsTest-563371099 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.24ce1d4a-6542-40dc-8e7b-4ff1004a4c0c is being set with open permissions: ugo+rw Aug 10 16:06:10 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d856f961-7811-456b-a12e-26bdd934f16d tempest-SnapshotsActionsTest-563371099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.24ce1d4a-6542-40dc-8e7b-4ff1004a4c0c {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:10 devstack sudo[102488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.24ce1d4a-6542-40dc-8e7b-4ff1004a4c0c Aug 10 16:06:10 devstack sudo[102488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:11 devstack sudo[102488]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d856f961-7811-456b-a12e-26bdd934f16d tempest-SnapshotsActionsTest-563371099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.24ce1d4a-6542-40dc-8e7b-4ff1004a4c0c" returned: 0 in 0.276s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:11 devstack cinder-volume[88641]: DEBUG dbcounter [-] [88641] Writing DB stats cinder:UPDATE=162,cinder:DELETE=11,cinder:SELECT=128,cinder:INSERT=39 {{(pid=88641) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 16:06:11 devstack cinder-volume[88641]: DEBUG dbcounter [-] [88641] Writing DB stats cinder:SELECT=138,cinder:INSERT=51,cinder:UPDATE=157,cinder:DELETE=13 {{(pid=88641) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 16:06:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-d856f961-7811-456b-a12e-26bdd934f16d tempest-SnapshotsActionsTest-563371099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.580s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:06:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-b4f8f150-b3e7-4307-825a-d2fdaac8f643 tempest-CreateVolumesFromSnapshotTest-432970862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.002s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:06:11 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-b4f8f150-b3e7-4307-825a-d2fdaac8f643 tempest-CreateVolumesFromSnapshotTest-432970862 None] Creating offline snapshot c92f0af2-c929-41d5-87be-26061ca70216 of volume 059752c8-e711-4af3-853c-aa8a3385f4a6 {{(pid=88641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 16:06:11 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-d856f961-7811-456b-a12e-26bdd934f16d tempest-SnapshotsActionsTest-563371099 None] Create snapshot completed successfully Aug 10 16:06:11 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[74efff05-d2b6-4e66-8dcd-ceba96e03d8b]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:06:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b4f8f150-b3e7-4307-825a-d2fdaac8f643 tempest-CreateVolumesFromSnapshotTest-432970862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-059752c8-e711-4af3-853c-aa8a3385f4a6 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:11 devstack sudo[102491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-059752c8-e711-4af3-853c-aa8a3385f4a6 Aug 10 16:06:11 devstack sudo[102491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:11 devstack sudo[102491]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b4f8f150-b3e7-4307-825a-d2fdaac8f643 tempest-CreateVolumesFromSnapshotTest-432970862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-059752c8-e711-4af3-853c-aa8a3385f4a6" returned: 0 in 0.398s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b4f8f150-b3e7-4307-825a-d2fdaac8f643 tempest-CreateVolumesFromSnapshotTest-432970862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-059752c8-e711-4af3-853c-aa8a3385f4a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-059752c8-e711-4af3-853c-aa8a3385f4a6.c92f0af2-c929-41d5-87be-26061ca70216 1G {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:11 devstack sudo[102496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-059752c8-e711-4af3-853c-aa8a3385f4a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-059752c8-e711-4af3-853c-aa8a3385f4a6.c92f0af2-c929-41d5-87be-26061ca70216 1G Aug 10 16:06:11 devstack sudo[102496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:11 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-a10d186c-1c3a-495d-b62a-6dc98142ba7c tempest-SnapshotsActionsTest-1239710851 None] Acquiring lock "cinder-24ce1d4a-6542-40dc-8e7b-4ff1004a4c0c-delete_snapshot" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:06:11 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-a10d186c-1c3a-495d-b62a-6dc98142ba7c tempest-SnapshotsActionsTest-1239710851 None] Lock "cinder-24ce1d4a-6542-40dc-8e7b-4ff1004a4c0c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:06:11 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-a10d186c-1c3a-495d-b62a-6dc98142ba7c tempest-SnapshotsActionsTest-1239710851 None] Acquiring lock "cinder-quobyte-a1d127d8-4b1f-4309-9b71-98698e5dae7a" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:06:11 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-a10d186c-1c3a-495d-b62a-6dc98142ba7c tempest-SnapshotsActionsTest-1239710851 None] Lock "cinder-quobyte-a1d127d8-4b1f-4309-9b71-98698e5dae7a" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:06:11 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-a10d186c-1c3a-495d-b62a-6dc98142ba7c tempest-SnapshotsActionsTest-1239710851 None] Acquiring lock "cinder-quobyte-24ce1d4a-6542-40dc-8e7b-4ff1004a4c0c" by "_delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:06:11 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-a10d186c-1c3a-495d-b62a-6dc98142ba7c tempest-SnapshotsActionsTest-1239710851 None] Lock "cinder-quobyte-24ce1d4a-6542-40dc-8e7b-4ff1004a4c0c" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:06:11 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-a10d186c-1c3a-495d-b62a-6dc98142ba7c tempest-SnapshotsActionsTest-1239710851 None] Deleting offline snapshot 24ce1d4a-6542-40dc-8e7b-4ff1004a4c0c of volume a1d127d8-4b1f-4309-9b71-98698e5dae7a {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 16:06:11 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-a10d186c-1c3a-495d-b62a-6dc98142ba7c tempest-SnapshotsActionsTest-1239710851 None] snapshot_file for this snap is: volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.24ce1d4a-6542-40dc-8e7b-4ff1004a4c0c {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 16:06:11 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5bcaf80-b91b-4aa5-8074-863944ecdc39]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:06:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a10d186c-1c3a-495d-b62a-6dc98142ba7c tempest-SnapshotsActionsTest-1239710851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.24ce1d4a-6542-40dc-8e7b-4ff1004a4c0c {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:12 devstack sudo[102501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.24ce1d4a-6542-40dc-8e7b-4ff1004a4c0c Aug 10 16:06:12 devstack sudo[102501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:12 devstack sudo[102496]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:12 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b4f8f150-b3e7-4307-825a-d2fdaac8f643 tempest-CreateVolumesFromSnapshotTest-432970862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-059752c8-e711-4af3-853c-aa8a3385f4a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-059752c8-e711-4af3-853c-aa8a3385f4a6.c92f0af2-c929-41d5-87be-26061ca70216 1G" returned: 0 in 0.524s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:12 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b4f8f150-b3e7-4307-825a-d2fdaac8f643 tempest-CreateVolumesFromSnapshotTest-432970862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-059752c8-e711-4af3-853c-aa8a3385f4a6 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-059752c8-e711-4af3-853c-aa8a3385f4a6.c92f0af2-c929-41d5-87be-26061ca70216 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:12 devstack sudo[102505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-059752c8-e711-4af3-853c-aa8a3385f4a6 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-059752c8-e711-4af3-853c-aa8a3385f4a6.c92f0af2-c929-41d5-87be-26061ca70216 Aug 10 16:06:12 devstack sudo[102505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:12 devstack sudo[102501]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:12 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a10d186c-1c3a-495d-b62a-6dc98142ba7c tempest-SnapshotsActionsTest-1239710851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.24ce1d4a-6542-40dc-8e7b-4ff1004a4c0c" returned: 0 in 0.388s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:12 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-a10d186c-1c3a-495d-b62a-6dc98142ba7c tempest-SnapshotsActionsTest-1239710851 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 16:06:12 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e7d3e3b-eed0-4a0e-9d97-f260f9002c30]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:06:12 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a10d186c-1c3a-495d-b62a-6dc98142ba7c tempest-SnapshotsActionsTest-1239710851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.4e968a7c-3296-40bb-a468-b8e0bee026c9 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:12 devstack sudo[102505]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:12 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b4f8f150-b3e7-4307-825a-d2fdaac8f643 tempest-CreateVolumesFromSnapshotTest-432970862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-059752c8-e711-4af3-853c-aa8a3385f4a6 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-059752c8-e711-4af3-853c-aa8a3385f4a6.c92f0af2-c929-41d5-87be-26061ca70216" returned: 0 in 0.334s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:12 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-b4f8f150-b3e7-4307-825a-d2fdaac8f643 tempest-CreateVolumesFromSnapshotTest-432970862 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-059752c8-e711-4af3-853c-aa8a3385f4a6.c92f0af2-c929-41d5-87be-26061ca70216 is being set with open permissions: ugo+rw Aug 10 16:06:12 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b4f8f150-b3e7-4307-825a-d2fdaac8f643 tempest-CreateVolumesFromSnapshotTest-432970862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-059752c8-e711-4af3-853c-aa8a3385f4a6.c92f0af2-c929-41d5-87be-26061ca70216 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:12 devstack sudo[102515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-059752c8-e711-4af3-853c-aa8a3385f4a6.c92f0af2-c929-41d5-87be-26061ca70216 Aug 10 16:06:12 devstack sudo[102515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:12 devstack sudo[102514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.4e968a7c-3296-40bb-a468-b8e0bee026c9 Aug 10 16:06:12 devstack sudo[102514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:12 devstack sudo[102515]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:12 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b4f8f150-b3e7-4307-825a-d2fdaac8f643 tempest-CreateVolumesFromSnapshotTest-432970862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-059752c8-e711-4af3-853c-aa8a3385f4a6.c92f0af2-c929-41d5-87be-26061ca70216" returned: 0 in 0.281s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:12 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b4f8f150-b3e7-4307-825a-d2fdaac8f643 tempest-CreateVolumesFromSnapshotTest-432970862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-059752c8-e711-4af3-853c-aa8a3385f4a6.info {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:12 devstack sudo[102514]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:12 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a10d186c-1c3a-495d-b62a-6dc98142ba7c tempest-SnapshotsActionsTest-1239710851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.4e968a7c-3296-40bb-a468-b8e0bee026c9" returned: 0 in 0.407s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:12 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-a10d186c-1c3a-495d-b62a-6dc98142ba7c tempest-SnapshotsActionsTest-1239710851 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 16:06:12 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a10d186c-1c3a-495d-b62a-6dc98142ba7c tempest-SnapshotsActionsTest-1239710851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.24ce1d4a-6542-40dc-8e7b-4ff1004a4c0c {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:12 devstack sudo[102524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-059752c8-e711-4af3-853c-aa8a3385f4a6.info Aug 10 16:06:12 devstack sudo[102524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:12 devstack sudo[102525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.24ce1d4a-6542-40dc-8e7b-4ff1004a4c0c Aug 10 16:06:12 devstack sudo[102525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:13 devstack sudo[102524]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:13 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b4f8f150-b3e7-4307-825a-d2fdaac8f643 tempest-CreateVolumesFromSnapshotTest-432970862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-059752c8-e711-4af3-853c-aa8a3385f4a6.info" returned: 0 in 0.277s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:13 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-b4f8f150-b3e7-4307-825a-d2fdaac8f643 tempest-CreateVolumesFromSnapshotTest-432970862 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-059752c8-e711-4af3-853c-aa8a3385f4a6.info is being set with open permissions: ugo+rw Aug 10 16:06:13 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b4f8f150-b3e7-4307-825a-d2fdaac8f643 tempest-CreateVolumesFromSnapshotTest-432970862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-059752c8-e711-4af3-853c-aa8a3385f4a6.info {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:13 devstack sudo[102532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-059752c8-e711-4af3-853c-aa8a3385f4a6.info Aug 10 16:06:13 devstack sudo[102532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:13 devstack sudo[102525]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:13 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a10d186c-1c3a-495d-b62a-6dc98142ba7c tempest-SnapshotsActionsTest-1239710851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.24ce1d4a-6542-40dc-8e7b-4ff1004a4c0c" returned: 0 in 0.436s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:13 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a10d186c-1c3a-495d-b62a-6dc98142ba7c tempest-SnapshotsActionsTest-1239710851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.24ce1d4a-6542-40dc-8e7b-4ff1004a4c0c {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:13 devstack sudo[102535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.24ce1d4a-6542-40dc-8e7b-4ff1004a4c0c Aug 10 16:06:13 devstack sudo[102535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:13 devstack sudo[102532]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:13 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b4f8f150-b3e7-4307-825a-d2fdaac8f643 tempest-CreateVolumesFromSnapshotTest-432970862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-059752c8-e711-4af3-853c-aa8a3385f4a6.info" returned: 0 in 0.270s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:13 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-b4f8f150-b3e7-4307-825a-d2fdaac8f643 tempest-CreateVolumesFromSnapshotTest-432970862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.208s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:06:13 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-b4f8f150-b3e7-4307-825a-d2fdaac8f643 tempest-CreateVolumesFromSnapshotTest-432970862 None] Create snapshot completed successfully Aug 10 16:06:13 devstack sudo[102535]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:13 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a10d186c-1c3a-495d-b62a-6dc98142ba7c tempest-SnapshotsActionsTest-1239710851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.24ce1d4a-6542-40dc-8e7b-4ff1004a4c0c" returned: 0 in 0.269s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:13 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-a10d186c-1c3a-495d-b62a-6dc98142ba7c tempest-SnapshotsActionsTest-1239710851 None] Lock "cinder-quobyte-24ce1d4a-6542-40dc-8e7b-4ff1004a4c0c" released by "_delete_snapshot" :: held 1.601s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:06:13 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-a10d186c-1c3a-495d-b62a-6dc98142ba7c tempest-SnapshotsActionsTest-1239710851 None] Lock "cinder-quobyte-a1d127d8-4b1f-4309-9b71-98698e5dae7a" released by "delete_snapshot" :: held 1.633s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:06:13 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-a10d186c-1c3a-495d-b62a-6dc98142ba7c tempest-SnapshotsActionsTest-1239710851 None] Created reservations ['092ec6fd-da30-4e2f-bf0a-c169cb6febf6', 'a91fbeb6-12e8-4341-90c4-0afbaaec96d7', 'da7248b4-16d8-4f40-86b2-ad86708fbaa9', 'e52e651d-2212-4bb1-808b-ae82301b4311'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:06:13 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-a10d186c-1c3a-495d-b62a-6dc98142ba7c tempest-SnapshotsActionsTest-1239710851 None] Delete snapshot completed successfully. Aug 10 16:06:13 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-a10d186c-1c3a-495d-b62a-6dc98142ba7c tempest-SnapshotsActionsTest-1239710851 None] Lock "cinder-24ce1d4a-6542-40dc-8e7b-4ff1004a4c0c-delete_snapshot" released by "delete_snapshot" :: held 1.804s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:06:14 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-71f90378-d4c7-4c13-a6fa-a7471a2f7f6e tempest-SnapshotsActionsTest-563371099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:06:14 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-71f90378-d4c7-4c13-a6fa-a7471a2f7f6e tempest-SnapshotsActionsTest-563371099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:06:14 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-71f90378-d4c7-4c13-a6fa-a7471a2f7f6e tempest-SnapshotsActionsTest-563371099 None] Creating offline snapshot 6aa20123-ef41-4524-b219-c827317b00a4 of volume a1d127d8-4b1f-4309-9b71-98698e5dae7a {{(pid=88641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 16:06:14 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba41375-7c44-43fe-ba3d-8f701402bd11]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:06:14 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-71f90378-d4c7-4c13-a6fa-a7471a2f7f6e tempest-SnapshotsActionsTest-563371099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.4e968a7c-3296-40bb-a468-b8e0bee026c9 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:14 devstack sudo[102539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.4e968a7c-3296-40bb-a468-b8e0bee026c9 Aug 10 16:06:14 devstack sudo[102539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:14 devstack sudo[102539]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:14 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-71f90378-d4c7-4c13-a6fa-a7471a2f7f6e tempest-SnapshotsActionsTest-563371099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.4e968a7c-3296-40bb-a468-b8e0bee026c9" returned: 0 in 0.430s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:14 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-71f90378-d4c7-4c13-a6fa-a7471a2f7f6e tempest-SnapshotsActionsTest-563371099 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 16:06:14 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-71f90378-d4c7-4c13-a6fa-a7471a2f7f6e tempest-SnapshotsActionsTest-563371099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.4e968a7c-3296-40bb-a468-b8e0bee026c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.6aa20123-ef41-4524-b219-c827317b00a4 1G {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:14 devstack sudo[102545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.4e968a7c-3296-40bb-a468-b8e0bee026c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.6aa20123-ef41-4524-b219-c827317b00a4 1G Aug 10 16:06:14 devstack sudo[102545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:14 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa75574b-feaf-4d25-ac09-5086eaff2baf tempest-CreateVolumesFromSnapshotTest-432970862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:06:14 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-aa75574b-feaf-4d25-ac09-5086eaff2baf tempest-CreateVolumesFromSnapshotTest-432970862 None] Flow 'volume_create_manager' (23399dd8-fbd5-4887-901a-6d2b83504f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:06:14 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-aa75574b-feaf-4d25-ac09-5086eaff2baf tempest-CreateVolumesFromSnapshotTest-432970862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9785de2e-3ccd-47b7-af92-4e420e144391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:06:14 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-aa75574b-feaf-4d25-ac09-5086eaff2baf tempest-CreateVolumesFromSnapshotTest-432970862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9785de2e-3ccd-47b7-af92-4e420e144391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:06:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1224271262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8a1e4a8-5650-4d83-93cb-e58885776528,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1daf45bb02544a5288c8946ce028f200',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:06:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:06:15Z,use_quota=True,user_id='0ce77c6415aa405bab2501e2913943dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:06:14 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-aa75574b-feaf-4d25-ac09-5086eaff2baf tempest-CreateVolumesFromSnapshotTest-432970862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e59a8ada-5bdb-4e18-9176-fd8bd9facd48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:06:14 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-aa75574b-feaf-4d25-ac09-5086eaff2baf tempest-CreateVolumesFromSnapshotTest-432970862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e59a8ada-5bdb-4e18-9176-fd8bd9facd48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:06:14 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-aa75574b-feaf-4d25-ac09-5086eaff2baf tempest-CreateVolumesFromSnapshotTest-432970862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (153c7d49-6932-41a1-9b7c-f70329f6dbb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:06:14 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-aa75574b-feaf-4d25-ac09-5086eaff2baf tempest-CreateVolumesFromSnapshotTest-432970862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (153c7d49-6932-41a1-9b7c-f70329f6dbb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8a1e4a8-5650-4d83-93cb-e58885776528', 'volume_name': 'volume-c8a1e4a8-5650-4d83-93cb-e58885776528', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:06:14 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-aa75574b-feaf-4d25-ac09-5086eaff2baf tempest-CreateVolumesFromSnapshotTest-432970862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f273b7d-a573-424c-a95c-9f58b91e90e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:06:14 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-aa75574b-feaf-4d25-ac09-5086eaff2baf tempest-CreateVolumesFromSnapshotTest-432970862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f273b7d-a573-424c-a95c-9f58b91e90e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:06:14 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-aa75574b-feaf-4d25-ac09-5086eaff2baf tempest-CreateVolumesFromSnapshotTest-432970862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94057420-529e-4622-9d02-721bc4981716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:06:14 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-aa75574b-feaf-4d25-ac09-5086eaff2baf tempest-CreateVolumesFromSnapshotTest-432970862 None] Volume c8a1e4a8-5650-4d83-93cb-e58885776528: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8a1e4a8-5650-4d83-93cb-e58885776528', 'volume_size': 1} Aug 10 16:06:14 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-aa75574b-feaf-4d25-ac09-5086eaff2baf tempest-CreateVolumesFromSnapshotTest-432970862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:06:15 devstack sudo[102545]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:15 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-71f90378-d4c7-4c13-a6fa-a7471a2f7f6e tempest-SnapshotsActionsTest-563371099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.4e968a7c-3296-40bb-a468-b8e0bee026c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.6aa20123-ef41-4524-b219-c827317b00a4 1G" returned: 0 in 0.492s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:15 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-71f90378-d4c7-4c13-a6fa-a7471a2f7f6e tempest-SnapshotsActionsTest-563371099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.4e968a7c-3296-40bb-a468-b8e0bee026c9 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.6aa20123-ef41-4524-b219-c827317b00a4 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:15 devstack sudo[102551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.4e968a7c-3296-40bb-a468-b8e0bee026c9 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.6aa20123-ef41-4524-b219-c827317b00a4 Aug 10 16:06:15 devstack sudo[102551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:15 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-0acf37fd-5e35-49c4-9f16-bb95e26e85f5 tempest-CreateVolumesFromSnapshotTest-432970862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:06:15 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-0acf37fd-5e35-49c4-9f16-bb95e26e85f5 tempest-CreateVolumesFromSnapshotTest-432970862 None] Flow 'volume_create_manager' (116de9af-2575-4a96-8bf4-1b0be4f005e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:06:15 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-0acf37fd-5e35-49c4-9f16-bb95e26e85f5 tempest-CreateVolumesFromSnapshotTest-432970862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f74a341a-7e97-4c5d-afe0-125bb49d203d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:06:15 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-0acf37fd-5e35-49c4-9f16-bb95e26e85f5 tempest-CreateVolumesFromSnapshotTest-432970862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f74a341a-7e97-4c5d-afe0-125bb49d203d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:06:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1461111472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea7e1a63-b2d0-42c2-af48-32710587dada,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1daf45bb02544a5288c8946ce028f200',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:06:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:06:15Z,use_quota=True,user_id='0ce77c6415aa405bab2501e2913943dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:06:15 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-0acf37fd-5e35-49c4-9f16-bb95e26e85f5 tempest-CreateVolumesFromSnapshotTest-432970862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ddd2655-20bd-4c92-9147-269aee6bac32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:06:15 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-0acf37fd-5e35-49c4-9f16-bb95e26e85f5 tempest-CreateVolumesFromSnapshotTest-432970862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ddd2655-20bd-4c92-9147-269aee6bac32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:06:15 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-0acf37fd-5e35-49c4-9f16-bb95e26e85f5 tempest-CreateVolumesFromSnapshotTest-432970862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d191cfd8-ef3c-4400-8cba-d8dbdeac7070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:06:15 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-0acf37fd-5e35-49c4-9f16-bb95e26e85f5 tempest-CreateVolumesFromSnapshotTest-432970862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d191cfd8-ef3c-4400-8cba-d8dbdeac7070) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea7e1a63-b2d0-42c2-af48-32710587dada', 'volume_name': 'volume-ea7e1a63-b2d0-42c2-af48-32710587dada', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:06:15 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-0acf37fd-5e35-49c4-9f16-bb95e26e85f5 tempest-CreateVolumesFromSnapshotTest-432970862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cb8931e-2caa-45f5-aa9f-1ca9dc5e7da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:06:15 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-0acf37fd-5e35-49c4-9f16-bb95e26e85f5 tempest-CreateVolumesFromSnapshotTest-432970862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cb8931e-2caa-45f5-aa9f-1ca9dc5e7da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:06:15 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-0acf37fd-5e35-49c4-9f16-bb95e26e85f5 tempest-CreateVolumesFromSnapshotTest-432970862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0f77fae-683c-4e6a-a6b5-34d6672063bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:06:15 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-0acf37fd-5e35-49c4-9f16-bb95e26e85f5 tempest-CreateVolumesFromSnapshotTest-432970862 None] Volume ea7e1a63-b2d0-42c2-af48-32710587dada: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea7e1a63-b2d0-42c2-af48-32710587dada', 'volume_size': 1} Aug 10 16:06:15 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-0acf37fd-5e35-49c4-9f16-bb95e26e85f5 tempest-CreateVolumesFromSnapshotTest-432970862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:06:15 devstack sudo[102551]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:15 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-71f90378-d4c7-4c13-a6fa-a7471a2f7f6e tempest-SnapshotsActionsTest-563371099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.4e968a7c-3296-40bb-a468-b8e0bee026c9 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.6aa20123-ef41-4524-b219-c827317b00a4" returned: 0 in 0.614s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:15 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-71f90378-d4c7-4c13-a6fa-a7471a2f7f6e tempest-SnapshotsActionsTest-563371099 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.6aa20123-ef41-4524-b219-c827317b00a4 is being set with open permissions: ugo+rw Aug 10 16:06:15 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-71f90378-d4c7-4c13-a6fa-a7471a2f7f6e tempest-SnapshotsActionsTest-563371099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.6aa20123-ef41-4524-b219-c827317b00a4 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:15 devstack sudo[102556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.6aa20123-ef41-4524-b219-c827317b00a4 Aug 10 16:06:15 devstack sudo[102556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:16 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c6b82b5-844f-4708-b344-e073d2e79690 tempest-CreateVolumesFromSnapshotTest-432970862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:06:16 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-0c6b82b5-844f-4708-b344-e073d2e79690 tempest-CreateVolumesFromSnapshotTest-432970862 None] Flow 'volume_create_manager' (d3e6b460-dc23-445e-aab0-4fbb5774cbec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:06:16 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-0c6b82b5-844f-4708-b344-e073d2e79690 tempest-CreateVolumesFromSnapshotTest-432970862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (862d13a3-3d38-4687-aee4-10d6aaf69437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:06:16 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-0c6b82b5-844f-4708-b344-e073d2e79690 tempest-CreateVolumesFromSnapshotTest-432970862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (862d13a3-3d38-4687-aee4-10d6aaf69437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:06:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-104348730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e09c26c8-0824-4605-bb8d-767c12310ece,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1daf45bb02544a5288c8946ce028f200',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:06:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:06:16Z,use_quota=True,user_id='0ce77c6415aa405bab2501e2913943dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:06:16 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-0c6b82b5-844f-4708-b344-e073d2e79690 tempest-CreateVolumesFromSnapshotTest-432970862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23706c54-fc2b-4efc-8b41-26a1a6b5ec31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:06:16 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-0c6b82b5-844f-4708-b344-e073d2e79690 tempest-CreateVolumesFromSnapshotTest-432970862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23706c54-fc2b-4efc-8b41-26a1a6b5ec31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:06:16 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-0c6b82b5-844f-4708-b344-e073d2e79690 tempest-CreateVolumesFromSnapshotTest-432970862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adfd29d0-6dda-4226-b08b-f7303d7bc304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:06:16 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-0c6b82b5-844f-4708-b344-e073d2e79690 tempest-CreateVolumesFromSnapshotTest-432970862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adfd29d0-6dda-4226-b08b-f7303d7bc304) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e09c26c8-0824-4605-bb8d-767c12310ece', 'volume_name': 'volume-e09c26c8-0824-4605-bb8d-767c12310ece', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:06:16 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-0c6b82b5-844f-4708-b344-e073d2e79690 tempest-CreateVolumesFromSnapshotTest-432970862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f434cc8-b12d-488e-990f-775667bc579b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:06:16 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-0c6b82b5-844f-4708-b344-e073d2e79690 tempest-CreateVolumesFromSnapshotTest-432970862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f434cc8-b12d-488e-990f-775667bc579b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:06:16 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-0c6b82b5-844f-4708-b344-e073d2e79690 tempest-CreateVolumesFromSnapshotTest-432970862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d77dd05-0c7e-44f7-9f52-b38baae15716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:06:16 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-0c6b82b5-844f-4708-b344-e073d2e79690 tempest-CreateVolumesFromSnapshotTest-432970862 None] Volume e09c26c8-0824-4605-bb8d-767c12310ece: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e09c26c8-0824-4605-bb8d-767c12310ece', 'volume_size': 1} Aug 10 16:06:16 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-0c6b82b5-844f-4708-b344-e073d2e79690 tempest-CreateVolumesFromSnapshotTest-432970862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:06:16 devstack sudo[102556]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:16 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-71f90378-d4c7-4c13-a6fa-a7471a2f7f6e tempest-SnapshotsActionsTest-563371099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.6aa20123-ef41-4524-b219-c827317b00a4" returned: 0 in 0.287s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:16 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-71f90378-d4c7-4c13-a6fa-a7471a2f7f6e tempest-SnapshotsActionsTest-563371099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.947s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:06:16 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-aa75574b-feaf-4d25-ac09-5086eaff2baf tempest-CreateVolumesFromSnapshotTest-432970862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.296s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:06:16 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-aa75574b-feaf-4d25-ac09-5086eaff2baf tempest-CreateVolumesFromSnapshotTest-432970862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:06:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1224271262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8a1e4a8-5650-4d83-93cb-e58885776528,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1daf45bb02544a5288c8946ce028f200',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:06:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:06:15Z,use_quota=True,user_id='0ce77c6415aa405bab2501e2913943dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:06:16 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-aa75574b-feaf-4d25-ac09-5086eaff2baf tempest-CreateVolumesFromSnapshotTest-432970862 None] Creating volume c8a1e4a8-5650-4d83-93cb-e58885776528 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:06:16 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-aa75574b-feaf-4d25-ac09-5086eaff2baf tempest-CreateVolumesFromSnapshotTest-432970862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:06:16 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-aa75574b-feaf-4d25-ac09-5086eaff2baf tempest-CreateVolumesFromSnapshotTest-432970862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:06:16 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-aa75574b-feaf-4d25-ac09-5086eaff2baf tempest-CreateVolumesFromSnapshotTest-432970862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:06:16 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-aa75574b-feaf-4d25-ac09-5086eaff2baf tempest-CreateVolumesFromSnapshotTest-432970862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:06:16 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-aa75574b-feaf-4d25-ac09-5086eaff2baf tempest-CreateVolumesFromSnapshotTest-432970862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:06:16 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-aa75574b-feaf-4d25-ac09-5086eaff2baf tempest-CreateVolumesFromSnapshotTest-432970862 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:06:16 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-aa75574b-feaf-4d25-ac09-5086eaff2baf tempest-CreateVolumesFromSnapshotTest-432970862 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:06:16 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-aa75574b-feaf-4d25-ac09-5086eaff2baf tempest-CreateVolumesFromSnapshotTest-432970862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c8a1e4a8-5650-4d83-93cb-e58885776528 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:16 devstack sudo[102559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c8a1e4a8-5650-4d83-93cb-e58885776528 1073741824 Aug 10 16:06:16 devstack sudo[102559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:16 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-71f90378-d4c7-4c13-a6fa-a7471a2f7f6e tempest-SnapshotsActionsTest-563371099 None] Create snapshot completed successfully Aug 10 16:06:16 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-501c47a5-edf4-4cd6-86d2-465593d52304 tempest-CreateVolumesFromSnapshotTest-432970862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:06:16 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-501c47a5-edf4-4cd6-86d2-465593d52304 tempest-CreateVolumesFromSnapshotTest-432970862 None] Flow 'volume_create_manager' (302b3414-a974-4f25-a098-b182602bc2d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:06:16 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-501c47a5-edf4-4cd6-86d2-465593d52304 tempest-CreateVolumesFromSnapshotTest-432970862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6fb2cca-2765-4739-b715-2a661fa3b543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:06:16 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-501c47a5-edf4-4cd6-86d2-465593d52304 tempest-CreateVolumesFromSnapshotTest-432970862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6fb2cca-2765-4739-b715-2a661fa3b543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:06:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1306936059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35557b12-7702-49b6-9453-9db7be603e7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1daf45bb02544a5288c8946ce028f200',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:06:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:06:16Z,use_quota=True,user_id='0ce77c6415aa405bab2501e2913943dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:06:16 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-501c47a5-edf4-4cd6-86d2-465593d52304 tempest-CreateVolumesFromSnapshotTest-432970862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf755508-de9d-44be-90c1-82bd5c409499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:06:16 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-501c47a5-edf4-4cd6-86d2-465593d52304 tempest-CreateVolumesFromSnapshotTest-432970862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf755508-de9d-44be-90c1-82bd5c409499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:06:16 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-501c47a5-edf4-4cd6-86d2-465593d52304 tempest-CreateVolumesFromSnapshotTest-432970862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34213813-2099-4878-88e0-f77182a39487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:06:16 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-501c47a5-edf4-4cd6-86d2-465593d52304 tempest-CreateVolumesFromSnapshotTest-432970862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34213813-2099-4878-88e0-f77182a39487) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35557b12-7702-49b6-9453-9db7be603e7e', 'volume_name': 'volume-35557b12-7702-49b6-9453-9db7be603e7e', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:06:16 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-501c47a5-edf4-4cd6-86d2-465593d52304 tempest-CreateVolumesFromSnapshotTest-432970862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46a97321-d2c3-48f4-9017-f4a2304035aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:06:16 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-501c47a5-edf4-4cd6-86d2-465593d52304 tempest-CreateVolumesFromSnapshotTest-432970862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46a97321-d2c3-48f4-9017-f4a2304035aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:06:16 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-501c47a5-edf4-4cd6-86d2-465593d52304 tempest-CreateVolumesFromSnapshotTest-432970862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a82481f2-c2b2-4515-b623-716b2810585b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:06:16 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-501c47a5-edf4-4cd6-86d2-465593d52304 tempest-CreateVolumesFromSnapshotTest-432970862 None] Volume 35557b12-7702-49b6-9453-9db7be603e7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35557b12-7702-49b6-9453-9db7be603e7e', 'volume_size': 1} Aug 10 16:06:16 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-501c47a5-edf4-4cd6-86d2-465593d52304 tempest-CreateVolumesFromSnapshotTest-432970862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:06:16 devstack sudo[102559]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:16 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-aa75574b-feaf-4d25-ac09-5086eaff2baf tempest-CreateVolumesFromSnapshotTest-432970862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c8a1e4a8-5650-4d83-93cb-e58885776528 1073741824" returned: 0 in 0.609s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:16 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-aa75574b-feaf-4d25-ac09-5086eaff2baf tempest-CreateVolumesFromSnapshotTest-432970862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c8a1e4a8-5650-4d83-93cb-e58885776528 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:16 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-c05fc1fd-2579-414d-9df0-af259832ef4e tempest-CreateVolumesFromSnapshotTest-432970862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:06:16 devstack sudo[102565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c8a1e4a8-5650-4d83-93cb-e58885776528 Aug 10 16:06:16 devstack sudo[102565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:17 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c05fc1fd-2579-414d-9df0-af259832ef4e tempest-CreateVolumesFromSnapshotTest-432970862 None] Flow 'volume_create_manager' (da171519-3b23-4bc5-b765-26a8b38c9720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:06:17 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c05fc1fd-2579-414d-9df0-af259832ef4e tempest-CreateVolumesFromSnapshotTest-432970862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31865ffd-0db6-4622-b86d-fd74dd1c3588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:06:17 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c05fc1fd-2579-414d-9df0-af259832ef4e tempest-CreateVolumesFromSnapshotTest-432970862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31865ffd-0db6-4622-b86d-fd74dd1c3588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:06:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1036552764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c3b11a1-9440-48d2-8a87-ca1d84e5d2d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1daf45bb02544a5288c8946ce028f200',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:06:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:06:17Z,use_quota=True,user_id='0ce77c6415aa405bab2501e2913943dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:06:17 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c05fc1fd-2579-414d-9df0-af259832ef4e tempest-CreateVolumesFromSnapshotTest-432970862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c327bf2-9d24-459c-8b04-1a14f89deca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:06:17 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c05fc1fd-2579-414d-9df0-af259832ef4e tempest-CreateVolumesFromSnapshotTest-432970862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c327bf2-9d24-459c-8b04-1a14f89deca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:06:17 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c05fc1fd-2579-414d-9df0-af259832ef4e tempest-CreateVolumesFromSnapshotTest-432970862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (158c548a-c480-49fb-9ae8-e298bbe6d312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:06:17 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c05fc1fd-2579-414d-9df0-af259832ef4e tempest-CreateVolumesFromSnapshotTest-432970862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (158c548a-c480-49fb-9ae8-e298bbe6d312) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c3b11a1-9440-48d2-8a87-ca1d84e5d2d3', 'volume_name': 'volume-4c3b11a1-9440-48d2-8a87-ca1d84e5d2d3', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:06:17 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c05fc1fd-2579-414d-9df0-af259832ef4e tempest-CreateVolumesFromSnapshotTest-432970862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce483e87-9526-4094-881b-7e34c6364d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:06:17 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c05fc1fd-2579-414d-9df0-af259832ef4e tempest-CreateVolumesFromSnapshotTest-432970862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce483e87-9526-4094-881b-7e34c6364d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:06:17 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c05fc1fd-2579-414d-9df0-af259832ef4e tempest-CreateVolumesFromSnapshotTest-432970862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21898729-ef40-4a1b-a098-0c1a6d1d89c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:06:17 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-c05fc1fd-2579-414d-9df0-af259832ef4e tempest-CreateVolumesFromSnapshotTest-432970862 None] Volume 4c3b11a1-9440-48d2-8a87-ca1d84e5d2d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c3b11a1-9440-48d2-8a87-ca1d84e5d2d3', 'volume_size': 1} Aug 10 16:06:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-c05fc1fd-2579-414d-9df0-af259832ef4e tempest-CreateVolumesFromSnapshotTest-432970862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:06:17 devstack sudo[102565]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-aa75574b-feaf-4d25-ac09-5086eaff2baf tempest-CreateVolumesFromSnapshotTest-432970862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c8a1e4a8-5650-4d83-93cb-e58885776528" returned: 0 in 0.321s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:17 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-aa75574b-feaf-4d25-ac09-5086eaff2baf tempest-CreateVolumesFromSnapshotTest-432970862 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:06:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-aa75574b-feaf-4d25-ac09-5086eaff2baf tempest-CreateVolumesFromSnapshotTest-432970862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:06:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-0acf37fd-5e35-49c4-9f16-bb95e26e85f5 tempest-CreateVolumesFromSnapshotTest-432970862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.515s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:06:17 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-0acf37fd-5e35-49c4-9f16-bb95e26e85f5 tempest-CreateVolumesFromSnapshotTest-432970862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:06:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1461111472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea7e1a63-b2d0-42c2-af48-32710587dada,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1daf45bb02544a5288c8946ce028f200',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:06:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:06:15Z,use_quota=True,user_id='0ce77c6415aa405bab2501e2913943dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:06:17 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-0acf37fd-5e35-49c4-9f16-bb95e26e85f5 tempest-CreateVolumesFromSnapshotTest-432970862 None] Creating volume ea7e1a63-b2d0-42c2-af48-32710587dada {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:06:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-0acf37fd-5e35-49c4-9f16-bb95e26e85f5 tempest-CreateVolumesFromSnapshotTest-432970862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:06:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-0acf37fd-5e35-49c4-9f16-bb95e26e85f5 tempest-CreateVolumesFromSnapshotTest-432970862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:06:17 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-0acf37fd-5e35-49c4-9f16-bb95e26e85f5 tempest-CreateVolumesFromSnapshotTest-432970862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:06:17 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-0acf37fd-5e35-49c4-9f16-bb95e26e85f5 tempest-CreateVolumesFromSnapshotTest-432970862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:06:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-0acf37fd-5e35-49c4-9f16-bb95e26e85f5 tempest-CreateVolumesFromSnapshotTest-432970862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:06:17 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-0acf37fd-5e35-49c4-9f16-bb95e26e85f5 tempest-CreateVolumesFromSnapshotTest-432970862 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:06:17 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-0acf37fd-5e35-49c4-9f16-bb95e26e85f5 tempest-CreateVolumesFromSnapshotTest-432970862 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:06:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0acf37fd-5e35-49c4-9f16-bb95e26e85f5 tempest-CreateVolumesFromSnapshotTest-432970862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-ea7e1a63-b2d0-42c2-af48-32710587dada 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:17 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-aa75574b-feaf-4d25-ac09-5086eaff2baf tempest-CreateVolumesFromSnapshotTest-432970862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94057420-529e-4622-9d02-721bc4981716) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8a1e4a8-5650-4d83-93cb-e58885776528', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:06:17 devstack sudo[102568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-ea7e1a63-b2d0-42c2-af48-32710587dada 1073741824 Aug 10 16:06:17 devstack sudo[102568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:17 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-aa75574b-feaf-4d25-ac09-5086eaff2baf tempest-CreateVolumesFromSnapshotTest-432970862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c33ec9a-bd42-4a9c-833f-36d00e2099f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:06:17 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-aa75574b-feaf-4d25-ac09-5086eaff2baf tempest-CreateVolumesFromSnapshotTest-432970862 None] Volume volume-c8a1e4a8-5650-4d83-93cb-e58885776528 (c8a1e4a8-5650-4d83-93cb-e58885776528): created successfully Aug 10 16:06:17 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-aa75574b-feaf-4d25-ac09-5086eaff2baf tempest-CreateVolumesFromSnapshotTest-432970862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c33ec9a-bd42-4a9c-833f-36d00e2099f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:06:17 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-aa75574b-feaf-4d25-ac09-5086eaff2baf tempest-CreateVolumesFromSnapshotTest-432970862 None] Flow 'volume_create_manager' (23399dd8-fbd5-4887-901a-6d2b83504f31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:06:17 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-aa75574b-feaf-4d25-ac09-5086eaff2baf tempest-CreateVolumesFromSnapshotTest-432970862 None] Created volume successfully. Aug 10 16:06:17 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-7d491ddc-e7a2-477c-8f95-3a222e36ef70 tempest-SnapshotsActionsTest-1239710851 None] Acquiring lock "cinder-6aa20123-ef41-4524-b219-c827317b00a4-delete_snapshot" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:06:17 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-7d491ddc-e7a2-477c-8f95-3a222e36ef70 tempest-SnapshotsActionsTest-1239710851 None] Lock "cinder-6aa20123-ef41-4524-b219-c827317b00a4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:06:17 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-7d491ddc-e7a2-477c-8f95-3a222e36ef70 tempest-SnapshotsActionsTest-1239710851 None] Acquiring lock "cinder-quobyte-a1d127d8-4b1f-4309-9b71-98698e5dae7a" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:06:17 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-7d491ddc-e7a2-477c-8f95-3a222e36ef70 tempest-SnapshotsActionsTest-1239710851 None] Lock "cinder-quobyte-a1d127d8-4b1f-4309-9b71-98698e5dae7a" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:06:17 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-7d491ddc-e7a2-477c-8f95-3a222e36ef70 tempest-SnapshotsActionsTest-1239710851 None] Acquiring lock "cinder-quobyte-6aa20123-ef41-4524-b219-c827317b00a4" by "_delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:06:17 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-7d491ddc-e7a2-477c-8f95-3a222e36ef70 tempest-SnapshotsActionsTest-1239710851 None] Lock "cinder-quobyte-6aa20123-ef41-4524-b219-c827317b00a4" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:06:17 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-7d491ddc-e7a2-477c-8f95-3a222e36ef70 tempest-SnapshotsActionsTest-1239710851 None] Deleting offline snapshot 6aa20123-ef41-4524-b219-c827317b00a4 of volume a1d127d8-4b1f-4309-9b71-98698e5dae7a {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 16:06:17 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-7d491ddc-e7a2-477c-8f95-3a222e36ef70 tempest-SnapshotsActionsTest-1239710851 None] snapshot_file for this snap is: volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.6aa20123-ef41-4524-b219-c827317b00a4 {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 16:06:17 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[09824012-485f-4239-a240-e79e94ec2604]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:06:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7d491ddc-e7a2-477c-8f95-3a222e36ef70 tempest-SnapshotsActionsTest-1239710851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.6aa20123-ef41-4524-b219-c827317b00a4 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:17 devstack sudo[102568]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0acf37fd-5e35-49c4-9f16-bb95e26e85f5 tempest-CreateVolumesFromSnapshotTest-432970862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-ea7e1a63-b2d0-42c2-af48-32710587dada 1073741824" returned: 0 in 0.587s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0acf37fd-5e35-49c4-9f16-bb95e26e85f5 tempest-CreateVolumesFromSnapshotTest-432970862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-ea7e1a63-b2d0-42c2-af48-32710587dada {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:17 devstack sudo[102574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.6aa20123-ef41-4524-b219-c827317b00a4 Aug 10 16:06:17 devstack sudo[102574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:17 devstack sudo[102575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-ea7e1a63-b2d0-42c2-af48-32710587dada Aug 10 16:06:17 devstack sudo[102575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:18 devstack sudo[102575]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:18 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0acf37fd-5e35-49c4-9f16-bb95e26e85f5 tempest-CreateVolumesFromSnapshotTest-432970862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-ea7e1a63-b2d0-42c2-af48-32710587dada" returned: 0 in 0.347s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:18 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-0acf37fd-5e35-49c4-9f16-bb95e26e85f5 tempest-CreateVolumesFromSnapshotTest-432970862 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:06:18 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-0acf37fd-5e35-49c4-9f16-bb95e26e85f5 tempest-CreateVolumesFromSnapshotTest-432970862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:06:18 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-0c6b82b5-844f-4708-b344-e073d2e79690 tempest-CreateVolumesFromSnapshotTest-432970862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.172s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:06:18 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-0c6b82b5-844f-4708-b344-e073d2e79690 tempest-CreateVolumesFromSnapshotTest-432970862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:06:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-104348730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e09c26c8-0824-4605-bb8d-767c12310ece,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1daf45bb02544a5288c8946ce028f200',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:06:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:06:16Z,use_quota=True,user_id='0ce77c6415aa405bab2501e2913943dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:06:18 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-0c6b82b5-844f-4708-b344-e073d2e79690 tempest-CreateVolumesFromSnapshotTest-432970862 None] Creating volume e09c26c8-0824-4605-bb8d-767c12310ece {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:06:18 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-0c6b82b5-844f-4708-b344-e073d2e79690 tempest-CreateVolumesFromSnapshotTest-432970862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:06:18 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-0c6b82b5-844f-4708-b344-e073d2e79690 tempest-CreateVolumesFromSnapshotTest-432970862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:06:18 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-0c6b82b5-844f-4708-b344-e073d2e79690 tempest-CreateVolumesFromSnapshotTest-432970862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:06:18 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-0c6b82b5-844f-4708-b344-e073d2e79690 tempest-CreateVolumesFromSnapshotTest-432970862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:06:18 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-0c6b82b5-844f-4708-b344-e073d2e79690 tempest-CreateVolumesFromSnapshotTest-432970862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:06:18 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-0c6b82b5-844f-4708-b344-e073d2e79690 tempest-CreateVolumesFromSnapshotTest-432970862 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:06:18 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-0c6b82b5-844f-4708-b344-e073d2e79690 tempest-CreateVolumesFromSnapshotTest-432970862 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:06:18 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0c6b82b5-844f-4708-b344-e073d2e79690 tempest-CreateVolumesFromSnapshotTest-432970862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-e09c26c8-0824-4605-bb8d-767c12310ece 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:18 devstack sudo[102574]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:18 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7d491ddc-e7a2-477c-8f95-3a222e36ef70 tempest-SnapshotsActionsTest-1239710851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.6aa20123-ef41-4524-b219-c827317b00a4" returned: 0 in 0.549s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:18 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-7d491ddc-e7a2-477c-8f95-3a222e36ef70 tempest-SnapshotsActionsTest-1239710851 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 16:06:18 devstack sudo[102582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-e09c26c8-0824-4605-bb8d-767c12310ece 1073741824 Aug 10 16:06:18 devstack sudo[102582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:18 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-0acf37fd-5e35-49c4-9f16-bb95e26e85f5 tempest-CreateVolumesFromSnapshotTest-432970862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0f77fae-683c-4e6a-a6b5-34d6672063bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea7e1a63-b2d0-42c2-af48-32710587dada', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:06:18 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-0acf37fd-5e35-49c4-9f16-bb95e26e85f5 tempest-CreateVolumesFromSnapshotTest-432970862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e1d402d-291b-464c-8bfd-d69d7a295334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:06:18 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[9705d42f-4cbe-4f45-8ccf-37da47e00fcb]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:06:18 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7d491ddc-e7a2-477c-8f95-3a222e36ef70 tempest-SnapshotsActionsTest-1239710851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.4e968a7c-3296-40bb-a468-b8e0bee026c9 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:18 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-0acf37fd-5e35-49c4-9f16-bb95e26e85f5 tempest-CreateVolumesFromSnapshotTest-432970862 None] Volume volume-ea7e1a63-b2d0-42c2-af48-32710587dada (ea7e1a63-b2d0-42c2-af48-32710587dada): created successfully Aug 10 16:06:18 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-0acf37fd-5e35-49c4-9f16-bb95e26e85f5 tempest-CreateVolumesFromSnapshotTest-432970862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e1d402d-291b-464c-8bfd-d69d7a295334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:06:18 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-0acf37fd-5e35-49c4-9f16-bb95e26e85f5 tempest-CreateVolumesFromSnapshotTest-432970862 None] Flow 'volume_create_manager' (116de9af-2575-4a96-8bf4-1b0be4f005e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:06:18 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-0acf37fd-5e35-49c4-9f16-bb95e26e85f5 tempest-CreateVolumesFromSnapshotTest-432970862 None] Created volume successfully. Aug 10 16:06:18 devstack sudo[102584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.4e968a7c-3296-40bb-a468-b8e0bee026c9 Aug 10 16:06:18 devstack sudo[102584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:18 devstack sudo[102584]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:18 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7d491ddc-e7a2-477c-8f95-3a222e36ef70 tempest-SnapshotsActionsTest-1239710851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.4e968a7c-3296-40bb-a468-b8e0bee026c9" returned: 0 in 0.473s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:18 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-7d491ddc-e7a2-477c-8f95-3a222e36ef70 tempest-SnapshotsActionsTest-1239710851 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 16:06:18 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7d491ddc-e7a2-477c-8f95-3a222e36ef70 tempest-SnapshotsActionsTest-1239710851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.6aa20123-ef41-4524-b219-c827317b00a4 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:18 devstack sudo[102582]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:18 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0c6b82b5-844f-4708-b344-e073d2e79690 tempest-CreateVolumesFromSnapshotTest-432970862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-e09c26c8-0824-4605-bb8d-767c12310ece 1073741824" returned: 0 in 0.559s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:18 devstack sudo[102594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.6aa20123-ef41-4524-b219-c827317b00a4 Aug 10 16:06:18 devstack sudo[102594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:18 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0c6b82b5-844f-4708-b344-e073d2e79690 tempest-CreateVolumesFromSnapshotTest-432970862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-e09c26c8-0824-4605-bb8d-767c12310ece {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:18 devstack sudo[102596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-e09c26c8-0824-4605-bb8d-767c12310ece Aug 10 16:06:18 devstack sudo[102596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:19 devstack sudo[102596]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0c6b82b5-844f-4708-b344-e073d2e79690 tempest-CreateVolumesFromSnapshotTest-432970862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-e09c26c8-0824-4605-bb8d-767c12310ece" returned: 0 in 0.349s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:19 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-0c6b82b5-844f-4708-b344-e073d2e79690 tempest-CreateVolumesFromSnapshotTest-432970862 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:06:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-0c6b82b5-844f-4708-b344-e073d2e79690 tempest-CreateVolumesFromSnapshotTest-432970862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:06:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-501c47a5-edf4-4cd6-86d2-465593d52304 tempest-CreateVolumesFromSnapshotTest-432970862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.647s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:06:19 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-501c47a5-edf4-4cd6-86d2-465593d52304 tempest-CreateVolumesFromSnapshotTest-432970862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:06:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1306936059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35557b12-7702-49b6-9453-9db7be603e7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1daf45bb02544a5288c8946ce028f200',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:06:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:06:16Z,use_quota=True,user_id='0ce77c6415aa405bab2501e2913943dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:06:19 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-501c47a5-edf4-4cd6-86d2-465593d52304 tempest-CreateVolumesFromSnapshotTest-432970862 None] Creating volume 35557b12-7702-49b6-9453-9db7be603e7e {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:06:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-501c47a5-edf4-4cd6-86d2-465593d52304 tempest-CreateVolumesFromSnapshotTest-432970862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:06:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-501c47a5-edf4-4cd6-86d2-465593d52304 tempest-CreateVolumesFromSnapshotTest-432970862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:06:19 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-501c47a5-edf4-4cd6-86d2-465593d52304 tempest-CreateVolumesFromSnapshotTest-432970862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:06:19 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-501c47a5-edf4-4cd6-86d2-465593d52304 tempest-CreateVolumesFromSnapshotTest-432970862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:06:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-501c47a5-edf4-4cd6-86d2-465593d52304 tempest-CreateVolumesFromSnapshotTest-432970862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:06:19 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-501c47a5-edf4-4cd6-86d2-465593d52304 tempest-CreateVolumesFromSnapshotTest-432970862 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:06:19 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-501c47a5-edf4-4cd6-86d2-465593d52304 tempest-CreateVolumesFromSnapshotTest-432970862 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:06:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-501c47a5-edf4-4cd6-86d2-465593d52304 tempest-CreateVolumesFromSnapshotTest-432970862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-35557b12-7702-49b6-9453-9db7be603e7e 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:19 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-0c6b82b5-844f-4708-b344-e073d2e79690 tempest-CreateVolumesFromSnapshotTest-432970862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d77dd05-0c7e-44f7-9f52-b38baae15716) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e09c26c8-0824-4605-bb8d-767c12310ece', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:06:19 devstack sudo[102602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-35557b12-7702-49b6-9453-9db7be603e7e 1073741824 Aug 10 16:06:19 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-0c6b82b5-844f-4708-b344-e073d2e79690 tempest-CreateVolumesFromSnapshotTest-432970862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71d41fdc-0f8f-43f2-9eb2-30ccf5f2bc12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:06:19 devstack sudo[102602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:19 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-0c6b82b5-844f-4708-b344-e073d2e79690 tempest-CreateVolumesFromSnapshotTest-432970862 None] Volume volume-e09c26c8-0824-4605-bb8d-767c12310ece (e09c26c8-0824-4605-bb8d-767c12310ece): created successfully Aug 10 16:06:19 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-0c6b82b5-844f-4708-b344-e073d2e79690 tempest-CreateVolumesFromSnapshotTest-432970862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71d41fdc-0f8f-43f2-9eb2-30ccf5f2bc12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:06:19 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-0c6b82b5-844f-4708-b344-e073d2e79690 tempest-CreateVolumesFromSnapshotTest-432970862 None] Flow 'volume_create_manager' (d3e6b460-dc23-445e-aab0-4fbb5774cbec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:06:19 devstack sudo[102594]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:19 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-0c6b82b5-844f-4708-b344-e073d2e79690 tempest-CreateVolumesFromSnapshotTest-432970862 None] Created volume successfully. Aug 10 16:06:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7d491ddc-e7a2-477c-8f95-3a222e36ef70 tempest-SnapshotsActionsTest-1239710851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.6aa20123-ef41-4524-b219-c827317b00a4" returned: 0 in 0.524s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7d491ddc-e7a2-477c-8f95-3a222e36ef70 tempest-SnapshotsActionsTest-1239710851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.6aa20123-ef41-4524-b219-c827317b00a4 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:19 devstack sudo[102604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.6aa20123-ef41-4524-b219-c827317b00a4 Aug 10 16:06:19 devstack sudo[102604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:19 devstack sudo[102604]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7d491ddc-e7a2-477c-8f95-3a222e36ef70 tempest-SnapshotsActionsTest-1239710851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.6aa20123-ef41-4524-b219-c827317b00a4" returned: 0 in 0.319s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:19 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-7d491ddc-e7a2-477c-8f95-3a222e36ef70 tempest-SnapshotsActionsTest-1239710851 None] Lock "cinder-quobyte-6aa20123-ef41-4524-b219-c827317b00a4" released by "_delete_snapshot" :: held 1.985s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:06:19 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-7d491ddc-e7a2-477c-8f95-3a222e36ef70 tempest-SnapshotsActionsTest-1239710851 None] Lock "cinder-quobyte-a1d127d8-4b1f-4309-9b71-98698e5dae7a" released by "delete_snapshot" :: held 2.013s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:06:19 devstack sudo[102602]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-501c47a5-edf4-4cd6-86d2-465593d52304 tempest-CreateVolumesFromSnapshotTest-432970862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-35557b12-7702-49b6-9453-9db7be603e7e 1073741824" returned: 0 in 0.537s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-501c47a5-edf4-4cd6-86d2-465593d52304 tempest-CreateVolumesFromSnapshotTest-432970862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-35557b12-7702-49b6-9453-9db7be603e7e {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:19 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-7d491ddc-e7a2-477c-8f95-3a222e36ef70 tempest-SnapshotsActionsTest-1239710851 None] Created reservations ['9a370316-9439-4e61-92f7-85bbb0012751', '42d070a4-8216-46de-970e-c6db9da3576c', '0c694bd2-6c36-4116-9315-6a7610f30a43', 'c46555aa-5614-4c79-805e-ffcdecdf0517'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:06:19 devstack sudo[102611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-35557b12-7702-49b6-9453-9db7be603e7e Aug 10 16:06:19 devstack sudo[102611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:20 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-7d491ddc-e7a2-477c-8f95-3a222e36ef70 tempest-SnapshotsActionsTest-1239710851 None] Delete snapshot completed successfully. Aug 10 16:06:20 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-7d491ddc-e7a2-477c-8f95-3a222e36ef70 tempest-SnapshotsActionsTest-1239710851 None] Lock "cinder-6aa20123-ef41-4524-b219-c827317b00a4-delete_snapshot" released by "delete_snapshot" :: held 2.363s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:06:20 devstack sudo[102611]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:20 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-501c47a5-edf4-4cd6-86d2-465593d52304 tempest-CreateVolumesFromSnapshotTest-432970862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-35557b12-7702-49b6-9453-9db7be603e7e" returned: 0 in 0.316s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:20 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-501c47a5-edf4-4cd6-86d2-465593d52304 tempest-CreateVolumesFromSnapshotTest-432970862 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:06:20 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-501c47a5-edf4-4cd6-86d2-465593d52304 tempest-CreateVolumesFromSnapshotTest-432970862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:06:20 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-c05fc1fd-2579-414d-9df0-af259832ef4e tempest-CreateVolumesFromSnapshotTest-432970862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.106s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:06:20 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-c05fc1fd-2579-414d-9df0-af259832ef4e tempest-CreateVolumesFromSnapshotTest-432970862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:06:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1036552764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c3b11a1-9440-48d2-8a87-ca1d84e5d2d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1daf45bb02544a5288c8946ce028f200',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:06:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:06:17Z,use_quota=True,user_id='0ce77c6415aa405bab2501e2913943dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:06:20 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-c05fc1fd-2579-414d-9df0-af259832ef4e tempest-CreateVolumesFromSnapshotTest-432970862 None] Creating volume 4c3b11a1-9440-48d2-8a87-ca1d84e5d2d3 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:06:20 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-c05fc1fd-2579-414d-9df0-af259832ef4e tempest-CreateVolumesFromSnapshotTest-432970862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:06:20 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-c05fc1fd-2579-414d-9df0-af259832ef4e tempest-CreateVolumesFromSnapshotTest-432970862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:06:20 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-c05fc1fd-2579-414d-9df0-af259832ef4e tempest-CreateVolumesFromSnapshotTest-432970862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:06:20 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-c05fc1fd-2579-414d-9df0-af259832ef4e tempest-CreateVolumesFromSnapshotTest-432970862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:06:20 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-c05fc1fd-2579-414d-9df0-af259832ef4e tempest-CreateVolumesFromSnapshotTest-432970862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:06:20 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-c05fc1fd-2579-414d-9df0-af259832ef4e tempest-CreateVolumesFromSnapshotTest-432970862 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:06:20 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-c05fc1fd-2579-414d-9df0-af259832ef4e tempest-CreateVolumesFromSnapshotTest-432970862 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:06:20 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c05fc1fd-2579-414d-9df0-af259832ef4e tempest-CreateVolumesFromSnapshotTest-432970862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4c3b11a1-9440-48d2-8a87-ca1d84e5d2d3 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:20 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-501c47a5-edf4-4cd6-86d2-465593d52304 tempest-CreateVolumesFromSnapshotTest-432970862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a82481f2-c2b2-4515-b623-716b2810585b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35557b12-7702-49b6-9453-9db7be603e7e', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:06:20 devstack sudo[102614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4c3b11a1-9440-48d2-8a87-ca1d84e5d2d3 1073741824 Aug 10 16:06:20 devstack sudo[102614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:20 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-501c47a5-edf4-4cd6-86d2-465593d52304 tempest-CreateVolumesFromSnapshotTest-432970862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8434e96-bd54-498a-907c-55bdaa995614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:06:20 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-501c47a5-edf4-4cd6-86d2-465593d52304 tempest-CreateVolumesFromSnapshotTest-432970862 None] Volume volume-35557b12-7702-49b6-9453-9db7be603e7e (35557b12-7702-49b6-9453-9db7be603e7e): created successfully Aug 10 16:06:20 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-501c47a5-edf4-4cd6-86d2-465593d52304 tempest-CreateVolumesFromSnapshotTest-432970862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8434e96-bd54-498a-907c-55bdaa995614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:06:20 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-501c47a5-edf4-4cd6-86d2-465593d52304 tempest-CreateVolumesFromSnapshotTest-432970862 None] Flow 'volume_create_manager' (302b3414-a974-4f25-a098-b182602bc2d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:06:20 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-501c47a5-edf4-4cd6-86d2-465593d52304 tempest-CreateVolumesFromSnapshotTest-432970862 None] Created volume successfully. Aug 10 16:06:20 devstack sudo[102614]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:20 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c05fc1fd-2579-414d-9df0-af259832ef4e tempest-CreateVolumesFromSnapshotTest-432970862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4c3b11a1-9440-48d2-8a87-ca1d84e5d2d3 1073741824" returned: 0 in 0.519s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:20 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c05fc1fd-2579-414d-9df0-af259832ef4e tempest-CreateVolumesFromSnapshotTest-432970862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4c3b11a1-9440-48d2-8a87-ca1d84e5d2d3 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:20 devstack sudo[102620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4c3b11a1-9440-48d2-8a87-ca1d84e5d2d3 Aug 10 16:06:20 devstack sudo[102620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:21 devstack sudo[102620]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:21 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c05fc1fd-2579-414d-9df0-af259832ef4e tempest-CreateVolumesFromSnapshotTest-432970862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4c3b11a1-9440-48d2-8a87-ca1d84e5d2d3" returned: 0 in 0.275s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:21 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-c05fc1fd-2579-414d-9df0-af259832ef4e tempest-CreateVolumesFromSnapshotTest-432970862 None] <== create_volume: return (836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:06:21 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-c05fc1fd-2579-414d-9df0-af259832ef4e tempest-CreateVolumesFromSnapshotTest-432970862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:06:21 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c05fc1fd-2579-414d-9df0-af259832ef4e tempest-CreateVolumesFromSnapshotTest-432970862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21898729-ef40-4a1b-a098-0c1a6d1d89c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c3b11a1-9440-48d2-8a87-ca1d84e5d2d3', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:06:21 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c05fc1fd-2579-414d-9df0-af259832ef4e tempest-CreateVolumesFromSnapshotTest-432970862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fb1696b-4618-49de-a93d-65f9bbf77cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:06:21 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-c05fc1fd-2579-414d-9df0-af259832ef4e tempest-CreateVolumesFromSnapshotTest-432970862 None] Volume volume-4c3b11a1-9440-48d2-8a87-ca1d84e5d2d3 (4c3b11a1-9440-48d2-8a87-ca1d84e5d2d3): created successfully Aug 10 16:06:21 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c05fc1fd-2579-414d-9df0-af259832ef4e tempest-CreateVolumesFromSnapshotTest-432970862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fb1696b-4618-49de-a93d-65f9bbf77cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:06:21 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c05fc1fd-2579-414d-9df0-af259832ef4e tempest-CreateVolumesFromSnapshotTest-432970862 None] Flow 'volume_create_manager' (da171519-3b23-4bc5-b765-26a8b38c9720) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:06:21 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-c05fc1fd-2579-414d-9df0-af259832ef4e tempest-CreateVolumesFromSnapshotTest-432970862 None] Created volume successfully. Aug 10 16:06:21 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-d4b9977b-13ac-4f6a-8f92-e11c9f3f89d1 tempest-SnapshotsActionsTest-563371099 None] Acquiring lock "cinder-4e968a7c-3296-40bb-a468-b8e0bee026c9-delete_snapshot" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:06:21 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-d4b9977b-13ac-4f6a-8f92-e11c9f3f89d1 tempest-SnapshotsActionsTest-563371099 None] Lock "cinder-4e968a7c-3296-40bb-a468-b8e0bee026c9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:06:21 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-d4b9977b-13ac-4f6a-8f92-e11c9f3f89d1 tempest-SnapshotsActionsTest-563371099 None] Acquiring lock "cinder-quobyte-a1d127d8-4b1f-4309-9b71-98698e5dae7a" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:06:21 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-d4b9977b-13ac-4f6a-8f92-e11c9f3f89d1 tempest-SnapshotsActionsTest-563371099 None] Lock "cinder-quobyte-a1d127d8-4b1f-4309-9b71-98698e5dae7a" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:06:21 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-d4b9977b-13ac-4f6a-8f92-e11c9f3f89d1 tempest-SnapshotsActionsTest-563371099 None] Acquiring lock "cinder-quobyte-4e968a7c-3296-40bb-a468-b8e0bee026c9" by "_delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:06:21 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-d4b9977b-13ac-4f6a-8f92-e11c9f3f89d1 tempest-SnapshotsActionsTest-563371099 None] Lock "cinder-quobyte-4e968a7c-3296-40bb-a468-b8e0bee026c9" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:06:21 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-d4b9977b-13ac-4f6a-8f92-e11c9f3f89d1 tempest-SnapshotsActionsTest-563371099 None] Deleting offline snapshot 4e968a7c-3296-40bb-a468-b8e0bee026c9 of volume a1d127d8-4b1f-4309-9b71-98698e5dae7a {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 16:06:21 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-d4b9977b-13ac-4f6a-8f92-e11c9f3f89d1 tempest-SnapshotsActionsTest-563371099 None] snapshot_file for this snap is: volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.4e968a7c-3296-40bb-a468-b8e0bee026c9 {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 16:06:21 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f811377-2b9c-4ea7-84c5-1a25e8a5d167]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:06:21 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d4b9977b-13ac-4f6a-8f92-e11c9f3f89d1 tempest-SnapshotsActionsTest-563371099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.4e968a7c-3296-40bb-a468-b8e0bee026c9 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:21 devstack sudo[102625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.4e968a7c-3296-40bb-a468-b8e0bee026c9 Aug 10 16:06:21 devstack sudo[102625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:21 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-69155868-2ab4-43b4-8df4-035e5ce2229a tempest-CreateVolumesFromSnapshotTest-432970862 None] Acquiring lock "cinder-4c3b11a1-9440-48d2-8a87-ca1d84e5d2d3-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:06:21 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-69155868-2ab4-43b4-8df4-035e5ce2229a tempest-CreateVolumesFromSnapshotTest-432970862 None] Lock "cinder-4c3b11a1-9440-48d2-8a87-ca1d84e5d2d3-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:06:21 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-69155868-2ab4-43b4-8df4-035e5ce2229a tempest-CreateVolumesFromSnapshotTest-432970862 None] Acquiring lock "cinder-quobyte-4c3b11a1-9440-48d2-8a87-ca1d84e5d2d3" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:06:21 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-69155868-2ab4-43b4-8df4-035e5ce2229a tempest-CreateVolumesFromSnapshotTest-432970862 None] Lock "cinder-quobyte-4c3b11a1-9440-48d2-8a87-ca1d84e5d2d3" acquired by "delete_volume" :: waited 0.023s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:06:21 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[358b7474-7b45-42b3-8c66-40770d5bc571]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:06:21 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-69155868-2ab4-43b4-8df4-035e5ce2229a tempest-CreateVolumesFromSnapshotTest-432970862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4c3b11a1-9440-48d2-8a87-ca1d84e5d2d3 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:21 devstack sudo[102625]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:21 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d4b9977b-13ac-4f6a-8f92-e11c9f3f89d1 tempest-SnapshotsActionsTest-563371099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.4e968a7c-3296-40bb-a468-b8e0bee026c9" returned: 0 in 0.449s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:21 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-d4b9977b-13ac-4f6a-8f92-e11c9f3f89d1 tempest-SnapshotsActionsTest-563371099 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 16:06:21 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[297de633-8173-47ee-bc88-3c2c1d21b167]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:06:21 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d4b9977b-13ac-4f6a-8f92-e11c9f3f89d1 tempest-SnapshotsActionsTest-563371099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:21 devstack sudo[102629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4c3b11a1-9440-48d2-8a87-ca1d84e5d2d3 Aug 10 16:06:21 devstack sudo[102629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:22 devstack sudo[102631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a Aug 10 16:06:22 devstack sudo[102631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:22 devstack sudo[102629]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-69155868-2ab4-43b4-8df4-035e5ce2229a tempest-CreateVolumesFromSnapshotTest-432970862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4c3b11a1-9440-48d2-8a87-ca1d84e5d2d3" returned: 0 in 0.419s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-69155868-2ab4-43b4-8df4-035e5ce2229a tempest-CreateVolumesFromSnapshotTest-432970862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4c3b11a1-9440-48d2-8a87-ca1d84e5d2d3 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:22 devstack sudo[102639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4c3b11a1-9440-48d2-8a87-ca1d84e5d2d3 Aug 10 16:06:22 devstack sudo[102639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:22 devstack sudo[102631]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d4b9977b-13ac-4f6a-8f92-e11c9f3f89d1 tempest-SnapshotsActionsTest-563371099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a" returned: 0 in 0.412s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d4b9977b-13ac-4f6a-8f92-e11c9f3f89d1 tempest-SnapshotsActionsTest-563371099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.4e968a7c-3296-40bb-a468-b8e0bee026c9 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:22 devstack sudo[102644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.4e968a7c-3296-40bb-a468-b8e0bee026c9 Aug 10 16:06:22 devstack sudo[102644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:22 devstack sudo[102639]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-69155868-2ab4-43b4-8df4-035e5ce2229a tempest-CreateVolumesFromSnapshotTest-432970862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4c3b11a1-9440-48d2-8a87-ca1d84e5d2d3" returned: 0 in 0.302s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:22 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-69155868-2ab4-43b4-8df4-035e5ce2229a tempest-CreateVolumesFromSnapshotTest-432970862 None] Lock "cinder-quobyte-4c3b11a1-9440-48d2-8a87-ca1d84e5d2d3" released by "delete_volume" :: held 0.782s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:06:22 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-69155868-2ab4-43b4-8df4-035e5ce2229a tempest-CreateVolumesFromSnapshotTest-432970862 None] Created reservations ['27698a69-0ac6-4357-8879-c16db23697f4', 'dc57b534-978a-4f0a-a522-a8db0e5e25f7', '41e0d3b4-88da-47c8-98da-a0dc02606bf2', 'ce1cd424-9407-42d2-b472-b14ae68b589e'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:06:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-69155868-2ab4-43b4-8df4-035e5ce2229a tempest-CreateVolumesFromSnapshotTest-432970862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:06:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-69155868-2ab4-43b4-8df4-035e5ce2229a tempest-CreateVolumesFromSnapshotTest-432970862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:06:22 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-69155868-2ab4-43b4-8df4-035e5ce2229a tempest-CreateVolumesFromSnapshotTest-432970862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:06:22 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-69155868-2ab4-43b4-8df4-035e5ce2229a tempest-CreateVolumesFromSnapshotTest-432970862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:06:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-69155868-2ab4-43b4-8df4-035e5ce2229a tempest-CreateVolumesFromSnapshotTest-432970862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:06:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-69155868-2ab4-43b4-8df4-035e5ce2229a tempest-CreateVolumesFromSnapshotTest-432970862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:22 devstack sudo[102644]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d4b9977b-13ac-4f6a-8f92-e11c9f3f89d1 tempest-SnapshotsActionsTest-563371099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.4e968a7c-3296-40bb-a468-b8e0bee026c9" returned: 0 in 0.415s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d4b9977b-13ac-4f6a-8f92-e11c9f3f89d1 tempest-SnapshotsActionsTest-563371099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.4e968a7c-3296-40bb-a468-b8e0bee026c9 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:22 devstack sudo[102650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:06:22 devstack sudo[102650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:22 devstack sudo[102652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.4e968a7c-3296-40bb-a468-b8e0bee026c9 Aug 10 16:06:22 devstack sudo[102652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:22 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-ed1a33ac-c310-4385-8b7a-1e4dfdb3c397 tempest-CreateVolumesFromSnapshotTest-432970862 None] Acquiring lock "cinder-35557b12-7702-49b6-9453-9db7be603e7e-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:06:22 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-ed1a33ac-c310-4385-8b7a-1e4dfdb3c397 tempest-CreateVolumesFromSnapshotTest-432970862 None] Lock "cinder-35557b12-7702-49b6-9453-9db7be603e7e-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:06:22 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-ed1a33ac-c310-4385-8b7a-1e4dfdb3c397 tempest-CreateVolumesFromSnapshotTest-432970862 None] Acquiring lock "cinder-quobyte-35557b12-7702-49b6-9453-9db7be603e7e" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:06:23 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-ed1a33ac-c310-4385-8b7a-1e4dfdb3c397 tempest-CreateVolumesFromSnapshotTest-432970862 None] Lock "cinder-quobyte-35557b12-7702-49b6-9453-9db7be603e7e" acquired by "delete_volume" :: waited 0.027s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:06:23 devstack sudo[102650]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:23 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-69155868-2ab4-43b4-8df4-035e5ce2229a tempest-CreateVolumesFromSnapshotTest-432970862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.309s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:23 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-69155868-2ab4-43b4-8df4-035e5ce2229a tempest-CreateVolumesFromSnapshotTest-432970862 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:06:23 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-69155868-2ab4-43b4-8df4-035e5ce2229a tempest-CreateVolumesFromSnapshotTest-432970862 None] Deleted volume successfully. Aug 10 16:06:23 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa61b97-f7e6-4ae8-8b51-7263bf447cba]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:06:23 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ed1a33ac-c310-4385-8b7a-1e4dfdb3c397 tempest-CreateVolumesFromSnapshotTest-432970862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-35557b12-7702-49b6-9453-9db7be603e7e {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:23 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-69155868-2ab4-43b4-8df4-035e5ce2229a tempest-CreateVolumesFromSnapshotTest-432970862 None] Lock "cinder-4c3b11a1-9440-48d2-8a87-ca1d84e5d2d3-delete_volume" released by "delete_volume" :: held 1.378s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:06:23 devstack sudo[102652]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:23 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d4b9977b-13ac-4f6a-8f92-e11c9f3f89d1 tempest-SnapshotsActionsTest-563371099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a.4e968a7c-3296-40bb-a468-b8e0bee026c9" returned: 0 in 0.361s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:23 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-d4b9977b-13ac-4f6a-8f92-e11c9f3f89d1 tempest-SnapshotsActionsTest-563371099 None] Lock "cinder-quobyte-4e968a7c-3296-40bb-a468-b8e0bee026c9" released by "_delete_snapshot" :: held 1.750s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:06:23 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-d4b9977b-13ac-4f6a-8f92-e11c9f3f89d1 tempest-SnapshotsActionsTest-563371099 None] Lock "cinder-quobyte-a1d127d8-4b1f-4309-9b71-98698e5dae7a" released by "delete_snapshot" :: held 1.775s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:06:23 devstack sudo[102656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-35557b12-7702-49b6-9453-9db7be603e7e Aug 10 16:06:23 devstack sudo[102656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:23 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-d4b9977b-13ac-4f6a-8f92-e11c9f3f89d1 tempest-SnapshotsActionsTest-563371099 None] Created reservations ['c3d5d69b-ed5d-4b83-ae64-4d5f742ab333', '60fcb397-ac70-4f8c-86c1-9b117860be07', 'bb472e12-2528-4444-8897-f5291f3cce7d', '8e759bf2-716c-49f0-aa1c-529b5c131188'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:06:23 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-d4b9977b-13ac-4f6a-8f92-e11c9f3f89d1 tempest-SnapshotsActionsTest-563371099 None] Delete snapshot completed successfully. Aug 10 16:06:23 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-d4b9977b-13ac-4f6a-8f92-e11c9f3f89d1 tempest-SnapshotsActionsTest-563371099 None] Lock "cinder-4e968a7c-3296-40bb-a468-b8e0bee026c9-delete_snapshot" released by "delete_snapshot" :: held 1.948s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:06:23 devstack sudo[102656]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:23 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ed1a33ac-c310-4385-8b7a-1e4dfdb3c397 tempest-CreateVolumesFromSnapshotTest-432970862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-35557b12-7702-49b6-9453-9db7be603e7e" returned: 0 in 0.390s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:23 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ed1a33ac-c310-4385-8b7a-1e4dfdb3c397 tempest-CreateVolumesFromSnapshotTest-432970862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-35557b12-7702-49b6-9453-9db7be603e7e {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:23 devstack sudo[102661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-35557b12-7702-49b6-9453-9db7be603e7e Aug 10 16:06:23 devstack sudo[102661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:23 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-7cd5e036-0862-433c-8823-019d18ecebf5 tempest-SnapshotsActionsTest-563371099 None] Acquiring lock "cinder-a1d127d8-4b1f-4309-9b71-98698e5dae7a-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:06:23 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-7cd5e036-0862-433c-8823-019d18ecebf5 tempest-SnapshotsActionsTest-563371099 None] Lock "cinder-a1d127d8-4b1f-4309-9b71-98698e5dae7a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:06:23 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-7cd5e036-0862-433c-8823-019d18ecebf5 tempest-SnapshotsActionsTest-563371099 None] Acquiring lock "cinder-quobyte-a1d127d8-4b1f-4309-9b71-98698e5dae7a" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:06:23 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-7cd5e036-0862-433c-8823-019d18ecebf5 tempest-SnapshotsActionsTest-563371099 None] Lock "cinder-quobyte-a1d127d8-4b1f-4309-9b71-98698e5dae7a" acquired by "delete_volume" :: waited 0.023s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:06:23 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[633ef1fb-ef36-401e-9436-614ab834e2b9]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:06:23 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7cd5e036-0862-433c-8823-019d18ecebf5 tempest-SnapshotsActionsTest-563371099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:23 devstack sudo[102661]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:23 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ed1a33ac-c310-4385-8b7a-1e4dfdb3c397 tempest-CreateVolumesFromSnapshotTest-432970862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-35557b12-7702-49b6-9453-9db7be603e7e" returned: 0 in 0.314s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:23 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-ed1a33ac-c310-4385-8b7a-1e4dfdb3c397 tempest-CreateVolumesFromSnapshotTest-432970862 None] Lock "cinder-quobyte-35557b12-7702-49b6-9453-9db7be603e7e" released by "delete_volume" :: held 0.760s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:06:23 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-ed1a33ac-c310-4385-8b7a-1e4dfdb3c397 tempest-CreateVolumesFromSnapshotTest-432970862 None] Created reservations ['e6659691-ba51-49ca-83b2-2abd9827b127', '35551650-9484-45e2-8794-a953552354ca', 'cadd70a1-54fa-4b10-82a0-4db7b363f6da', 'cdce7e0c-e0e1-4721-8d61-972f133048a1'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:06:23 devstack sudo[102664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a Aug 10 16:06:23 devstack sudo[102664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:23 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-ed1a33ac-c310-4385-8b7a-1e4dfdb3c397 tempest-CreateVolumesFromSnapshotTest-432970862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:06:23 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-ed1a33ac-c310-4385-8b7a-1e4dfdb3c397 tempest-CreateVolumesFromSnapshotTest-432970862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:06:23 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-ed1a33ac-c310-4385-8b7a-1e4dfdb3c397 tempest-CreateVolumesFromSnapshotTest-432970862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:06:23 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-ed1a33ac-c310-4385-8b7a-1e4dfdb3c397 tempest-CreateVolumesFromSnapshotTest-432970862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:06:23 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-ed1a33ac-c310-4385-8b7a-1e4dfdb3c397 tempest-CreateVolumesFromSnapshotTest-432970862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:06:23 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ed1a33ac-c310-4385-8b7a-1e4dfdb3c397 tempest-CreateVolumesFromSnapshotTest-432970862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:23 devstack sudo[102667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:06:23 devstack sudo[102667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:24 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-095e3866-4c14-4c11-b3cb-ce462b84926d tempest-CreateVolumesFromSnapshotTest-432970862 None] Acquiring lock "cinder-e09c26c8-0824-4605-bb8d-767c12310ece-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:06:24 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-095e3866-4c14-4c11-b3cb-ce462b84926d tempest-CreateVolumesFromSnapshotTest-432970862 None] Lock "cinder-e09c26c8-0824-4605-bb8d-767c12310ece-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:06:24 devstack sudo[102664]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:24 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-095e3866-4c14-4c11-b3cb-ce462b84926d tempest-CreateVolumesFromSnapshotTest-432970862 None] Acquiring lock "cinder-quobyte-e09c26c8-0824-4605-bb8d-767c12310ece" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:06:24 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7cd5e036-0862-433c-8823-019d18ecebf5 tempest-SnapshotsActionsTest-563371099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a" returned: 0 in 0.470s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:24 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7cd5e036-0862-433c-8823-019d18ecebf5 tempest-SnapshotsActionsTest-563371099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:24 devstack sudo[102667]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:24 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ed1a33ac-c310-4385-8b7a-1e4dfdb3c397 tempest-CreateVolumesFromSnapshotTest-432970862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.329s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:24 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-ed1a33ac-c310-4385-8b7a-1e4dfdb3c397 tempest-CreateVolumesFromSnapshotTest-432970862 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:06:24 devstack sudo[102673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a Aug 10 16:06:24 devstack sudo[102673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:24 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-095e3866-4c14-4c11-b3cb-ce462b84926d tempest-CreateVolumesFromSnapshotTest-432970862 None] Lock "cinder-quobyte-e09c26c8-0824-4605-bb8d-767c12310ece" acquired by "delete_volume" :: waited 0.040s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:06:24 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-ed1a33ac-c310-4385-8b7a-1e4dfdb3c397 tempest-CreateVolumesFromSnapshotTest-432970862 None] Deleted volume successfully. Aug 10 16:06:24 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e5c2b0-0f2f-4376-8b4c-fba589b6b679]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:06:24 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-095e3866-4c14-4c11-b3cb-ce462b84926d tempest-CreateVolumesFromSnapshotTest-432970862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-e09c26c8-0824-4605-bb8d-767c12310ece {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:24 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-ed1a33ac-c310-4385-8b7a-1e4dfdb3c397 tempest-CreateVolumesFromSnapshotTest-432970862 None] Lock "cinder-35557b12-7702-49b6-9453-9db7be603e7e-delete_volume" released by "delete_volume" :: held 1.381s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:06:24 devstack sudo[102675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-e09c26c8-0824-4605-bb8d-767c12310ece Aug 10 16:06:24 devstack sudo[102675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:24 devstack sudo[102673]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:24 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7cd5e036-0862-433c-8823-019d18ecebf5 tempest-SnapshotsActionsTest-563371099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a1d127d8-4b1f-4309-9b71-98698e5dae7a" returned: 0 in 0.288s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:24 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-7cd5e036-0862-433c-8823-019d18ecebf5 tempest-SnapshotsActionsTest-563371099 None] Lock "cinder-quobyte-a1d127d8-4b1f-4309-9b71-98698e5dae7a" released by "delete_volume" :: held 0.853s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:06:24 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-7cd5e036-0862-433c-8823-019d18ecebf5 tempest-SnapshotsActionsTest-563371099 None] Created reservations ['4fea694f-01e3-4d3d-b95f-f6212f87feb1', '75c31862-8b50-46bb-87cf-d925cd8b4391', '47493c70-ab28-42c0-97b2-dc47c3bf734e', '21203edf-224b-4b46-b166-6c0dd998d4fd'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:06:24 devstack sudo[102675]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:24 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-7cd5e036-0862-433c-8823-019d18ecebf5 tempest-SnapshotsActionsTest-563371099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:06:24 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-7cd5e036-0862-433c-8823-019d18ecebf5 tempest-SnapshotsActionsTest-563371099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:06:24 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-7cd5e036-0862-433c-8823-019d18ecebf5 tempest-SnapshotsActionsTest-563371099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:06:24 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-7cd5e036-0862-433c-8823-019d18ecebf5 tempest-SnapshotsActionsTest-563371099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:06:24 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-7cd5e036-0862-433c-8823-019d18ecebf5 tempest-SnapshotsActionsTest-563371099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:06:24 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7cd5e036-0862-433c-8823-019d18ecebf5 tempest-SnapshotsActionsTest-563371099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:24 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-095e3866-4c14-4c11-b3cb-ce462b84926d tempest-CreateVolumesFromSnapshotTest-432970862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-e09c26c8-0824-4605-bb8d-767c12310ece" returned: 0 in 0.531s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:24 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-095e3866-4c14-4c11-b3cb-ce462b84926d tempest-CreateVolumesFromSnapshotTest-432970862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-e09c26c8-0824-4605-bb8d-767c12310ece {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:24 devstack sudo[102682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:06:24 devstack sudo[102682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:24 devstack sudo[102683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-e09c26c8-0824-4605-bb8d-767c12310ece Aug 10 16:06:24 devstack sudo[102683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:25 devstack sudo[102682]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:25 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7cd5e036-0862-433c-8823-019d18ecebf5 tempest-SnapshotsActionsTest-563371099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.262s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:25 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-7cd5e036-0862-433c-8823-019d18ecebf5 tempest-SnapshotsActionsTest-563371099 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:06:25 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-7cd5e036-0862-433c-8823-019d18ecebf5 tempest-SnapshotsActionsTest-563371099 None] Deleted volume successfully. Aug 10 16:06:25 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-7cd5e036-0862-433c-8823-019d18ecebf5 tempest-SnapshotsActionsTest-563371099 None] Lock "cinder-a1d127d8-4b1f-4309-9b71-98698e5dae7a-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:06:25 devstack sudo[102683]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:25 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-095e3866-4c14-4c11-b3cb-ce462b84926d tempest-CreateVolumesFromSnapshotTest-432970862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-e09c26c8-0824-4605-bb8d-767c12310ece" returned: 0 in 0.302s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:25 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-095e3866-4c14-4c11-b3cb-ce462b84926d tempest-CreateVolumesFromSnapshotTest-432970862 None] Lock "cinder-quobyte-e09c26c8-0824-4605-bb8d-767c12310ece" released by "delete_volume" :: held 0.893s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:06:25 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-095e3866-4c14-4c11-b3cb-ce462b84926d tempest-CreateVolumesFromSnapshotTest-432970862 None] Created reservations ['d7e14c53-d89b-4fd7-9f80-090ceaf88fa0', '99a3a5c4-c3f3-493a-80cb-ae1aec96cc50', 'ef1eea96-7058-4f66-9bd0-62979023c07b', '71d37298-848d-422c-8528-45a472ca1787'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:06:25 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-095e3866-4c14-4c11-b3cb-ce462b84926d tempest-CreateVolumesFromSnapshotTest-432970862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:06:25 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-095e3866-4c14-4c11-b3cb-ce462b84926d tempest-CreateVolumesFromSnapshotTest-432970862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:06:25 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-095e3866-4c14-4c11-b3cb-ce462b84926d tempest-CreateVolumesFromSnapshotTest-432970862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:06:25 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-095e3866-4c14-4c11-b3cb-ce462b84926d tempest-CreateVolumesFromSnapshotTest-432970862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:06:25 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-095e3866-4c14-4c11-b3cb-ce462b84926d tempest-CreateVolumesFromSnapshotTest-432970862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:06:25 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-095e3866-4c14-4c11-b3cb-ce462b84926d tempest-CreateVolumesFromSnapshotTest-432970862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:25 devstack sudo[102688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:06:25 devstack sudo[102688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:25 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-2a159fb4-54ec-40c9-95c3-89a03d231687 tempest-CreateVolumesFromSnapshotTest-432970862 None] Acquiring lock "cinder-ea7e1a63-b2d0-42c2-af48-32710587dada-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:06:25 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-2a159fb4-54ec-40c9-95c3-89a03d231687 tempest-CreateVolumesFromSnapshotTest-432970862 None] Lock "cinder-ea7e1a63-b2d0-42c2-af48-32710587dada-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:06:25 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-2a159fb4-54ec-40c9-95c3-89a03d231687 tempest-CreateVolumesFromSnapshotTest-432970862 None] Acquiring lock "cinder-quobyte-ea7e1a63-b2d0-42c2-af48-32710587dada" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:06:25 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-2a159fb4-54ec-40c9-95c3-89a03d231687 tempest-CreateVolumesFromSnapshotTest-432970862 None] Lock "cinder-quobyte-ea7e1a63-b2d0-42c2-af48-32710587dada" acquired by "delete_volume" :: waited 0.018s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:06:25 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[917df6cd-ddd7-4e8b-8166-f4d08032c0b1]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:06:25 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-2a159fb4-54ec-40c9-95c3-89a03d231687 tempest-CreateVolumesFromSnapshotTest-432970862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-ea7e1a63-b2d0-42c2-af48-32710587dada {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:25 devstack sudo[102690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-ea7e1a63-b2d0-42c2-af48-32710587dada Aug 10 16:06:25 devstack sudo[102690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:25 devstack sudo[102688]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:25 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-095e3866-4c14-4c11-b3cb-ce462b84926d tempest-CreateVolumesFromSnapshotTest-432970862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.314s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:25 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-095e3866-4c14-4c11-b3cb-ce462b84926d tempest-CreateVolumesFromSnapshotTest-432970862 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:06:25 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-095e3866-4c14-4c11-b3cb-ce462b84926d tempest-CreateVolumesFromSnapshotTest-432970862 None] Deleted volume successfully. Aug 10 16:06:25 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-095e3866-4c14-4c11-b3cb-ce462b84926d tempest-CreateVolumesFromSnapshotTest-432970862 None] Lock "cinder-e09c26c8-0824-4605-bb8d-767c12310ece-delete_volume" released by "delete_volume" :: held 1.484s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:06:25 devstack sudo[102690]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:25 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-2a159fb4-54ec-40c9-95c3-89a03d231687 tempest-CreateVolumesFromSnapshotTest-432970862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-ea7e1a63-b2d0-42c2-af48-32710587dada" returned: 0 in 0.468s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:25 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-2a159fb4-54ec-40c9-95c3-89a03d231687 tempest-CreateVolumesFromSnapshotTest-432970862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-ea7e1a63-b2d0-42c2-af48-32710587dada {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:25 devstack sudo[102696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-ea7e1a63-b2d0-42c2-af48-32710587dada Aug 10 16:06:25 devstack sudo[102696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:26 devstack sudo[102696]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:26 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-2a159fb4-54ec-40c9-95c3-89a03d231687 tempest-CreateVolumesFromSnapshotTest-432970862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-ea7e1a63-b2d0-42c2-af48-32710587dada" returned: 0 in 0.393s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:26 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-2a159fb4-54ec-40c9-95c3-89a03d231687 tempest-CreateVolumesFromSnapshotTest-432970862 None] Lock "cinder-quobyte-ea7e1a63-b2d0-42c2-af48-32710587dada" released by "delete_volume" :: held 0.912s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:06:26 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-2a159fb4-54ec-40c9-95c3-89a03d231687 tempest-CreateVolumesFromSnapshotTest-432970862 None] Created reservations ['6e42e73e-ced1-4c11-b37d-bd72c2b3b014', '0e45ca38-201d-4c05-ab1b-5570498de742', '56a5c0b0-a9a5-4c18-bd0d-23b7589aae13', 'bd25ddf6-c21c-4c83-820a-754d6e599ad4'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:06:26 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-2a159fb4-54ec-40c9-95c3-89a03d231687 tempest-CreateVolumesFromSnapshotTest-432970862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:06:26 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-2a159fb4-54ec-40c9-95c3-89a03d231687 tempest-CreateVolumesFromSnapshotTest-432970862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:06:26 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-2a159fb4-54ec-40c9-95c3-89a03d231687 tempest-CreateVolumesFromSnapshotTest-432970862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:06:26 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-2a159fb4-54ec-40c9-95c3-89a03d231687 tempest-CreateVolumesFromSnapshotTest-432970862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:06:26 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-2a159fb4-54ec-40c9-95c3-89a03d231687 tempest-CreateVolumesFromSnapshotTest-432970862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:06:26 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-2a159fb4-54ec-40c9-95c3-89a03d231687 tempest-CreateVolumesFromSnapshotTest-432970862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:26 devstack sudo[102699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:06:26 devstack sudo[102699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:26 devstack sudo[102699]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:26 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-2a159fb4-54ec-40c9-95c3-89a03d231687 tempest-CreateVolumesFromSnapshotTest-432970862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.312s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:26 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-2a159fb4-54ec-40c9-95c3-89a03d231687 tempest-CreateVolumesFromSnapshotTest-432970862 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:06:26 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-2a159fb4-54ec-40c9-95c3-89a03d231687 tempest-CreateVolumesFromSnapshotTest-432970862 None] Deleted volume successfully. Aug 10 16:06:26 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-2a159fb4-54ec-40c9-95c3-89a03d231687 tempest-CreateVolumesFromSnapshotTest-432970862 None] Lock "cinder-ea7e1a63-b2d0-42c2-af48-32710587dada-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:06:27 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-c3d32998-adb4-4f0e-ac92-8ccc851b0410 tempest-CreateVolumesFromSnapshotTest-432970862 None] Acquiring lock "cinder-c8a1e4a8-5650-4d83-93cb-e58885776528-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:06:27 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-c3d32998-adb4-4f0e-ac92-8ccc851b0410 tempest-CreateVolumesFromSnapshotTest-432970862 None] Lock "cinder-c8a1e4a8-5650-4d83-93cb-e58885776528-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:06:27 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-c3d32998-adb4-4f0e-ac92-8ccc851b0410 tempest-CreateVolumesFromSnapshotTest-432970862 None] Acquiring lock "cinder-quobyte-c8a1e4a8-5650-4d83-93cb-e58885776528" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:06:27 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-c3d32998-adb4-4f0e-ac92-8ccc851b0410 tempest-CreateVolumesFromSnapshotTest-432970862 None] Lock "cinder-quobyte-c8a1e4a8-5650-4d83-93cb-e58885776528" acquired by "delete_volume" :: waited 0.015s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:06:27 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[0265ad6b-519f-4ff5-ab02-3a59e98a8547]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:06:27 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c3d32998-adb4-4f0e-ac92-8ccc851b0410 tempest-CreateVolumesFromSnapshotTest-432970862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c8a1e4a8-5650-4d83-93cb-e58885776528 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:27 devstack sudo[102702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c8a1e4a8-5650-4d83-93cb-e58885776528 Aug 10 16:06:27 devstack sudo[102702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:28 devstack sudo[102702]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:28 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c3d32998-adb4-4f0e-ac92-8ccc851b0410 tempest-CreateVolumesFromSnapshotTest-432970862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c8a1e4a8-5650-4d83-93cb-e58885776528" returned: 0 in 0.431s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:28 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c3d32998-adb4-4f0e-ac92-8ccc851b0410 tempest-CreateVolumesFromSnapshotTest-432970862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c8a1e4a8-5650-4d83-93cb-e58885776528 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:28 devstack sudo[102707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c8a1e4a8-5650-4d83-93cb-e58885776528 Aug 10 16:06:28 devstack sudo[102707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:28 devstack sudo[102707]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:28 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c3d32998-adb4-4f0e-ac92-8ccc851b0410 tempest-CreateVolumesFromSnapshotTest-432970862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c8a1e4a8-5650-4d83-93cb-e58885776528" returned: 0 in 0.319s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:28 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-c3d32998-adb4-4f0e-ac92-8ccc851b0410 tempest-CreateVolumesFromSnapshotTest-432970862 None] Lock "cinder-quobyte-c8a1e4a8-5650-4d83-93cb-e58885776528" released by "delete_volume" :: held 0.812s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:06:28 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-c3d32998-adb4-4f0e-ac92-8ccc851b0410 tempest-CreateVolumesFromSnapshotTest-432970862 None] Created reservations ['00e83bec-fb06-46a8-9c2b-cef0df21b0a8', '17bf413b-dc97-410c-bde9-0c24982da570', 'a0836aaa-1b66-4942-8924-7af4ceb93312', 'd6244998-e3a6-412b-9d97-90d87f765a17'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:06:28 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-c3d32998-adb4-4f0e-ac92-8ccc851b0410 tempest-CreateVolumesFromSnapshotTest-432970862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:06:28 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-c3d32998-adb4-4f0e-ac92-8ccc851b0410 tempest-CreateVolumesFromSnapshotTest-432970862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:06:28 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-c3d32998-adb4-4f0e-ac92-8ccc851b0410 tempest-CreateVolumesFromSnapshotTest-432970862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:06:28 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-c3d32998-adb4-4f0e-ac92-8ccc851b0410 tempest-CreateVolumesFromSnapshotTest-432970862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:06:28 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-c3d32998-adb4-4f0e-ac92-8ccc851b0410 tempest-CreateVolumesFromSnapshotTest-432970862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:06:28 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c3d32998-adb4-4f0e-ac92-8ccc851b0410 tempest-CreateVolumesFromSnapshotTest-432970862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:28 devstack sudo[102710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:06:28 devstack sudo[102710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:28 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-003ee3a8-4641-4a4a-942c-0cc962eb6e3a tempest-CreateVolumesFromSnapshotTest-432970862 None] Acquiring lock "cinder-c92f0af2-c929-41d5-87be-26061ca70216-delete_snapshot" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:06:28 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-003ee3a8-4641-4a4a-942c-0cc962eb6e3a tempest-CreateVolumesFromSnapshotTest-432970862 None] Lock "cinder-c92f0af2-c929-41d5-87be-26061ca70216-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:06:28 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-003ee3a8-4641-4a4a-942c-0cc962eb6e3a tempest-CreateVolumesFromSnapshotTest-432970862 None] Acquiring lock "cinder-quobyte-059752c8-e711-4af3-853c-aa8a3385f4a6" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:06:28 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-003ee3a8-4641-4a4a-942c-0cc962eb6e3a tempest-CreateVolumesFromSnapshotTest-432970862 None] Lock "cinder-quobyte-059752c8-e711-4af3-853c-aa8a3385f4a6" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:06:28 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-003ee3a8-4641-4a4a-942c-0cc962eb6e3a tempest-CreateVolumesFromSnapshotTest-432970862 None] Acquiring lock "cinder-quobyte-c92f0af2-c929-41d5-87be-26061ca70216" by "_delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:06:29 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-003ee3a8-4641-4a4a-942c-0cc962eb6e3a tempest-CreateVolumesFromSnapshotTest-432970862 None] Lock "cinder-quobyte-c92f0af2-c929-41d5-87be-26061ca70216" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:06:29 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-003ee3a8-4641-4a4a-942c-0cc962eb6e3a tempest-CreateVolumesFromSnapshotTest-432970862 None] Deleting offline snapshot c92f0af2-c929-41d5-87be-26061ca70216 of volume 059752c8-e711-4af3-853c-aa8a3385f4a6 {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 16:06:29 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-003ee3a8-4641-4a4a-942c-0cc962eb6e3a tempest-CreateVolumesFromSnapshotTest-432970862 None] snapshot_file for this snap is: volume-059752c8-e711-4af3-853c-aa8a3385f4a6.c92f0af2-c929-41d5-87be-26061ca70216 {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 16:06:29 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[c18b9e38-3017-46c7-a4b6-1c78795eb80b]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:06:29 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-003ee3a8-4641-4a4a-942c-0cc962eb6e3a tempest-CreateVolumesFromSnapshotTest-432970862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-059752c8-e711-4af3-853c-aa8a3385f4a6.c92f0af2-c929-41d5-87be-26061ca70216 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:29 devstack sudo[102710]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:29 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c3d32998-adb4-4f0e-ac92-8ccc851b0410 tempest-CreateVolumesFromSnapshotTest-432970862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.371s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:29 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-c3d32998-adb4-4f0e-ac92-8ccc851b0410 tempest-CreateVolumesFromSnapshotTest-432970862 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:06:29 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-c3d32998-adb4-4f0e-ac92-8ccc851b0410 tempest-CreateVolumesFromSnapshotTest-432970862 None] Deleted volume successfully. Aug 10 16:06:29 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-c3d32998-adb4-4f0e-ac92-8ccc851b0410 tempest-CreateVolumesFromSnapshotTest-432970862 None] Lock "cinder-c8a1e4a8-5650-4d83-93cb-e58885776528-delete_volume" released by "delete_volume" :: held 1.450s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:06:29 devstack sudo[102713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-059752c8-e711-4af3-853c-aa8a3385f4a6.c92f0af2-c929-41d5-87be-26061ca70216 Aug 10 16:06:29 devstack sudo[102713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:29 devstack sudo[102713]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:29 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-003ee3a8-4641-4a4a-942c-0cc962eb6e3a tempest-CreateVolumesFromSnapshotTest-432970862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-059752c8-e711-4af3-853c-aa8a3385f4a6.c92f0af2-c929-41d5-87be-26061ca70216" returned: 0 in 0.457s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:29 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-003ee3a8-4641-4a4a-942c-0cc962eb6e3a tempest-CreateVolumesFromSnapshotTest-432970862 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-059752c8-e711-4af3-853c-aa8a3385f4a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 16:06:29 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee845acf-eb7e-4bbd-a1d3-83be2cbe9802]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:06:29 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-003ee3a8-4641-4a4a-942c-0cc962eb6e3a tempest-CreateVolumesFromSnapshotTest-432970862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-059752c8-e711-4af3-853c-aa8a3385f4a6 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:29 devstack sudo[102719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-059752c8-e711-4af3-853c-aa8a3385f4a6 Aug 10 16:06:29 devstack sudo[102719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:30 devstack sudo[102719]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:30 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-003ee3a8-4641-4a4a-942c-0cc962eb6e3a tempest-CreateVolumesFromSnapshotTest-432970862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-059752c8-e711-4af3-853c-aa8a3385f4a6" returned: 0 in 0.447s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:30 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-003ee3a8-4641-4a4a-942c-0cc962eb6e3a tempest-CreateVolumesFromSnapshotTest-432970862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-059752c8-e711-4af3-853c-aa8a3385f4a6.c92f0af2-c929-41d5-87be-26061ca70216 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:30 devstack sudo[102724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-059752c8-e711-4af3-853c-aa8a3385f4a6.c92f0af2-c929-41d5-87be-26061ca70216 Aug 10 16:06:30 devstack sudo[102724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:30 devstack sudo[102724]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:30 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-003ee3a8-4641-4a4a-942c-0cc962eb6e3a tempest-CreateVolumesFromSnapshotTest-432970862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-059752c8-e711-4af3-853c-aa8a3385f4a6.c92f0af2-c929-41d5-87be-26061ca70216" returned: 0 in 0.417s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:30 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-003ee3a8-4641-4a4a-942c-0cc962eb6e3a tempest-CreateVolumesFromSnapshotTest-432970862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-059752c8-e711-4af3-853c-aa8a3385f4a6.c92f0af2-c929-41d5-87be-26061ca70216 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:30 devstack sudo[102730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-059752c8-e711-4af3-853c-aa8a3385f4a6.c92f0af2-c929-41d5-87be-26061ca70216 Aug 10 16:06:30 devstack sudo[102730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:30 devstack sudo[102730]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:30 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-003ee3a8-4641-4a4a-942c-0cc962eb6e3a tempest-CreateVolumesFromSnapshotTest-432970862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-059752c8-e711-4af3-853c-aa8a3385f4a6.c92f0af2-c929-41d5-87be-26061ca70216" returned: 0 in 0.295s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:30 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-003ee3a8-4641-4a4a-942c-0cc962eb6e3a tempest-CreateVolumesFromSnapshotTest-432970862 None] Lock "cinder-quobyte-c92f0af2-c929-41d5-87be-26061ca70216" released by "_delete_snapshot" :: held 1.789s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:06:30 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-003ee3a8-4641-4a4a-942c-0cc962eb6e3a tempest-CreateVolumesFromSnapshotTest-432970862 None] Lock "cinder-quobyte-059752c8-e711-4af3-853c-aa8a3385f4a6" released by "delete_snapshot" :: held 1.844s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:06:30 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-003ee3a8-4641-4a4a-942c-0cc962eb6e3a tempest-CreateVolumesFromSnapshotTest-432970862 None] Created reservations ['eaa505d1-0da9-4425-88d0-84aa79917624', 'e5c01084-a9ae-4bb8-8af3-091663e2c431', 'c1ab56c6-e50f-4b79-8b62-ff1457c6cfb5', '2a073c5d-0a13-4192-a6b7-ba380cd06a83'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:06:30 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-003ee3a8-4641-4a4a-942c-0cc962eb6e3a tempest-CreateVolumesFromSnapshotTest-432970862 None] Delete snapshot completed successfully. Aug 10 16:06:30 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-003ee3a8-4641-4a4a-942c-0cc962eb6e3a tempest-CreateVolumesFromSnapshotTest-432970862 None] Lock "cinder-c92f0af2-c929-41d5-87be-26061ca70216-delete_snapshot" released by "delete_snapshot" :: held 2.023s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:06:31 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-fbed85c6-899d-4bd0-b367-2e38111f7e80 tempest-CreateVolumesFromSnapshotTest-432970862 None] Acquiring lock "cinder-059752c8-e711-4af3-853c-aa8a3385f4a6-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:06:31 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-fbed85c6-899d-4bd0-b367-2e38111f7e80 tempest-CreateVolumesFromSnapshotTest-432970862 None] Lock "cinder-059752c8-e711-4af3-853c-aa8a3385f4a6-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:06:31 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-fbed85c6-899d-4bd0-b367-2e38111f7e80 tempest-CreateVolumesFromSnapshotTest-432970862 None] Acquiring lock "cinder-quobyte-059752c8-e711-4af3-853c-aa8a3385f4a6" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:06:31 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-fbed85c6-899d-4bd0-b367-2e38111f7e80 tempest-CreateVolumesFromSnapshotTest-432970862 None] Lock "cinder-quobyte-059752c8-e711-4af3-853c-aa8a3385f4a6" acquired by "delete_volume" :: waited 0.019s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:06:31 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[e88fd395-f08f-4faf-b38c-a187bec98da3]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:06:31 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fbed85c6-899d-4bd0-b367-2e38111f7e80 tempest-CreateVolumesFromSnapshotTest-432970862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-059752c8-e711-4af3-853c-aa8a3385f4a6 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:31 devstack sudo[102733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-059752c8-e711-4af3-853c-aa8a3385f4a6 Aug 10 16:06:31 devstack sudo[102733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:31 devstack sudo[102733]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:31 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fbed85c6-899d-4bd0-b367-2e38111f7e80 tempest-CreateVolumesFromSnapshotTest-432970862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-059752c8-e711-4af3-853c-aa8a3385f4a6" returned: 0 in 0.422s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:31 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fbed85c6-899d-4bd0-b367-2e38111f7e80 tempest-CreateVolumesFromSnapshotTest-432970862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-059752c8-e711-4af3-853c-aa8a3385f4a6 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:31 devstack sudo[102738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-059752c8-e711-4af3-853c-aa8a3385f4a6 Aug 10 16:06:31 devstack sudo[102738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:31 devstack sudo[102738]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:31 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fbed85c6-899d-4bd0-b367-2e38111f7e80 tempest-CreateVolumesFromSnapshotTest-432970862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-059752c8-e711-4af3-853c-aa8a3385f4a6" returned: 0 in 0.293s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:31 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-fbed85c6-899d-4bd0-b367-2e38111f7e80 tempest-CreateVolumesFromSnapshotTest-432970862 None] Lock "cinder-quobyte-059752c8-e711-4af3-853c-aa8a3385f4a6" released by "delete_volume" :: held 0.800s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:06:32 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-fbed85c6-899d-4bd0-b367-2e38111f7e80 tempest-CreateVolumesFromSnapshotTest-432970862 None] Created reservations ['4c2d354a-87a4-4a24-ba34-24f8920fbb87', '288993d0-a852-49a2-b2af-5ae001f7ac77', '7d0ff15a-f340-4a06-b951-6488d8b3f6ba', '18864f41-9937-4656-ad9a-b5202b363fea'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:06:32 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-fbed85c6-899d-4bd0-b367-2e38111f7e80 tempest-CreateVolumesFromSnapshotTest-432970862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:06:32 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-fbed85c6-899d-4bd0-b367-2e38111f7e80 tempest-CreateVolumesFromSnapshotTest-432970862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:06:32 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-fbed85c6-899d-4bd0-b367-2e38111f7e80 tempest-CreateVolumesFromSnapshotTest-432970862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:06:32 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-fbed85c6-899d-4bd0-b367-2e38111f7e80 tempest-CreateVolumesFromSnapshotTest-432970862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:06:32 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-fbed85c6-899d-4bd0-b367-2e38111f7e80 tempest-CreateVolumesFromSnapshotTest-432970862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:06:32 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fbed85c6-899d-4bd0-b367-2e38111f7e80 tempest-CreateVolumesFromSnapshotTest-432970862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:32 devstack sudo[102742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:06:32 devstack sudo[102742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:32 devstack sudo[102742]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:32 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fbed85c6-899d-4bd0-b367-2e38111f7e80 tempest-CreateVolumesFromSnapshotTest-432970862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.385s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:32 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-fbed85c6-899d-4bd0-b367-2e38111f7e80 tempest-CreateVolumesFromSnapshotTest-432970862 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:06:32 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-fbed85c6-899d-4bd0-b367-2e38111f7e80 tempest-CreateVolumesFromSnapshotTest-432970862 None] Deleted volume successfully. Aug 10 16:06:32 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-fbed85c6-899d-4bd0-b367-2e38111f7e80 tempest-CreateVolumesFromSnapshotTest-432970862 None] Lock "cinder-059752c8-e711-4af3-853c-aa8a3385f4a6-delete_volume" released by "delete_volume" :: held 1.460s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:06:36 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2b37fcb-47f0-4101-8473-6af05a1aec4b tempest-VolumeDependencyTests-2102328531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:06:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d2b37fcb-47f0-4101-8473-6af05a1aec4b tempest-VolumeDependencyTests-2102328531 None] Flow 'volume_create_manager' (a7e2427c-9ca3-4702-b5bb-b299ea2accf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:06:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d2b37fcb-47f0-4101-8473-6af05a1aec4b tempest-VolumeDependencyTests-2102328531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (034d5cc6-f057-4e93-99c9-5be7f158a851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:06:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d2b37fcb-47f0-4101-8473-6af05a1aec4b tempest-VolumeDependencyTests-2102328531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (034d5cc6-f057-4e93-99c9-5be7f158a851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:06:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1260224167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41302d67-600b-4ddb-8f00-26376730d81f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='400a2c6015124bacba17c840c2da4686',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:06:36Z,use_quota=True,user_id='cc4108d471d8428b8eb1197fef6076bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:06:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d2b37fcb-47f0-4101-8473-6af05a1aec4b tempest-VolumeDependencyTests-2102328531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7da3ece5-a337-461c-ab03-08526b1ca3c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:06:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d2b37fcb-47f0-4101-8473-6af05a1aec4b tempest-VolumeDependencyTests-2102328531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7da3ece5-a337-461c-ab03-08526b1ca3c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:06:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d2b37fcb-47f0-4101-8473-6af05a1aec4b tempest-VolumeDependencyTests-2102328531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8e244d2-78e9-434c-8af8-7a171b7aa9a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:06:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d2b37fcb-47f0-4101-8473-6af05a1aec4b tempest-VolumeDependencyTests-2102328531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8e244d2-78e9-434c-8af8-7a171b7aa9a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41302d67-600b-4ddb-8f00-26376730d81f', 'volume_name': 'volume-41302d67-600b-4ddb-8f00-26376730d81f', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:06:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d2b37fcb-47f0-4101-8473-6af05a1aec4b tempest-VolumeDependencyTests-2102328531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a194a2da-f44b-4bce-bcc7-a51961e1b091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:06:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d2b37fcb-47f0-4101-8473-6af05a1aec4b tempest-VolumeDependencyTests-2102328531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a194a2da-f44b-4bce-bcc7-a51961e1b091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:06:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d2b37fcb-47f0-4101-8473-6af05a1aec4b tempest-VolumeDependencyTests-2102328531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00576574-c579-45c1-a5da-3fdb5aa19ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:06:36 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-d2b37fcb-47f0-4101-8473-6af05a1aec4b tempest-VolumeDependencyTests-2102328531 None] Volume 41302d67-600b-4ddb-8f00-26376730d81f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41302d67-600b-4ddb-8f00-26376730d81f', 'volume_size': 1} Aug 10 16:06:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-d2b37fcb-47f0-4101-8473-6af05a1aec4b tempest-VolumeDependencyTests-2102328531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:06:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-d2b37fcb-47f0-4101-8473-6af05a1aec4b tempest-VolumeDependencyTests-2102328531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:06:36 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-d2b37fcb-47f0-4101-8473-6af05a1aec4b tempest-VolumeDependencyTests-2102328531 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:06:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1260224167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41302d67-600b-4ddb-8f00-26376730d81f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='400a2c6015124bacba17c840c2da4686',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:06:36Z,use_quota=True,user_id='cc4108d471d8428b8eb1197fef6076bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:06:36 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-d2b37fcb-47f0-4101-8473-6af05a1aec4b tempest-VolumeDependencyTests-2102328531 None] Creating volume 41302d67-600b-4ddb-8f00-26376730d81f {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:06:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-d2b37fcb-47f0-4101-8473-6af05a1aec4b tempest-VolumeDependencyTests-2102328531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:06:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-d2b37fcb-47f0-4101-8473-6af05a1aec4b tempest-VolumeDependencyTests-2102328531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:06:36 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-d2b37fcb-47f0-4101-8473-6af05a1aec4b tempest-VolumeDependencyTests-2102328531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:06:36 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-d2b37fcb-47f0-4101-8473-6af05a1aec4b tempest-VolumeDependencyTests-2102328531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:06:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-d2b37fcb-47f0-4101-8473-6af05a1aec4b tempest-VolumeDependencyTests-2102328531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:06:36 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-d2b37fcb-47f0-4101-8473-6af05a1aec4b tempest-VolumeDependencyTests-2102328531 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:06:36 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-d2b37fcb-47f0-4101-8473-6af05a1aec4b tempest-VolumeDependencyTests-2102328531 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:06:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d2b37fcb-47f0-4101-8473-6af05a1aec4b tempest-VolumeDependencyTests-2102328531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-41302d67-600b-4ddb-8f00-26376730d81f 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:36 devstack cinder-volume[88641]: DEBUG oslo_service.periodic_task [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88641) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 16:06:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:06:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:06:36 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:06:36 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:06:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:06:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:36 devstack sudo[102747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-41302d67-600b-4ddb-8f00-26376730d81f 1073741824 Aug 10 16:06:36 devstack sudo[102747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:36 devstack sudo[102749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:06:36 devstack sudo[102749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:36 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1815edf-5bef-44ce-b29b-c90726bb9465 tempest-TestStampPattern-1573197444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:06:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b1815edf-5bef-44ce-b29b-c90726bb9465 tempest-TestStampPattern-1573197444 None] Flow 'volume_create_manager' (a1c143a7-1d8a-4982-93cb-df3ececf14e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:06:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b1815edf-5bef-44ce-b29b-c90726bb9465 tempest-TestStampPattern-1573197444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43c20e78-f9ca-48eb-a198-ea1ef51a5b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:06:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b1815edf-5bef-44ce-b29b-c90726bb9465 tempest-TestStampPattern-1573197444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43c20e78-f9ca-48eb-a198-ea1ef51a5b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:06:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1534047251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a4564b4-def3-447b-98ae-a4fa16c5d222,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0d47507aa994b5a9fa6e185329cd7d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:06:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:06:37Z,use_quota=True,user_id='0f614f981bce4ec0845bc44f9e304e40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:06:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b1815edf-5bef-44ce-b29b-c90726bb9465 tempest-TestStampPattern-1573197444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1fccb98-b47c-4b40-973a-1330a0e3507d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:06:36 devstack sudo[102749]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b1815edf-5bef-44ce-b29b-c90726bb9465 tempest-TestStampPattern-1573197444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1fccb98-b47c-4b40-973a-1330a0e3507d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:06:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b1815edf-5bef-44ce-b29b-c90726bb9465 tempest-TestStampPattern-1573197444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8de4453b-e3f2-45b1-ae2a-878990390c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:06:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b1815edf-5bef-44ce-b29b-c90726bb9465 tempest-TestStampPattern-1573197444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8de4453b-e3f2-45b1-ae2a-878990390c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a4564b4-def3-447b-98ae-a4fa16c5d222', 'volume_name': 'volume-4a4564b4-def3-447b-98ae-a4fa16c5d222', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:06:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b1815edf-5bef-44ce-b29b-c90726bb9465 tempest-TestStampPattern-1573197444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d107856a-9900-4b52-b44e-14783eb81763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:06:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b1815edf-5bef-44ce-b29b-c90726bb9465 tempest-TestStampPattern-1573197444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d107856a-9900-4b52-b44e-14783eb81763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:06:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b1815edf-5bef-44ce-b29b-c90726bb9465 tempest-TestStampPattern-1573197444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f4034c6-0507-43b4-a1ee-0dea52fb6b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:06:36 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-b1815edf-5bef-44ce-b29b-c90726bb9465 tempest-TestStampPattern-1573197444 None] Volume 4a4564b4-def3-447b-98ae-a4fa16c5d222: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a4564b4-def3-447b-98ae-a4fa16c5d222', 'volume_size': 1} Aug 10 16:06:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-b1815edf-5bef-44ce-b29b-c90726bb9465 tempest-TestStampPattern-1573197444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:06:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.455s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:36 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:06:36 devstack cinder-volume[88641]: DEBUG oslo_service.periodic_task [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Running periodic task VolumeManager._thread_info {{(pid=88641) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 16:06:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] thread count: 28 {{(pid=88641) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 10 16:06:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] thread info: [<_MainThread(MainThread, started 127361545748608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88641) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 10 16:06:37 devstack sudo[102747]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d2b37fcb-47f0-4101-8473-6af05a1aec4b tempest-VolumeDependencyTests-2102328531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-41302d67-600b-4ddb-8f00-26376730d81f 1073741824" returned: 0 in 0.625s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d2b37fcb-47f0-4101-8473-6af05a1aec4b tempest-VolumeDependencyTests-2102328531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-41302d67-600b-4ddb-8f00-26376730d81f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:37 devstack sudo[102756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-41302d67-600b-4ddb-8f00-26376730d81f Aug 10 16:06:37 devstack sudo[102756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:37 devstack sudo[102756]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d2b37fcb-47f0-4101-8473-6af05a1aec4b tempest-VolumeDependencyTests-2102328531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-41302d67-600b-4ddb-8f00-26376730d81f" returned: 0 in 0.308s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:37 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-d2b37fcb-47f0-4101-8473-6af05a1aec4b tempest-VolumeDependencyTests-2102328531 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:06:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-d2b37fcb-47f0-4101-8473-6af05a1aec4b tempest-VolumeDependencyTests-2102328531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:06:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-b1815edf-5bef-44ce-b29b-c90726bb9465 tempest-TestStampPattern-1573197444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.491s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:06:37 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-b1815edf-5bef-44ce-b29b-c90726bb9465 tempest-TestStampPattern-1573197444 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:06:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1534047251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a4564b4-def3-447b-98ae-a4fa16c5d222,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0d47507aa994b5a9fa6e185329cd7d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:06:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:06:37Z,use_quota=True,user_id='0f614f981bce4ec0845bc44f9e304e40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:06:37 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-b1815edf-5bef-44ce-b29b-c90726bb9465 tempest-TestStampPattern-1573197444 None] Creating volume 4a4564b4-def3-447b-98ae-a4fa16c5d222 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:06:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-b1815edf-5bef-44ce-b29b-c90726bb9465 tempest-TestStampPattern-1573197444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:06:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-b1815edf-5bef-44ce-b29b-c90726bb9465 tempest-TestStampPattern-1573197444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:06:37 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-b1815edf-5bef-44ce-b29b-c90726bb9465 tempest-TestStampPattern-1573197444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:06:37 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-b1815edf-5bef-44ce-b29b-c90726bb9465 tempest-TestStampPattern-1573197444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:06:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-b1815edf-5bef-44ce-b29b-c90726bb9465 tempest-TestStampPattern-1573197444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:06:37 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-b1815edf-5bef-44ce-b29b-c90726bb9465 tempest-TestStampPattern-1573197444 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:06:37 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-b1815edf-5bef-44ce-b29b-c90726bb9465 tempest-TestStampPattern-1573197444 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:06:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b1815edf-5bef-44ce-b29b-c90726bb9465 tempest-TestStampPattern-1573197444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4a4564b4-def3-447b-98ae-a4fa16c5d222 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:37 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d2b37fcb-47f0-4101-8473-6af05a1aec4b tempest-VolumeDependencyTests-2102328531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00576574-c579-45c1-a5da-3fdb5aa19ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41302d67-600b-4ddb-8f00-26376730d81f', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:06:37 devstack sudo[102759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4a4564b4-def3-447b-98ae-a4fa16c5d222 1073741824 Aug 10 16:06:37 devstack sudo[102759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:37 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d2b37fcb-47f0-4101-8473-6af05a1aec4b tempest-VolumeDependencyTests-2102328531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7af538d5-f136-4731-b05e-4aeada6319b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:06:37 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-d2b37fcb-47f0-4101-8473-6af05a1aec4b tempest-VolumeDependencyTests-2102328531 None] Volume volume-41302d67-600b-4ddb-8f00-26376730d81f (41302d67-600b-4ddb-8f00-26376730d81f): created successfully Aug 10 16:06:37 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d2b37fcb-47f0-4101-8473-6af05a1aec4b tempest-VolumeDependencyTests-2102328531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7af538d5-f136-4731-b05e-4aeada6319b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:06:37 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d2b37fcb-47f0-4101-8473-6af05a1aec4b tempest-VolumeDependencyTests-2102328531 None] Flow 'volume_create_manager' (a7e2427c-9ca3-4702-b5bb-b299ea2accf2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:06:37 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-d2b37fcb-47f0-4101-8473-6af05a1aec4b tempest-VolumeDependencyTests-2102328531 None] Created volume successfully. Aug 10 16:06:37 devstack sudo[102759]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b1815edf-5bef-44ce-b29b-c90726bb9465 tempest-TestStampPattern-1573197444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4a4564b4-def3-447b-98ae-a4fa16c5d222 1073741824" returned: 0 in 0.532s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:38 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b1815edf-5bef-44ce-b29b-c90726bb9465 tempest-TestStampPattern-1573197444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4a4564b4-def3-447b-98ae-a4fa16c5d222 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:38 devstack sudo[102768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4a4564b4-def3-447b-98ae-a4fa16c5d222 Aug 10 16:06:38 devstack sudo[102768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:38 devstack sudo[102768]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:38 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b1815edf-5bef-44ce-b29b-c90726bb9465 tempest-TestStampPattern-1573197444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4a4564b4-def3-447b-98ae-a4fa16c5d222" returned: 0 in 0.293s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:38 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-b1815edf-5bef-44ce-b29b-c90726bb9465 tempest-TestStampPattern-1573197444 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:06:38 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-b1815edf-5bef-44ce-b29b-c90726bb9465 tempest-TestStampPattern-1573197444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:06:38 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b1815edf-5bef-44ce-b29b-c90726bb9465 tempest-TestStampPattern-1573197444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f4034c6-0507-43b4-a1ee-0dea52fb6b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a4564b4-def3-447b-98ae-a4fa16c5d222', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:06:38 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b1815edf-5bef-44ce-b29b-c90726bb9465 tempest-TestStampPattern-1573197444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79d27b66-af11-4a38-bd78-b99e0e00833f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:06:38 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-b1815edf-5bef-44ce-b29b-c90726bb9465 tempest-TestStampPattern-1573197444 None] Volume volume-4a4564b4-def3-447b-98ae-a4fa16c5d222 (4a4564b4-def3-447b-98ae-a4fa16c5d222): created successfully Aug 10 16:06:38 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b1815edf-5bef-44ce-b29b-c90726bb9465 tempest-TestStampPattern-1573197444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79d27b66-af11-4a38-bd78-b99e0e00833f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:06:38 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b1815edf-5bef-44ce-b29b-c90726bb9465 tempest-TestStampPattern-1573197444 None] Flow 'volume_create_manager' (a1c143a7-1d8a-4982-93cb-df3ececf14e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:06:38 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-b1815edf-5bef-44ce-b29b-c90726bb9465 tempest-TestStampPattern-1573197444 None] Created volume successfully. Aug 10 16:06:38 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-40489b62-a97f-4e46-97d0-224b6228baea tempest-VolumeDependencyTests-2102328531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:06:38 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-40489b62-a97f-4e46-97d0-224b6228baea tempest-VolumeDependencyTests-2102328531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:06:38 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-40489b62-a97f-4e46-97d0-224b6228baea tempest-VolumeDependencyTests-2102328531 None] Creating offline snapshot 195075dc-83f3-4d22-83c1-3593335fb540 of volume 41302d67-600b-4ddb-8f00-26376730d81f {{(pid=88641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 16:06:38 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a22ea15-7f29-4fa5-92ea-397ccb3c3ac7]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:06:38 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-40489b62-a97f-4e46-97d0-224b6228baea tempest-VolumeDependencyTests-2102328531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-41302d67-600b-4ddb-8f00-26376730d81f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:38 devstack sudo[102771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-41302d67-600b-4ddb-8f00-26376730d81f Aug 10 16:06:38 devstack sudo[102771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:39 devstack sudo[102771]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:39 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-40489b62-a97f-4e46-97d0-224b6228baea tempest-VolumeDependencyTests-2102328531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-41302d67-600b-4ddb-8f00-26376730d81f" returned: 0 in 0.444s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:39 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-40489b62-a97f-4e46-97d0-224b6228baea tempest-VolumeDependencyTests-2102328531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-41302d67-600b-4ddb-8f00-26376730d81f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-41302d67-600b-4ddb-8f00-26376730d81f.195075dc-83f3-4d22-83c1-3593335fb540 1G {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:39 devstack sudo[102777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-41302d67-600b-4ddb-8f00-26376730d81f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-41302d67-600b-4ddb-8f00-26376730d81f.195075dc-83f3-4d22-83c1-3593335fb540 1G Aug 10 16:06:39 devstack sudo[102777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:39 devstack sudo[102777]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:39 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-40489b62-a97f-4e46-97d0-224b6228baea tempest-VolumeDependencyTests-2102328531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-41302d67-600b-4ddb-8f00-26376730d81f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-41302d67-600b-4ddb-8f00-26376730d81f.195075dc-83f3-4d22-83c1-3593335fb540 1G" returned: 0 in 0.634s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:39 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-40489b62-a97f-4e46-97d0-224b6228baea tempest-VolumeDependencyTests-2102328531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41302d67-600b-4ddb-8f00-26376730d81f -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-41302d67-600b-4ddb-8f00-26376730d81f.195075dc-83f3-4d22-83c1-3593335fb540 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:39 devstack sudo[102786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41302d67-600b-4ddb-8f00-26376730d81f -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-41302d67-600b-4ddb-8f00-26376730d81f.195075dc-83f3-4d22-83c1-3593335fb540 Aug 10 16:06:39 devstack sudo[102786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:40 devstack sudo[102786]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:40 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-40489b62-a97f-4e46-97d0-224b6228baea tempest-VolumeDependencyTests-2102328531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41302d67-600b-4ddb-8f00-26376730d81f -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-41302d67-600b-4ddb-8f00-26376730d81f.195075dc-83f3-4d22-83c1-3593335fb540" returned: 0 in 0.372s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:40 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-40489b62-a97f-4e46-97d0-224b6228baea tempest-VolumeDependencyTests-2102328531 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-41302d67-600b-4ddb-8f00-26376730d81f.195075dc-83f3-4d22-83c1-3593335fb540 is being set with open permissions: ugo+rw Aug 10 16:06:40 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-40489b62-a97f-4e46-97d0-224b6228baea tempest-VolumeDependencyTests-2102328531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-41302d67-600b-4ddb-8f00-26376730d81f.195075dc-83f3-4d22-83c1-3593335fb540 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:40 devstack sudo[102801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-41302d67-600b-4ddb-8f00-26376730d81f.195075dc-83f3-4d22-83c1-3593335fb540 Aug 10 16:06:40 devstack sudo[102801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:40 devstack sudo[102801]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:40 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-40489b62-a97f-4e46-97d0-224b6228baea tempest-VolumeDependencyTests-2102328531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-41302d67-600b-4ddb-8f00-26376730d81f.195075dc-83f3-4d22-83c1-3593335fb540" returned: 0 in 0.436s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:40 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-40489b62-a97f-4e46-97d0-224b6228baea tempest-VolumeDependencyTests-2102328531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-41302d67-600b-4ddb-8f00-26376730d81f.info {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:40 devstack sudo[102806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-41302d67-600b-4ddb-8f00-26376730d81f.info Aug 10 16:06:40 devstack sudo[102806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:40 devstack sudo[102806]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:40 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-40489b62-a97f-4e46-97d0-224b6228baea tempest-VolumeDependencyTests-2102328531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-41302d67-600b-4ddb-8f00-26376730d81f.info" returned: 0 in 0.302s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:41 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-40489b62-a97f-4e46-97d0-224b6228baea tempest-VolumeDependencyTests-2102328531 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-41302d67-600b-4ddb-8f00-26376730d81f.info is being set with open permissions: ugo+rw Aug 10 16:06:41 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-40489b62-a97f-4e46-97d0-224b6228baea tempest-VolumeDependencyTests-2102328531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-41302d67-600b-4ddb-8f00-26376730d81f.info {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:41 devstack sudo[102809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-41302d67-600b-4ddb-8f00-26376730d81f.info Aug 10 16:06:41 devstack sudo[102809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:41 devstack sudo[102809]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:41 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-40489b62-a97f-4e46-97d0-224b6228baea tempest-VolumeDependencyTests-2102328531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-41302d67-600b-4ddb-8f00-26376730d81f.info" returned: 0 in 0.293s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:41 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-40489b62-a97f-4e46-97d0-224b6228baea tempest-VolumeDependencyTests-2102328531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.621s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:06:41 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-40489b62-a97f-4e46-97d0-224b6228baea tempest-VolumeDependencyTests-2102328531 None] Create snapshot completed successfully Aug 10 16:06:42 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-a219be7b-0677-44e0-a382-daa6150e3457 tempest-VolumeDependencyTests-2102328531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:06:42 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-a219be7b-0677-44e0-a382-daa6150e3457 tempest-VolumeDependencyTests-2102328531 None] Flow 'volume_create_manager' (975a1417-062a-4d0d-b2ef-83f6fc479ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:06:42 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-a219be7b-0677-44e0-a382-daa6150e3457 tempest-VolumeDependencyTests-2102328531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74a889e3-b647-479f-b4b5-52217d5960a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:06:42 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-a219be7b-0677-44e0-a382-daa6150e3457 tempest-VolumeDependencyTests-2102328531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74a889e3-b647-479f-b4b5-52217d5960a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:06:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1892413436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b14dc7d0-9c47-4144-8dd0-bc3061b8c555,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='400a2c6015124bacba17c840c2da4686',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:06:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=195075dc-83f3-4d22-83c1-3593335fb540,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:06:43Z,use_quota=True,user_id='cc4108d471d8428b8eb1197fef6076bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:06:42 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-a219be7b-0677-44e0-a382-daa6150e3457 tempest-VolumeDependencyTests-2102328531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (623fc3d6-bb61-4f31-817e-3a27358da540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:06:42 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-a219be7b-0677-44e0-a382-daa6150e3457 tempest-VolumeDependencyTests-2102328531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (623fc3d6-bb61-4f31-817e-3a27358da540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:06:42 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-a219be7b-0677-44e0-a382-daa6150e3457 tempest-VolumeDependencyTests-2102328531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faa0eea5-8d2c-4cbe-8ace-a235c55d64aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:06:42 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-a219be7b-0677-44e0-a382-daa6150e3457 tempest-VolumeDependencyTests-2102328531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faa0eea5-8d2c-4cbe-8ace-a235c55d64aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b14dc7d0-9c47-4144-8dd0-bc3061b8c555', 'volume_name': 'volume-b14dc7d0-9c47-4144-8dd0-bc3061b8c555', 'volume_size': 1, 'snapshot_id': '195075dc-83f3-4d22-83c1-3593335fb540'}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:06:42 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-a219be7b-0677-44e0-a382-daa6150e3457 tempest-VolumeDependencyTests-2102328531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1c77475-294d-4ade-a214-29c1d16c7fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:06:42 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-a219be7b-0677-44e0-a382-daa6150e3457 tempest-VolumeDependencyTests-2102328531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1c77475-294d-4ade-a214-29c1d16c7fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:06:42 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-a219be7b-0677-44e0-a382-daa6150e3457 tempest-VolumeDependencyTests-2102328531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (923a8322-d4ca-4f99-aa00-3650ff9f8c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:06:42 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-a219be7b-0677-44e0-a382-daa6150e3457 tempest-VolumeDependencyTests-2102328531 None] Volume b14dc7d0-9c47-4144-8dd0-bc3061b8c555: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b14dc7d0-9c47-4144-8dd0-bc3061b8c555', 'volume_size': 1, 'snapshot_id': '195075dc-83f3-4d22-83c1-3593335fb540'} Aug 10 16:06:42 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-a219be7b-0677-44e0-a382-daa6150e3457 tempest-VolumeDependencyTests-2102328531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:06:42 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-a219be7b-0677-44e0-a382-daa6150e3457 tempest-VolumeDependencyTests-2102328531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:06:42 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-a219be7b-0677-44e0-a382-daa6150e3457 tempest-VolumeDependencyTests-2102328531 None] Acquiring lock "cinder-quobyte-195075dc-83f3-4d22-83c1-3593335fb540-b14dc7d0-9c47-4144-8dd0-bc3061b8c555" by "_create_volume_from_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:06:42 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-a219be7b-0677-44e0-a382-daa6150e3457 tempest-VolumeDependencyTests-2102328531 None] Lock "cinder-quobyte-195075dc-83f3-4d22-83c1-3593335fb540-b14dc7d0-9c47-4144-8dd0-bc3061b8c555" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:06:42 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-a219be7b-0677-44e0-a382-daa6150e3457 tempest-VolumeDependencyTests-2102328531 None] Creating volume b14dc7d0-9c47-4144-8dd0-bc3061b8c555 from snapshot 195075dc-83f3-4d22-83c1-3593335fb540 {{(pid=88641) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 10 16:06:42 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-a219be7b-0677-44e0-a382-daa6150e3457 tempest-VolumeDependencyTests-2102328531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:06:42 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-a219be7b-0677-44e0-a382-daa6150e3457 tempest-VolumeDependencyTests-2102328531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:06:42 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-a219be7b-0677-44e0-a382-daa6150e3457 tempest-VolumeDependencyTests-2102328531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:06:42 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-a219be7b-0677-44e0-a382-daa6150e3457 tempest-VolumeDependencyTests-2102328531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:06:42 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-a219be7b-0677-44e0-a382-daa6150e3457 tempest-VolumeDependencyTests-2102328531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:06:42 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-a219be7b-0677-44e0-a382-daa6150e3457 tempest-VolumeDependencyTests-2102328531 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:06:42 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-a219be7b-0677-44e0-a382-daa6150e3457 tempest-VolumeDependencyTests-2102328531 None] Acquiring lock "cinder-quobyte-b14dc7d0-9c47-4144-8dd0-bc3061b8c555" by "_copy_volume_from_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:06:42 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-a219be7b-0677-44e0-a382-daa6150e3457 tempest-VolumeDependencyTests-2102328531 None] Lock "cinder-quobyte-b14dc7d0-9c47-4144-8dd0-bc3061b8c555" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:06:42 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-a219be7b-0677-44e0-a382-daa6150e3457 tempest-VolumeDependencyTests-2102328531 None] snapshot: 195075dc-83f3-4d22-83c1-3593335fb540, volume: b14dc7d0-9c47-4144-8dd0-bc3061b8c555, {{(pid=88641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 10 16:06:43 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-a219be7b-0677-44e0-a382-daa6150e3457 tempest-VolumeDependencyTests-2102328531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:06:43 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-a219be7b-0677-44e0-a382-daa6150e3457 tempest-VolumeDependencyTests-2102328531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:06:43 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-a219be7b-0677-44e0-a382-daa6150e3457 tempest-VolumeDependencyTests-2102328531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:06:43 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-a219be7b-0677-44e0-a382-daa6150e3457 tempest-VolumeDependencyTests-2102328531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:06:43 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-a219be7b-0677-44e0-a382-daa6150e3457 tempest-VolumeDependencyTests-2102328531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:06:43 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[6983b12c-ab6e-4fba-b65b-260764de0810]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:06:43 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a219be7b-0677-44e0-a382-daa6150e3457 tempest-VolumeDependencyTests-2102328531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-41302d67-600b-4ddb-8f00-26376730d81f.195075dc-83f3-4d22-83c1-3593335fb540 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:43 devstack sudo[102857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-41302d67-600b-4ddb-8f00-26376730d81f.195075dc-83f3-4d22-83c1-3593335fb540 Aug 10 16:06:43 devstack sudo[102857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:43 devstack sudo[102857]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:43 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a219be7b-0677-44e0-a382-daa6150e3457 tempest-VolumeDependencyTests-2102328531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-41302d67-600b-4ddb-8f00-26376730d81f.195075dc-83f3-4d22-83c1-3593335fb540" returned: 0 in 0.620s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:43 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-a219be7b-0677-44e0-a382-daa6150e3457 tempest-VolumeDependencyTests-2102328531 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-41302d67-600b-4ddb-8f00-26376730d81f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 16:06:43 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bef5ec0-2a19-40a5-ae40-34a6c500f6fc]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:06:43 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a219be7b-0677-44e0-a382-daa6150e3457 tempest-VolumeDependencyTests-2102328531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-41302d67-600b-4ddb-8f00-26376730d81f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:43 devstack sudo[102884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-41302d67-600b-4ddb-8f00-26376730d81f Aug 10 16:06:43 devstack sudo[102884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:44 devstack sudo[102884]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:44 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a219be7b-0677-44e0-a382-daa6150e3457 tempest-VolumeDependencyTests-2102328531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-41302d67-600b-4ddb-8f00-26376730d81f" returned: 0 in 0.455s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:44 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-a219be7b-0677-44e0-a382-daa6150e3457 tempest-VolumeDependencyTests-2102328531 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-41302d67-600b-4ddb-8f00-26376730d81f {{(pid=88641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 10 16:06:44 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-a219be7b-0677-44e0-a382-daa6150e3457 tempest-VolumeDependencyTests-2102328531 None] Creating direct copy from snapshot {{(pid=88641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 10 16:06:44 devstack cinder-volume[88641]: DEBUG cinder.utils [None req-a219be7b-0677-44e0-a382-daa6150e3457 tempest-VolumeDependencyTests-2102328531 None] Path /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b14dc7d0-9c47-4144-8dd0-bc3061b8c555 not found in is_blk_device check {{(pid=88641) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 10 16:06:44 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a219be7b-0677-44e0-a382-daa6150e3457 tempest-VolumeDependencyTests-2102328531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-41302d67-600b-4ddb-8f00-26376730d81f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b14dc7d0-9c47-4144-8dd0-bc3061b8c555 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:44 devstack sudo[102903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-41302d67-600b-4ddb-8f00-26376730d81f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b14dc7d0-9c47-4144-8dd0-bc3061b8c555 Aug 10 16:06:44 devstack sudo[102903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:51 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-37965ab5-d6d4-4243-ade5-bce9bd587a31 tempest-VolumeQuotasAdminTestJSON-1536430118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:06:51 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-37965ab5-d6d4-4243-ade5-bce9bd587a31 tempest-VolumeQuotasAdminTestJSON-1536430118 None] Flow 'volume_create_manager' (e05659ab-79c5-4854-90fe-a472a39d7f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:06:51 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-37965ab5-d6d4-4243-ade5-bce9bd587a31 tempest-VolumeQuotasAdminTestJSON-1536430118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1da9c992-1960-40c7-a96f-d13273db9523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:06:51 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-37965ab5-d6d4-4243-ade5-bce9bd587a31 tempest-VolumeQuotasAdminTestJSON-1536430118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1da9c992-1960-40c7-a96f-d13273db9523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:06:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-566855246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6723d535-dbb7-44e5-a6d6-350d36b6f969,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d915d4f0c1bd4587b0b597b4148d9f95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:06:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:06:51Z,use_quota=True,user_id='656fc273217c4433a4ed78d3b7136230',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:06:51 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-37965ab5-d6d4-4243-ade5-bce9bd587a31 tempest-VolumeQuotasAdminTestJSON-1536430118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cce68f71-59e5-4634-99b1-172c36cbd33c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:06:51 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-37965ab5-d6d4-4243-ade5-bce9bd587a31 tempest-VolumeQuotasAdminTestJSON-1536430118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cce68f71-59e5-4634-99b1-172c36cbd33c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:06:51 devstack sudo[102903]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:51 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-37965ab5-d6d4-4243-ade5-bce9bd587a31 tempest-VolumeQuotasAdminTestJSON-1536430118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (716a5f7f-788e-4f39-9291-6c806e9dc36e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:06:51 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-37965ab5-d6d4-4243-ade5-bce9bd587a31 tempest-VolumeQuotasAdminTestJSON-1536430118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (716a5f7f-788e-4f39-9291-6c806e9dc36e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6723d535-dbb7-44e5-a6d6-350d36b6f969', 'volume_name': 'volume-6723d535-dbb7-44e5-a6d6-350d36b6f969', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:06:51 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-37965ab5-d6d4-4243-ade5-bce9bd587a31 tempest-VolumeQuotasAdminTestJSON-1536430118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e4fe84a-d2bb-4d9a-9efb-57ba394f049c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:06:51 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-37965ab5-d6d4-4243-ade5-bce9bd587a31 tempest-VolumeQuotasAdminTestJSON-1536430118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e4fe84a-d2bb-4d9a-9efb-57ba394f049c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:06:51 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-37965ab5-d6d4-4243-ade5-bce9bd587a31 tempest-VolumeQuotasAdminTestJSON-1536430118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dee5077-2fa7-47fe-b19c-b850e5369af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:06:51 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-37965ab5-d6d4-4243-ade5-bce9bd587a31 tempest-VolumeQuotasAdminTestJSON-1536430118 None] Volume 6723d535-dbb7-44e5-a6d6-350d36b6f969: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6723d535-dbb7-44e5-a6d6-350d36b6f969', 'volume_size': 1} Aug 10 16:06:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-37965ab5-d6d4-4243-ade5-bce9bd587a31 tempest-VolumeQuotasAdminTestJSON-1536430118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:06:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a219be7b-0677-44e0-a382-daa6150e3457 tempest-VolumeDependencyTests-2102328531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-41302d67-600b-4ddb-8f00-26376730d81f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b14dc7d0-9c47-4144-8dd0-bc3061b8c555" returned: 0 in 7.446s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:51 devstack cinder-volume[88641]: DEBUG cinder.image.image_utils [None req-a219be7b-0677-44e0-a382-daa6150e3457 tempest-VolumeDependencyTests-2102328531 None] Image conversion details: src /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-41302d67-600b-4ddb-8f00-26376730d81f, size 1024.00 MB, duration 7.45 sec, destination /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b14dc7d0-9c47-4144-8dd0-bc3061b8c555 {{(pid=88641) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 10 16:06:51 devstack cinder-volume[88641]: INFO cinder.image.image_utils [None req-a219be7b-0677-44e0-a382-daa6150e3457 tempest-VolumeDependencyTests-2102328531 None] Converted 1024.00 MB image at 137.52 MB/s Aug 10 16:06:51 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-a219be7b-0677-44e0-a382-daa6150e3457 tempest-VolumeDependencyTests-2102328531 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b14dc7d0-9c47-4144-8dd0-bc3061b8c555 is being set with open permissions: ugo+rw Aug 10 16:06:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a219be7b-0677-44e0-a382-daa6150e3457 tempest-VolumeDependencyTests-2102328531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b14dc7d0-9c47-4144-8dd0-bc3061b8c555 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:51 devstack sudo[102920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b14dc7d0-9c47-4144-8dd0-bc3061b8c555 Aug 10 16:06:51 devstack sudo[102920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:51 devstack sudo[102920]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a219be7b-0677-44e0-a382-daa6150e3457 tempest-VolumeDependencyTests-2102328531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b14dc7d0-9c47-4144-8dd0-bc3061b8c555" returned: 0 in 0.269s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:51 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-a219be7b-0677-44e0-a382-daa6150e3457 tempest-VolumeDependencyTests-2102328531 None] Lock "cinder-quobyte-b14dc7d0-9c47-4144-8dd0-bc3061b8c555" released by "_copy_volume_from_snapshot" :: held 8.946s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:06:51 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-a219be7b-0677-44e0-a382-daa6150e3457 tempest-VolumeDependencyTests-2102328531 None] Lock "cinder-quobyte-195075dc-83f3-4d22-83c1-3593335fb540-b14dc7d0-9c47-4144-8dd0-bc3061b8c555" released by "_create_volume_from_snapshot" :: held 9.041s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:06:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-a219be7b-0677-44e0-a382-daa6150e3457 tempest-VolumeDependencyTests-2102328531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.074s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:06:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-37965ab5-d6d4-4243-ade5-bce9bd587a31 tempest-VolumeQuotasAdminTestJSON-1536430118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.331s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:06:51 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-37965ab5-d6d4-4243-ade5-bce9bd587a31 tempest-VolumeQuotasAdminTestJSON-1536430118 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:06:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-566855246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6723d535-dbb7-44e5-a6d6-350d36b6f969,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d915d4f0c1bd4587b0b597b4148d9f95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:06:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:06:51Z,use_quota=True,user_id='656fc273217c4433a4ed78d3b7136230',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:06:51 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-37965ab5-d6d4-4243-ade5-bce9bd587a31 tempest-VolumeQuotasAdminTestJSON-1536430118 None] Creating volume 6723d535-dbb7-44e5-a6d6-350d36b6f969 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:06:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-37965ab5-d6d4-4243-ade5-bce9bd587a31 tempest-VolumeQuotasAdminTestJSON-1536430118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:06:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-37965ab5-d6d4-4243-ade5-bce9bd587a31 tempest-VolumeQuotasAdminTestJSON-1536430118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:06:51 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-37965ab5-d6d4-4243-ade5-bce9bd587a31 tempest-VolumeQuotasAdminTestJSON-1536430118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:06:51 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-37965ab5-d6d4-4243-ade5-bce9bd587a31 tempest-VolumeQuotasAdminTestJSON-1536430118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:06:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-37965ab5-d6d4-4243-ade5-bce9bd587a31 tempest-VolumeQuotasAdminTestJSON-1536430118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:06:51 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-37965ab5-d6d4-4243-ade5-bce9bd587a31 tempest-VolumeQuotasAdminTestJSON-1536430118 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:06:51 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-37965ab5-d6d4-4243-ade5-bce9bd587a31 tempest-VolumeQuotasAdminTestJSON-1536430118 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:06:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-37965ab5-d6d4-4243-ade5-bce9bd587a31 tempest-VolumeQuotasAdminTestJSON-1536430118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6723d535-dbb7-44e5-a6d6-350d36b6f969 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:52 devstack sudo[102923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6723d535-dbb7-44e5-a6d6-350d36b6f969 1073741824 Aug 10 16:06:52 devstack sudo[102923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:52 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-a219be7b-0677-44e0-a382-daa6150e3457 tempest-VolumeDependencyTests-2102328531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (923a8322-d4ca-4f99-aa00-3650ff9f8c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b14dc7d0-9c47-4144-8dd0-bc3061b8c555', 'volume_size': 1, 'snapshot_id': '195075dc-83f3-4d22-83c1-3593335fb540'}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:06:52 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-a219be7b-0677-44e0-a382-daa6150e3457 tempest-VolumeDependencyTests-2102328531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (973b0351-5817-4656-9f04-9bc66a668e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:06:52 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-a219be7b-0677-44e0-a382-daa6150e3457 tempest-VolumeDependencyTests-2102328531 None] Volume volume-b14dc7d0-9c47-4144-8dd0-bc3061b8c555 (b14dc7d0-9c47-4144-8dd0-bc3061b8c555): created successfully Aug 10 16:06:52 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-a219be7b-0677-44e0-a382-daa6150e3457 tempest-VolumeDependencyTests-2102328531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (973b0351-5817-4656-9f04-9bc66a668e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:06:52 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-a219be7b-0677-44e0-a382-daa6150e3457 tempest-VolumeDependencyTests-2102328531 None] Flow 'volume_create_manager' (975a1417-062a-4d0d-b2ef-83f6fc479ead) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:06:52 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-a219be7b-0677-44e0-a382-daa6150e3457 tempest-VolumeDependencyTests-2102328531 None] Created volume successfully. Aug 10 16:06:52 devstack sudo[102923]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-37965ab5-d6d4-4243-ade5-bce9bd587a31 tempest-VolumeQuotasAdminTestJSON-1536430118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6723d535-dbb7-44e5-a6d6-350d36b6f969 1073741824" returned: 0 in 0.515s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-37965ab5-d6d4-4243-ade5-bce9bd587a31 tempest-VolumeQuotasAdminTestJSON-1536430118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6723d535-dbb7-44e5-a6d6-350d36b6f969 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:52 devstack sudo[102930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6723d535-dbb7-44e5-a6d6-350d36b6f969 Aug 10 16:06:52 devstack sudo[102930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:52 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-6f02fe08-7596-428a-a305-1b726c2bf70e tempest-VolumeDependencyTests-2102328531 None] Acquiring lock "cinder-195075dc-83f3-4d22-83c1-3593335fb540-delete_snapshot" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:06:52 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-6f02fe08-7596-428a-a305-1b726c2bf70e tempest-VolumeDependencyTests-2102328531 None] Lock "cinder-195075dc-83f3-4d22-83c1-3593335fb540-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:06:52 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-6f02fe08-7596-428a-a305-1b726c2bf70e tempest-VolumeDependencyTests-2102328531 None] Acquiring lock "cinder-quobyte-41302d67-600b-4ddb-8f00-26376730d81f" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:06:52 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-6f02fe08-7596-428a-a305-1b726c2bf70e tempest-VolumeDependencyTests-2102328531 None] Lock "cinder-quobyte-41302d67-600b-4ddb-8f00-26376730d81f" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:06:52 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-6f02fe08-7596-428a-a305-1b726c2bf70e tempest-VolumeDependencyTests-2102328531 None] Acquiring lock "cinder-quobyte-195075dc-83f3-4d22-83c1-3593335fb540" by "_delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:06:52 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-6f02fe08-7596-428a-a305-1b726c2bf70e tempest-VolumeDependencyTests-2102328531 None] Lock "cinder-quobyte-195075dc-83f3-4d22-83c1-3593335fb540" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:06:52 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-6f02fe08-7596-428a-a305-1b726c2bf70e tempest-VolumeDependencyTests-2102328531 None] Deleting offline snapshot 195075dc-83f3-4d22-83c1-3593335fb540 of volume 41302d67-600b-4ddb-8f00-26376730d81f {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 16:06:52 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-6f02fe08-7596-428a-a305-1b726c2bf70e tempest-VolumeDependencyTests-2102328531 None] snapshot_file for this snap is: volume-41302d67-600b-4ddb-8f00-26376730d81f.195075dc-83f3-4d22-83c1-3593335fb540 {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 16:06:52 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca0e4dd-d874-45d8-9e9d-e30235ebda00]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:06:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6f02fe08-7596-428a-a305-1b726c2bf70e tempest-VolumeDependencyTests-2102328531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-41302d67-600b-4ddb-8f00-26376730d81f.195075dc-83f3-4d22-83c1-3593335fb540 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:52 devstack sudo[102930]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-37965ab5-d6d4-4243-ade5-bce9bd587a31 tempest-VolumeQuotasAdminTestJSON-1536430118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6723d535-dbb7-44e5-a6d6-350d36b6f969" returned: 0 in 0.415s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:52 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-37965ab5-d6d4-4243-ade5-bce9bd587a31 tempest-VolumeQuotasAdminTestJSON-1536430118 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:06:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-37965ab5-d6d4-4243-ade5-bce9bd587a31 tempest-VolumeQuotasAdminTestJSON-1536430118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:06:52 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-37965ab5-d6d4-4243-ade5-bce9bd587a31 tempest-VolumeQuotasAdminTestJSON-1536430118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dee5077-2fa7-47fe-b19c-b850e5369af0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6723d535-dbb7-44e5-a6d6-350d36b6f969', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:06:52 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-37965ab5-d6d4-4243-ade5-bce9bd587a31 tempest-VolumeQuotasAdminTestJSON-1536430118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea03b50d-6180-4dd4-a9c7-a324b09e1081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:06:52 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-37965ab5-d6d4-4243-ade5-bce9bd587a31 tempest-VolumeQuotasAdminTestJSON-1536430118 None] Volume volume-6723d535-dbb7-44e5-a6d6-350d36b6f969 (6723d535-dbb7-44e5-a6d6-350d36b6f969): created successfully Aug 10 16:06:52 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-37965ab5-d6d4-4243-ade5-bce9bd587a31 tempest-VolumeQuotasAdminTestJSON-1536430118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea03b50d-6180-4dd4-a9c7-a324b09e1081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:06:53 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-37965ab5-d6d4-4243-ade5-bce9bd587a31 tempest-VolumeQuotasAdminTestJSON-1536430118 None] Flow 'volume_create_manager' (e05659ab-79c5-4854-90fe-a472a39d7f01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:06:53 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-37965ab5-d6d4-4243-ade5-bce9bd587a31 tempest-VolumeQuotasAdminTestJSON-1536430118 None] Created volume successfully. Aug 10 16:06:53 devstack sudo[102934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-41302d67-600b-4ddb-8f00-26376730d81f.195075dc-83f3-4d22-83c1-3593335fb540 Aug 10 16:06:53 devstack sudo[102934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:53 devstack sudo[102934]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6f02fe08-7596-428a-a305-1b726c2bf70e tempest-VolumeDependencyTests-2102328531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-41302d67-600b-4ddb-8f00-26376730d81f.195075dc-83f3-4d22-83c1-3593335fb540" returned: 0 in 0.426s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:53 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-6f02fe08-7596-428a-a305-1b726c2bf70e tempest-VolumeDependencyTests-2102328531 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-41302d67-600b-4ddb-8f00-26376730d81f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 16:06:53 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f5109d2-df22-4a7e-9ce7-481236ce63b2]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:06:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6f02fe08-7596-428a-a305-1b726c2bf70e tempest-VolumeDependencyTests-2102328531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-41302d67-600b-4ddb-8f00-26376730d81f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:53 devstack sudo[102940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-41302d67-600b-4ddb-8f00-26376730d81f Aug 10 16:06:53 devstack sudo[102940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:53 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-03a1bbf3-61b4-4fda-ba02-1bd4c4e74f9b tempest-VolumeQuotasAdminTestJSON-1536430118 None] Acquiring lock "cinder-6723d535-dbb7-44e5-a6d6-350d36b6f969-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:06:53 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-03a1bbf3-61b4-4fda-ba02-1bd4c4e74f9b tempest-VolumeQuotasAdminTestJSON-1536430118 None] Lock "cinder-6723d535-dbb7-44e5-a6d6-350d36b6f969-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:06:53 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-03a1bbf3-61b4-4fda-ba02-1bd4c4e74f9b tempest-VolumeQuotasAdminTestJSON-1536430118 None] Acquiring lock "cinder-quobyte-6723d535-dbb7-44e5-a6d6-350d36b6f969" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:06:53 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-03a1bbf3-61b4-4fda-ba02-1bd4c4e74f9b tempest-VolumeQuotasAdminTestJSON-1536430118 None] Lock "cinder-quobyte-6723d535-dbb7-44e5-a6d6-350d36b6f969" acquired by "delete_volume" :: waited 0.021s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:06:53 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc9e62b-4316-4f2d-9c07-6a17c13f7ab2]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:06:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-03a1bbf3-61b4-4fda-ba02-1bd4c4e74f9b tempest-VolumeQuotasAdminTestJSON-1536430118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6723d535-dbb7-44e5-a6d6-350d36b6f969 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:53 devstack sudo[102942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6723d535-dbb7-44e5-a6d6-350d36b6f969 Aug 10 16:06:53 devstack sudo[102942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:54 devstack sudo[102940]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6f02fe08-7596-428a-a305-1b726c2bf70e tempest-VolumeDependencyTests-2102328531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-41302d67-600b-4ddb-8f00-26376730d81f" returned: 0 in 0.750s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6f02fe08-7596-428a-a305-1b726c2bf70e tempest-VolumeDependencyTests-2102328531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-41302d67-600b-4ddb-8f00-26376730d81f.195075dc-83f3-4d22-83c1-3593335fb540 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:54 devstack sudo[102972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-41302d67-600b-4ddb-8f00-26376730d81f.195075dc-83f3-4d22-83c1-3593335fb540 Aug 10 16:06:54 devstack sudo[102972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:54 devstack sudo[102942]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-03a1bbf3-61b4-4fda-ba02-1bd4c4e74f9b tempest-VolumeQuotasAdminTestJSON-1536430118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6723d535-dbb7-44e5-a6d6-350d36b6f969" returned: 0 in 0.473s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-03a1bbf3-61b4-4fda-ba02-1bd4c4e74f9b tempest-VolumeQuotasAdminTestJSON-1536430118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6723d535-dbb7-44e5-a6d6-350d36b6f969 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:54 devstack sudo[102986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6723d535-dbb7-44e5-a6d6-350d36b6f969 Aug 10 16:06:54 devstack sudo[102986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:54 devstack sudo[102972]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6f02fe08-7596-428a-a305-1b726c2bf70e tempest-VolumeDependencyTests-2102328531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-41302d67-600b-4ddb-8f00-26376730d81f.195075dc-83f3-4d22-83c1-3593335fb540" returned: 0 in 0.459s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6f02fe08-7596-428a-a305-1b726c2bf70e tempest-VolumeDependencyTests-2102328531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-41302d67-600b-4ddb-8f00-26376730d81f.195075dc-83f3-4d22-83c1-3593335fb540 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:54 devstack sudo[102986]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-03a1bbf3-61b4-4fda-ba02-1bd4c4e74f9b tempest-VolumeQuotasAdminTestJSON-1536430118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6723d535-dbb7-44e5-a6d6-350d36b6f969" returned: 0 in 0.329s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:54 devstack sudo[102994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-41302d67-600b-4ddb-8f00-26376730d81f.195075dc-83f3-4d22-83c1-3593335fb540 Aug 10 16:06:54 devstack sudo[102994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:54 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-03a1bbf3-61b4-4fda-ba02-1bd4c4e74f9b tempest-VolumeQuotasAdminTestJSON-1536430118 None] Lock "cinder-quobyte-6723d535-dbb7-44e5-a6d6-350d36b6f969" released by "delete_volume" :: held 0.877s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:06:54 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-03a1bbf3-61b4-4fda-ba02-1bd4c4e74f9b tempest-VolumeQuotasAdminTestJSON-1536430118 None] Created reservations ['47069817-3f59-43f8-816c-721de547eddb', '826d2728-07e8-466b-839d-f65a0f131372', 'd9dd0013-6479-4d97-ab0c-585cdbbff4cb', 'cd45169e-9659-42b9-8b0c-ced1940c25d6'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:06:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-03a1bbf3-61b4-4fda-ba02-1bd4c4e74f9b tempest-VolumeQuotasAdminTestJSON-1536430118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:06:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-03a1bbf3-61b4-4fda-ba02-1bd4c4e74f9b tempest-VolumeQuotasAdminTestJSON-1536430118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:06:54 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-03a1bbf3-61b4-4fda-ba02-1bd4c4e74f9b tempest-VolumeQuotasAdminTestJSON-1536430118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:06:54 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-03a1bbf3-61b4-4fda-ba02-1bd4c4e74f9b tempest-VolumeQuotasAdminTestJSON-1536430118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:06:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-03a1bbf3-61b4-4fda-ba02-1bd4c4e74f9b tempest-VolumeQuotasAdminTestJSON-1536430118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:06:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-03a1bbf3-61b4-4fda-ba02-1bd4c4e74f9b tempest-VolumeQuotasAdminTestJSON-1536430118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:54 devstack sudo[102996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:06:54 devstack sudo[102996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:54 devstack sudo[102994]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6f02fe08-7596-428a-a305-1b726c2bf70e tempest-VolumeDependencyTests-2102328531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-41302d67-600b-4ddb-8f00-26376730d81f.195075dc-83f3-4d22-83c1-3593335fb540" returned: 0 in 0.315s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:54 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-6f02fe08-7596-428a-a305-1b726c2bf70e tempest-VolumeDependencyTests-2102328531 None] Lock "cinder-quobyte-195075dc-83f3-4d22-83c1-3593335fb540" released by "_delete_snapshot" :: held 2.078s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:06:55 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-6f02fe08-7596-428a-a305-1b726c2bf70e tempest-VolumeDependencyTests-2102328531 None] Lock "cinder-quobyte-41302d67-600b-4ddb-8f00-26376730d81f" released by "delete_snapshot" :: held 2.128s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:06:55 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-6f02fe08-7596-428a-a305-1b726c2bf70e tempest-VolumeDependencyTests-2102328531 None] Created reservations ['2d6cbdb8-0172-429d-b8dd-958c169b99bf', 'b8856466-c0a1-4875-a61b-1616e70c54f8', 'fcef1a8b-bb48-4448-83cf-c35b187a8160', 'a7a1bfca-3abc-4f10-bc4f-6559ce32b2ef'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:06:55 devstack sudo[102996]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-03a1bbf3-61b4-4fda-ba02-1bd4c4e74f9b tempest-VolumeQuotasAdminTestJSON-1536430118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.315s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:55 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-03a1bbf3-61b4-4fda-ba02-1bd4c4e74f9b tempest-VolumeQuotasAdminTestJSON-1536430118 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:06:55 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-03a1bbf3-61b4-4fda-ba02-1bd4c4e74f9b tempest-VolumeQuotasAdminTestJSON-1536430118 None] Deleted volume successfully. Aug 10 16:06:55 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-03a1bbf3-61b4-4fda-ba02-1bd4c4e74f9b tempest-VolumeQuotasAdminTestJSON-1536430118 None] Lock "cinder-6723d535-dbb7-44e5-a6d6-350d36b6f969-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:06:55 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-6f02fe08-7596-428a-a305-1b726c2bf70e tempest-VolumeDependencyTests-2102328531 None] Delete snapshot completed successfully. Aug 10 16:06:55 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-6f02fe08-7596-428a-a305-1b726c2bf70e tempest-VolumeDependencyTests-2102328531 None] Lock "cinder-195075dc-83f3-4d22-83c1-3593335fb540-delete_snapshot" released by "delete_snapshot" :: held 2.405s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:06:55 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-021e3d6f-9eff-422b-8da0-afc8a13cd393 tempest-VolumeQuotasAdminTestJSON-1536430118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:06:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-021e3d6f-9eff-422b-8da0-afc8a13cd393 tempest-VolumeQuotasAdminTestJSON-1536430118 None] Flow 'volume_create_manager' (c8b69f21-0d5c-4339-891d-894deab03dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:06:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-021e3d6f-9eff-422b-8da0-afc8a13cd393 tempest-VolumeQuotasAdminTestJSON-1536430118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0135945b-9b97-427c-9c88-5ea9ab14353d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:06:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-021e3d6f-9eff-422b-8da0-afc8a13cd393 tempest-VolumeQuotasAdminTestJSON-1536430118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0135945b-9b97-427c-9c88-5ea9ab14353d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:06:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1093533072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79bf0b0e-f04d-4378-85f4-32d8f242cf58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d915d4f0c1bd4587b0b597b4148d9f95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:06:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:06:56Z,use_quota=True,user_id='656fc273217c4433a4ed78d3b7136230',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:06:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-021e3d6f-9eff-422b-8da0-afc8a13cd393 tempest-VolumeQuotasAdminTestJSON-1536430118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37f3a486-ed5c-4102-8f9a-caa7b5f206d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:06:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-021e3d6f-9eff-422b-8da0-afc8a13cd393 tempest-VolumeQuotasAdminTestJSON-1536430118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37f3a486-ed5c-4102-8f9a-caa7b5f206d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:06:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-021e3d6f-9eff-422b-8da0-afc8a13cd393 tempest-VolumeQuotasAdminTestJSON-1536430118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00dfd263-dd1e-4748-b800-ef2e8545684f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:06:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-021e3d6f-9eff-422b-8da0-afc8a13cd393 tempest-VolumeQuotasAdminTestJSON-1536430118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00dfd263-dd1e-4748-b800-ef2e8545684f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79bf0b0e-f04d-4378-85f4-32d8f242cf58', 'volume_name': 'volume-79bf0b0e-f04d-4378-85f4-32d8f242cf58', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:06:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-021e3d6f-9eff-422b-8da0-afc8a13cd393 tempest-VolumeQuotasAdminTestJSON-1536430118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68a67840-dc89-4a3c-a66a-9846663870be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:06:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-021e3d6f-9eff-422b-8da0-afc8a13cd393 tempest-VolumeQuotasAdminTestJSON-1536430118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68a67840-dc89-4a3c-a66a-9846663870be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:06:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-021e3d6f-9eff-422b-8da0-afc8a13cd393 tempest-VolumeQuotasAdminTestJSON-1536430118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2214c64-edd4-4616-a8cb-b85641094f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:06:55 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-021e3d6f-9eff-422b-8da0-afc8a13cd393 tempest-VolumeQuotasAdminTestJSON-1536430118 None] Volume 79bf0b0e-f04d-4378-85f4-32d8f242cf58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79bf0b0e-f04d-4378-85f4-32d8f242cf58', 'volume_size': 1} Aug 10 16:06:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-021e3d6f-9eff-422b-8da0-afc8a13cd393 tempest-VolumeQuotasAdminTestJSON-1536430118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:06:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-021e3d6f-9eff-422b-8da0-afc8a13cd393 tempest-VolumeQuotasAdminTestJSON-1536430118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:06:55 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-021e3d6f-9eff-422b-8da0-afc8a13cd393 tempest-VolumeQuotasAdminTestJSON-1536430118 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:06:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1093533072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79bf0b0e-f04d-4378-85f4-32d8f242cf58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d915d4f0c1bd4587b0b597b4148d9f95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:06:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:06:56Z,use_quota=True,user_id='656fc273217c4433a4ed78d3b7136230',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:06:55 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-021e3d6f-9eff-422b-8da0-afc8a13cd393 tempest-VolumeQuotasAdminTestJSON-1536430118 None] Creating volume 79bf0b0e-f04d-4378-85f4-32d8f242cf58 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:06:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-021e3d6f-9eff-422b-8da0-afc8a13cd393 tempest-VolumeQuotasAdminTestJSON-1536430118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:06:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-021e3d6f-9eff-422b-8da0-afc8a13cd393 tempest-VolumeQuotasAdminTestJSON-1536430118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:06:55 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-021e3d6f-9eff-422b-8da0-afc8a13cd393 tempest-VolumeQuotasAdminTestJSON-1536430118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:06:55 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-021e3d6f-9eff-422b-8da0-afc8a13cd393 tempest-VolumeQuotasAdminTestJSON-1536430118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:06:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-021e3d6f-9eff-422b-8da0-afc8a13cd393 tempest-VolumeQuotasAdminTestJSON-1536430118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:06:55 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-021e3d6f-9eff-422b-8da0-afc8a13cd393 tempest-VolumeQuotasAdminTestJSON-1536430118 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:06:55 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-021e3d6f-9eff-422b-8da0-afc8a13cd393 tempest-VolumeQuotasAdminTestJSON-1536430118 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:06:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-021e3d6f-9eff-422b-8da0-afc8a13cd393 tempest-VolumeQuotasAdminTestJSON-1536430118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-79bf0b0e-f04d-4378-85f4-32d8f242cf58 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:55 devstack sudo[103000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-79bf0b0e-f04d-4378-85f4-32d8f242cf58 1073741824 Aug 10 16:06:55 devstack sudo[103000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:56 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-86407988-4e03-4fe7-af2d-18d59614f9ff tempest-VolumeDependencyTests-2102328531 None] Acquiring lock "cinder-41302d67-600b-4ddb-8f00-26376730d81f-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:06:56 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-86407988-4e03-4fe7-af2d-18d59614f9ff tempest-VolumeDependencyTests-2102328531 None] Lock "cinder-41302d67-600b-4ddb-8f00-26376730d81f-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:06:56 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-86407988-4e03-4fe7-af2d-18d59614f9ff tempest-VolumeDependencyTests-2102328531 None] Acquiring lock "cinder-quobyte-41302d67-600b-4ddb-8f00-26376730d81f" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:06:56 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-86407988-4e03-4fe7-af2d-18d59614f9ff tempest-VolumeDependencyTests-2102328531 None] Lock "cinder-quobyte-41302d67-600b-4ddb-8f00-26376730d81f" acquired by "delete_volume" :: waited 0.016s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:06:56 devstack sudo[103000]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-021e3d6f-9eff-422b-8da0-afc8a13cd393 tempest-VolumeQuotasAdminTestJSON-1536430118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-79bf0b0e-f04d-4378-85f4-32d8f242cf58 1073741824" returned: 0 in 0.532s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:56 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[310af5a7-0d31-4dc2-b372-316c7a27a69a]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:06:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-86407988-4e03-4fe7-af2d-18d59614f9ff tempest-VolumeDependencyTests-2102328531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-41302d67-600b-4ddb-8f00-26376730d81f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-021e3d6f-9eff-422b-8da0-afc8a13cd393 tempest-VolumeQuotasAdminTestJSON-1536430118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-79bf0b0e-f04d-4378-85f4-32d8f242cf58 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:56 devstack sudo[103007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-79bf0b0e-f04d-4378-85f4-32d8f242cf58 Aug 10 16:06:56 devstack sudo[103007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:56 devstack sudo[103006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-41302d67-600b-4ddb-8f00-26376730d81f Aug 10 16:06:56 devstack sudo[103006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:56 devstack sudo[103007]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-021e3d6f-9eff-422b-8da0-afc8a13cd393 tempest-VolumeQuotasAdminTestJSON-1536430118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-79bf0b0e-f04d-4378-85f4-32d8f242cf58" returned: 0 in 0.362s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:56 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-021e3d6f-9eff-422b-8da0-afc8a13cd393 tempest-VolumeQuotasAdminTestJSON-1536430118 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:06:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-021e3d6f-9eff-422b-8da0-afc8a13cd393 tempest-VolumeQuotasAdminTestJSON-1536430118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:06:56 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-021e3d6f-9eff-422b-8da0-afc8a13cd393 tempest-VolumeQuotasAdminTestJSON-1536430118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2214c64-edd4-4616-a8cb-b85641094f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79bf0b0e-f04d-4378-85f4-32d8f242cf58', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:06:56 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-021e3d6f-9eff-422b-8da0-afc8a13cd393 tempest-VolumeQuotasAdminTestJSON-1536430118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c00c4f8-fc91-4e47-ab1a-314cc2e02959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:06:56 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-021e3d6f-9eff-422b-8da0-afc8a13cd393 tempest-VolumeQuotasAdminTestJSON-1536430118 None] Volume volume-79bf0b0e-f04d-4378-85f4-32d8f242cf58 (79bf0b0e-f04d-4378-85f4-32d8f242cf58): created successfully Aug 10 16:06:56 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-021e3d6f-9eff-422b-8da0-afc8a13cd393 tempest-VolumeQuotasAdminTestJSON-1536430118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c00c4f8-fc91-4e47-ab1a-314cc2e02959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:06:56 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-021e3d6f-9eff-422b-8da0-afc8a13cd393 tempest-VolumeQuotasAdminTestJSON-1536430118 None] Flow 'volume_create_manager' (c8b69f21-0d5c-4339-891d-894deab03dc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:06:56 devstack sudo[103006]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-86407988-4e03-4fe7-af2d-18d59614f9ff tempest-VolumeDependencyTests-2102328531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-41302d67-600b-4ddb-8f00-26376730d81f" returned: 0 in 0.491s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-86407988-4e03-4fe7-af2d-18d59614f9ff tempest-VolumeDependencyTests-2102328531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-41302d67-600b-4ddb-8f00-26376730d81f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:56 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-021e3d6f-9eff-422b-8da0-afc8a13cd393 tempest-VolumeQuotasAdminTestJSON-1536430118 None] Created volume successfully. Aug 10 16:06:56 devstack sudo[103014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-41302d67-600b-4ddb-8f00-26376730d81f Aug 10 16:06:56 devstack sudo[103014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:56 devstack sudo[103014]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-86407988-4e03-4fe7-af2d-18d59614f9ff tempest-VolumeDependencyTests-2102328531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-41302d67-600b-4ddb-8f00-26376730d81f" returned: 0 in 0.268s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:57 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-86407988-4e03-4fe7-af2d-18d59614f9ff tempest-VolumeDependencyTests-2102328531 None] Lock "cinder-quobyte-41302d67-600b-4ddb-8f00-26376730d81f" released by "delete_volume" :: held 0.828s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:06:57 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-86407988-4e03-4fe7-af2d-18d59614f9ff tempest-VolumeDependencyTests-2102328531 None] Created reservations ['9b746112-bcc6-4515-913c-48276bd0f580', '89650204-9fe4-4029-ac71-2d74765c9198', '91b92415-e170-4874-91cd-4277cd8b0b47', '16e1504b-0837-4ff2-b330-b7496c2a59ea'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:06:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-86407988-4e03-4fe7-af2d-18d59614f9ff tempest-VolumeDependencyTests-2102328531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:06:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-86407988-4e03-4fe7-af2d-18d59614f9ff tempest-VolumeDependencyTests-2102328531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:06:57 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-86407988-4e03-4fe7-af2d-18d59614f9ff tempest-VolumeDependencyTests-2102328531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:06:57 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-86407988-4e03-4fe7-af2d-18d59614f9ff tempest-VolumeDependencyTests-2102328531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:06:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-86407988-4e03-4fe7-af2d-18d59614f9ff tempest-VolumeDependencyTests-2102328531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:06:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-86407988-4e03-4fe7-af2d-18d59614f9ff tempest-VolumeDependencyTests-2102328531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:57 devstack sudo[103032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:06:57 devstack sudo[103032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:57 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-58d5b04d-6d05-4803-b04b-ad9b7a349647 tempest-VolumeDependencyTests-2102328531 None] Acquiring lock "cinder-b14dc7d0-9c47-4144-8dd0-bc3061b8c555-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:06:57 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-58d5b04d-6d05-4803-b04b-ad9b7a349647 tempest-VolumeDependencyTests-2102328531 None] Lock "cinder-b14dc7d0-9c47-4144-8dd0-bc3061b8c555-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:06:57 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-58d5b04d-6d05-4803-b04b-ad9b7a349647 tempest-VolumeDependencyTests-2102328531 None] Acquiring lock "cinder-quobyte-b14dc7d0-9c47-4144-8dd0-bc3061b8c555" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:06:57 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-58d5b04d-6d05-4803-b04b-ad9b7a349647 tempest-VolumeDependencyTests-2102328531 None] Lock "cinder-quobyte-b14dc7d0-9c47-4144-8dd0-bc3061b8c555" acquired by "delete_volume" :: waited 0.021s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:06:57 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cd38d45-d1ee-4782-be30-1918974447f7]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:06:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-58d5b04d-6d05-4803-b04b-ad9b7a349647 tempest-VolumeDependencyTests-2102328531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b14dc7d0-9c47-4144-8dd0-bc3061b8c555 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:57 devstack sudo[103032]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-86407988-4e03-4fe7-af2d-18d59614f9ff tempest-VolumeDependencyTests-2102328531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.318s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:57 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-86407988-4e03-4fe7-af2d-18d59614f9ff tempest-VolumeDependencyTests-2102328531 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:06:57 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-86407988-4e03-4fe7-af2d-18d59614f9ff tempest-VolumeDependencyTests-2102328531 None] Deleted volume successfully. Aug 10 16:06:57 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-86407988-4e03-4fe7-af2d-18d59614f9ff tempest-VolumeDependencyTests-2102328531 None] Lock "cinder-41302d67-600b-4ddb-8f00-26376730d81f-delete_volume" released by "delete_volume" :: held 1.427s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:06:57 devstack sudo[103034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b14dc7d0-9c47-4144-8dd0-bc3061b8c555 Aug 10 16:06:57 devstack sudo[103034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:57 devstack sudo[103034]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-58d5b04d-6d05-4803-b04b-ad9b7a349647 tempest-VolumeDependencyTests-2102328531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b14dc7d0-9c47-4144-8dd0-bc3061b8c555" returned: 0 in 0.392s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-58d5b04d-6d05-4803-b04b-ad9b7a349647 tempest-VolumeDependencyTests-2102328531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b14dc7d0-9c47-4144-8dd0-bc3061b8c555 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:57 devstack sudo[103040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b14dc7d0-9c47-4144-8dd0-bc3061b8c555 Aug 10 16:06:57 devstack sudo[103040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:58 devstack sudo[103040]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-58d5b04d-6d05-4803-b04b-ad9b7a349647 tempest-VolumeDependencyTests-2102328531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b14dc7d0-9c47-4144-8dd0-bc3061b8c555" returned: 0 in 0.275s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:58 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-58d5b04d-6d05-4803-b04b-ad9b7a349647 tempest-VolumeDependencyTests-2102328531 None] Lock "cinder-quobyte-b14dc7d0-9c47-4144-8dd0-bc3061b8c555" released by "delete_volume" :: held 0.719s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:06:58 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-58d5b04d-6d05-4803-b04b-ad9b7a349647 tempest-VolumeDependencyTests-2102328531 None] Created reservations ['0ff2224a-0794-4138-bda7-c7a8dd62faac', '78ecd676-3a2a-4ba8-90f8-0a0999f54941', 'd41367a9-0d3d-414e-b0ac-6bb86ed35800', '5bf8f61a-5cf5-4b2c-a401-f55b61f2fc87'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:06:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-58d5b04d-6d05-4803-b04b-ad9b7a349647 tempest-VolumeDependencyTests-2102328531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:06:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-58d5b04d-6d05-4803-b04b-ad9b7a349647 tempest-VolumeDependencyTests-2102328531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:06:58 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-58d5b04d-6d05-4803-b04b-ad9b7a349647 tempest-VolumeDependencyTests-2102328531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:06:58 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-58d5b04d-6d05-4803-b04b-ad9b7a349647 tempest-VolumeDependencyTests-2102328531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:06:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-58d5b04d-6d05-4803-b04b-ad9b7a349647 tempest-VolumeDependencyTests-2102328531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:06:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-58d5b04d-6d05-4803-b04b-ad9b7a349647 tempest-VolumeDependencyTests-2102328531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:58 devstack sudo[103043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:06:58 devstack sudo[103043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:58 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-5128667e-7490-444b-9796-261eb146b809 tempest-VolumeQuotasAdminTestJSON-1691873825 None] Transfer volume completed successfully. Aug 10 16:06:58 devstack sudo[103043]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-58d5b04d-6d05-4803-b04b-ad9b7a349647 tempest-VolumeDependencyTests-2102328531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.278s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:58 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-58d5b04d-6d05-4803-b04b-ad9b7a349647 tempest-VolumeDependencyTests-2102328531 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:06:58 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-58d5b04d-6d05-4803-b04b-ad9b7a349647 tempest-VolumeDependencyTests-2102328531 None] Deleted volume successfully. Aug 10 16:06:58 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-58d5b04d-6d05-4803-b04b-ad9b7a349647 tempest-VolumeDependencyTests-2102328531 None] Lock "cinder-b14dc7d0-9c47-4144-8dd0-bc3061b8c555-delete_volume" released by "delete_volume" :: held 1.238s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:06:58 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-9bed2e8c-090b-484f-a2c5-b0e6e3252a20 tempest-VolumeQuotasAdminTestJSON-885700014 None] Acquiring lock "cinder-79bf0b0e-f04d-4378-85f4-32d8f242cf58-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:06:58 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-9bed2e8c-090b-484f-a2c5-b0e6e3252a20 tempest-VolumeQuotasAdminTestJSON-885700014 None] Lock "cinder-79bf0b0e-f04d-4378-85f4-32d8f242cf58-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:06:58 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-9bed2e8c-090b-484f-a2c5-b0e6e3252a20 tempest-VolumeQuotasAdminTestJSON-885700014 None] Acquiring lock "cinder-quobyte-79bf0b0e-f04d-4378-85f4-32d8f242cf58" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:06:58 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-9bed2e8c-090b-484f-a2c5-b0e6e3252a20 tempest-VolumeQuotasAdminTestJSON-885700014 None] Lock "cinder-quobyte-79bf0b0e-f04d-4378-85f4-32d8f242cf58" acquired by "delete_volume" :: waited 0.017s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:06:58 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac0b194-681d-491e-8312-85160012a007]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:06:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9bed2e8c-090b-484f-a2c5-b0e6e3252a20 tempest-VolumeQuotasAdminTestJSON-885700014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-79bf0b0e-f04d-4378-85f4-32d8f242cf58 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:59 devstack sudo[103046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-79bf0b0e-f04d-4378-85f4-32d8f242cf58 Aug 10 16:06:59 devstack sudo[103046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:59 devstack sudo[103046]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:59 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9bed2e8c-090b-484f-a2c5-b0e6e3252a20 tempest-VolumeQuotasAdminTestJSON-885700014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-79bf0b0e-f04d-4378-85f4-32d8f242cf58" returned: 0 in 0.374s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:59 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9bed2e8c-090b-484f-a2c5-b0e6e3252a20 tempest-VolumeQuotasAdminTestJSON-885700014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-79bf0b0e-f04d-4378-85f4-32d8f242cf58 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:59 devstack sudo[103051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-79bf0b0e-f04d-4378-85f4-32d8f242cf58 Aug 10 16:06:59 devstack sudo[103051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:59 devstack sudo[103051]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:59 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9bed2e8c-090b-484f-a2c5-b0e6e3252a20 tempest-VolumeQuotasAdminTestJSON-885700014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-79bf0b0e-f04d-4378-85f4-32d8f242cf58" returned: 0 in 0.271s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:59 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-9bed2e8c-090b-484f-a2c5-b0e6e3252a20 tempest-VolumeQuotasAdminTestJSON-885700014 None] Lock "cinder-quobyte-79bf0b0e-f04d-4378-85f4-32d8f242cf58" released by "delete_volume" :: held 0.694s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:06:59 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-9bed2e8c-090b-484f-a2c5-b0e6e3252a20 tempest-VolumeQuotasAdminTestJSON-885700014 None] Created reservations ['a504f75b-a9e8-41f1-886d-44eb8b5be9c4', '647a9c19-42ff-4d72-b7d3-e02aa10c3e87', 'ce9bd5ac-b73a-4931-8784-337a71dd88d9', 'c7766d7d-48ef-4ca4-84c6-9e4420e83908'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:06:59 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-9bed2e8c-090b-484f-a2c5-b0e6e3252a20 tempest-VolumeQuotasAdminTestJSON-885700014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:06:59 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-9bed2e8c-090b-484f-a2c5-b0e6e3252a20 tempest-VolumeQuotasAdminTestJSON-885700014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:06:59 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-9bed2e8c-090b-484f-a2c5-b0e6e3252a20 tempest-VolumeQuotasAdminTestJSON-885700014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:06:59 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-9bed2e8c-090b-484f-a2c5-b0e6e3252a20 tempest-VolumeQuotasAdminTestJSON-885700014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:06:59 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-9bed2e8c-090b-484f-a2c5-b0e6e3252a20 tempest-VolumeQuotasAdminTestJSON-885700014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:06:59 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9bed2e8c-090b-484f-a2c5-b0e6e3252a20 tempest-VolumeQuotasAdminTestJSON-885700014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:06:59 devstack sudo[103054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:06:59 devstack sudo[103054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:06:59 devstack sudo[103054]: pam_unix(sudo:session): session closed for user root Aug 10 16:06:59 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9bed2e8c-090b-484f-a2c5-b0e6e3252a20 tempest-VolumeQuotasAdminTestJSON-885700014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.271s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:06:59 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-9bed2e8c-090b-484f-a2c5-b0e6e3252a20 tempest-VolumeQuotasAdminTestJSON-885700014 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:07:00 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-9bed2e8c-090b-484f-a2c5-b0e6e3252a20 tempest-VolumeQuotasAdminTestJSON-885700014 None] Deleted volume successfully. Aug 10 16:07:00 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-9bed2e8c-090b-484f-a2c5-b0e6e3252a20 tempest-VolumeQuotasAdminTestJSON-885700014 None] Lock "cinder-79bf0b0e-f04d-4378-85f4-32d8f242cf58-delete_volume" released by "delete_volume" :: held 1.208s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:07:04 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb40a154-3f94-4c77-950d-d91f29c4166f tempest-VolumeImageDependencyTests-892319928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:07:04 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bb40a154-3f94-4c77-950d-d91f29c4166f tempest-VolumeImageDependencyTests-892319928 None] Flow 'volume_create_manager' (33db868e-9169-4f12-9a1e-7e72f7606cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:07:04 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bb40a154-3f94-4c77-950d-d91f29c4166f tempest-VolumeImageDependencyTests-892319928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8c504d5-91c7-40e4-ac00-6e03a9805c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:07:04 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bb40a154-3f94-4c77-950d-d91f29c4166f tempest-VolumeImageDependencyTests-892319928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8c504d5-91c7-40e4-ac00-6e03a9805c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:07:04Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58b3583f-9517-458c-b9f2-5a7afe843842,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4f7c2c3cb3b4e9c8c6d43cf87985c01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:07:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:07:04Z,use_quota=True,user_id='d32a5afbf24340298606d054b0612b4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:07:04 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bb40a154-3f94-4c77-950d-d91f29c4166f tempest-VolumeImageDependencyTests-892319928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0c148b1-69c1-4f2e-a7db-527dd8ecce45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:07:04 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bb40a154-3f94-4c77-950d-d91f29c4166f tempest-VolumeImageDependencyTests-892319928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0c148b1-69c1-4f2e-a7db-527dd8ecce45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:07:04 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bb40a154-3f94-4c77-950d-d91f29c4166f tempest-VolumeImageDependencyTests-892319928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f768fa9-8adc-4cb1-87c0-f7ed18527c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:07:04 devstack cinder-volume[88641]: DEBUG cinder.image.glance [None req-bb40a154-3f94-4c77-950d-d91f29c4166f tempest-VolumeImageDependencyTests-892319928 None] Creating Keystone auth plugin from conf {{(pid=88641) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 10 16:07:04 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bb40a154-3f94-4c77-950d-d91f29c4166f tempest-VolumeImageDependencyTests-892319928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f768fa9-8adc-4cb1-87c0-f7ed18527c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '58b3583f-9517-458c-b9f2-5a7afe843842', 'volume_name': 'volume-58b3583f-9517-458c-b9f2-5a7afe843842', 'volume_size': 1, 'image_id': '906eda4e-0334-4920-bf6c-52d8fac45476', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/906eda4e-0334-4920-bf6c-52d8fac45476', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0f4536c57ddd0442c160d1fc56ab1721', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a4f7c2c3cb3b4e9c8c6d43cf87985c01', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e31f4d59293ed672462f8dcb2ea28e5416d8738a3357d9387c4e31c8598ff90963ce26053ac29fb9d2115d20da497345d7c9144db09796ba2b5291b05ab0c10a', 'id': '906eda4e-0334-4920-bf6c-52d8fac45476', 'created_at': datetime.datetime(2026, 8, 10, 14, 7, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 10, 14, 7, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/906eda4e-0334-4920-bf6c-52d8fac45476/file', 'properties': {}}, 'image_service': }' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:07:04 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bb40a154-3f94-4c77-950d-d91f29c4166f tempest-VolumeImageDependencyTests-892319928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da1e224d-c827-4598-90c8-57df780b21d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:07:04 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bb40a154-3f94-4c77-950d-d91f29c4166f tempest-VolumeImageDependencyTests-892319928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da1e224d-c827-4598-90c8-57df780b21d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:07:04 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bb40a154-3f94-4c77-950d-d91f29c4166f tempest-VolumeImageDependencyTests-892319928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6f6e07a-b5cb-4362-8d4b-edcc76f9ec80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:07:04 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-bb40a154-3f94-4c77-950d-d91f29c4166f tempest-VolumeImageDependencyTests-892319928 None] Volume 58b3583f-9517-458c-b9f2-5a7afe843842: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-58b3583f-9517-458c-b9f2-5a7afe843842', 'volume_size': 1, 'image_id': '906eda4e-0334-4920-bf6c-52d8fac45476', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/906eda4e-0334-4920-bf6c-52d8fac45476', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0f4536c57ddd0442c160d1fc56ab1721', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a4f7c2c3cb3b4e9c8c6d43cf87985c01', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e31f4d59293ed672462f8dcb2ea28e5416d8738a3357d9387c4e31c8598ff90963ce26053ac29fb9d2115d20da497345d7c9144db09796ba2b5291b05ab0c10a', 'id': '906eda4e-0334-4920-bf6c-52d8fac45476', 'created_at': datetime.datetime(2026, 8, 10, 14, 7, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 10, 14, 7, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/906eda4e-0334-4920-bf6c-52d8fac45476/file', 'properties': {}}, 'image_service': } Aug 10 16:07:04 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb40a154-3f94-4c77-950d-d91f29c4166f tempest-VolumeImageDependencyTests-892319928 None] Trying to clone 58b3583f-9517-458c-b9f2-5a7afe843842 from image 906eda4e-0334-4920-bf6c-52d8fac45476 at location (None, [{'url': 'file:///opt/stack/data/glance/images/906eda4e-0334-4920-bf6c-52d8fac45476', 'metadata': {}}]). {{(pid=88641) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 10 16:07:04 devstack cinder-volume[88641]: DEBUG cinder.image.image_utils [None req-bb40a154-3f94-4c77-950d-d91f29c4166f tempest-VolumeImageDependencyTests-892319928 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_906eda4e-0334-4920-bf6c-52d8fac45476_tm2v5wdhdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88641) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 10 16:07:04 devstack cinder-volume[88641]: INFO cinder.image.image_utils [None req-bb40a154-3f94-4c77-950d-d91f29c4166f tempest-VolumeImageDependencyTests-892319928 None] Image download 0.00 MB at 0.00 MB/s Aug 10 16:07:04 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[63893573-d988-4843-87ee-00f113df1053]: (4, 'raw') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:07:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bb40a154-3f94-4c77-950d-d91f29c4166f tempest-VolumeImageDependencyTests-892319928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_906eda4e-0334-4920-bf6c-52d8fac45476_tm2v5wdhdevstack@QuobyteHD {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:07:05 devstack sudo[103060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_906eda4e-0334-4920-bf6c-52d8fac45476_tm2v5wdhdevstack@QuobyteHD Aug 10 16:07:05 devstack sudo[103060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:07:05 devstack sudo[103060]: pam_unix(sudo:session): session closed for user root Aug 10 16:07:05 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bb40a154-3f94-4c77-950d-d91f29c4166f tempest-VolumeImageDependencyTests-892319928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_906eda4e-0334-4920-bf6c-52d8fac45476_tm2v5wdhdevstack@QuobyteHD" returned: 0 in 0.361s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:07:05 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bb40a154-3f94-4c77-950d-d91f29c4166f tempest-VolumeImageDependencyTests-892319928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_906eda4e-0334-4920-bf6c-52d8fac45476_tm2v5wdhdevstack@QuobyteHD {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:07:05 devstack sudo[103064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_906eda4e-0334-4920-bf6c-52d8fac45476_tm2v5wdhdevstack@QuobyteHD Aug 10 16:07:05 devstack sudo[103064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:07:05 devstack sudo[103064]: pam_unix(sudo:session): session closed for user root Aug 10 16:07:05 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bb40a154-3f94-4c77-950d-d91f29c4166f tempest-VolumeImageDependencyTests-892319928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_906eda4e-0334-4920-bf6c-52d8fac45476_tm2v5wdhdevstack@QuobyteHD" returned: 1 in 0.376s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:07:05 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bb40a154-3f94-4c77-950d-d91f29c4166f tempest-VolumeImageDependencyTests-892319928 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_906eda4e-0334-4920-bf6c-52d8fac45476_tm2v5wdhdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 10 16:07:05 devstack cinder-volume[88641]: DEBUG cinder.image.image_utils [None req-bb40a154-3f94-4c77-950d-d91f29c4166f tempest-VolumeImageDependencyTests-892319928 None] Temporary image 906eda4e-0334-4920-bf6c-52d8fac45476 is fetched for user d32a5afbf24340298606d054b0612b4a. {{(pid=88641) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 10 16:07:05 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e1a165-d14c-4a83-97af-24dd5467f714]: (4, 'raw') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:07:05 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bb40a154-3f94-4c77-950d-d91f29c4166f tempest-VolumeImageDependencyTests-892319928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_906eda4e-0334-4920-bf6c-52d8fac45476_tm2v5wdhdevstack@QuobyteHD {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:07:05 devstack sudo[103075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_906eda4e-0334-4920-bf6c-52d8fac45476_tm2v5wdhdevstack@QuobyteHD Aug 10 16:07:05 devstack sudo[103075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:07:06 devstack sudo[103075]: pam_unix(sudo:session): session closed for user root Aug 10 16:07:06 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bb40a154-3f94-4c77-950d-d91f29c4166f tempest-VolumeImageDependencyTests-892319928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_906eda4e-0334-4920-bf6c-52d8fac45476_tm2v5wdhdevstack@QuobyteHD" returned: 0 in 0.347s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:07:06 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bb40a154-3f94-4c77-950d-d91f29c4166f tempest-VolumeImageDependencyTests-892319928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_906eda4e-0334-4920-bf6c-52d8fac45476_tm2v5wdhdevstack@QuobyteHD {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:07:06 devstack sudo[103079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_906eda4e-0334-4920-bf6c-52d8fac45476_tm2v5wdhdevstack@QuobyteHD Aug 10 16:07:06 devstack sudo[103079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:07:06 devstack sudo[103079]: pam_unix(sudo:session): session closed for user root Aug 10 16:07:06 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bb40a154-3f94-4c77-950d-d91f29c4166f tempest-VolumeImageDependencyTests-892319928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_906eda4e-0334-4920-bf6c-52d8fac45476_tm2v5wdhdevstack@QuobyteHD" returned: 1 in 0.349s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:07:06 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bb40a154-3f94-4c77-950d-d91f29c4166f tempest-VolumeImageDependencyTests-892319928 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_906eda4e-0334-4920-bf6c-52d8fac45476_tm2v5wdhdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 10 16:07:06 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bb40a154-3f94-4c77-950d-d91f29c4166f tempest-VolumeImageDependencyTests-892319928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:07:06 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bb40a154-3f94-4c77-950d-d91f29c4166f tempest-VolumeImageDependencyTests-892319928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:07:06 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-bb40a154-3f94-4c77-950d-d91f29c4166f tempest-VolumeImageDependencyTests-892319928 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:07:04Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58b3583f-9517-458c-b9f2-5a7afe843842,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4f7c2c3cb3b4e9c8c6d43cf87985c01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:07:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:07:04Z,use_quota=True,user_id='d32a5afbf24340298606d054b0612b4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:07:06 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-bb40a154-3f94-4c77-950d-d91f29c4166f tempest-VolumeImageDependencyTests-892319928 None] Creating volume 58b3583f-9517-458c-b9f2-5a7afe843842 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:07:06 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bb40a154-3f94-4c77-950d-d91f29c4166f tempest-VolumeImageDependencyTests-892319928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:07:06 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bb40a154-3f94-4c77-950d-d91f29c4166f tempest-VolumeImageDependencyTests-892319928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:07:06 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-bb40a154-3f94-4c77-950d-d91f29c4166f tempest-VolumeImageDependencyTests-892319928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:07:06 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-bb40a154-3f94-4c77-950d-d91f29c4166f tempest-VolumeImageDependencyTests-892319928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:07:06 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bb40a154-3f94-4c77-950d-d91f29c4166f tempest-VolumeImageDependencyTests-892319928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:07:06 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-bb40a154-3f94-4c77-950d-d91f29c4166f tempest-VolumeImageDependencyTests-892319928 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:07:06 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-bb40a154-3f94-4c77-950d-d91f29c4166f tempest-VolumeImageDependencyTests-892319928 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:07:06 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bb40a154-3f94-4c77-950d-d91f29c4166f tempest-VolumeImageDependencyTests-892319928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-58b3583f-9517-458c-b9f2-5a7afe843842 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:07:06 devstack sudo[103084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-58b3583f-9517-458c-b9f2-5a7afe843842 1073741824 Aug 10 16:07:06 devstack sudo[103084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:07:06 devstack sudo[103084]: pam_unix(sudo:session): session closed for user root Aug 10 16:07:06 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bb40a154-3f94-4c77-950d-d91f29c4166f tempest-VolumeImageDependencyTests-892319928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-58b3583f-9517-458c-b9f2-5a7afe843842 1073741824" returned: 0 in 0.508s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:07:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bb40a154-3f94-4c77-950d-d91f29c4166f tempest-VolumeImageDependencyTests-892319928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-58b3583f-9517-458c-b9f2-5a7afe843842 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:07:07 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5c348d2-7019-4611-a8d1-b18a1fefcc13 tempest-VolumeQuotasNegativeTestJSON-1384058415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:07:07 devstack sudo[103090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-58b3583f-9517-458c-b9f2-5a7afe843842 Aug 10 16:07:07 devstack sudo[103090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:07:07 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d5c348d2-7019-4611-a8d1-b18a1fefcc13 tempest-VolumeQuotasNegativeTestJSON-1384058415 None] Flow 'volume_create_manager' (c5fc7082-9e6f-4888-b2b3-8f539dcb51bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:07:07 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d5c348d2-7019-4611-a8d1-b18a1fefcc13 tempest-VolumeQuotasNegativeTestJSON-1384058415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a51479f-d259-42ae-bcca-28d5c692bd45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:07:07 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d5c348d2-7019-4611-a8d1-b18a1fefcc13 tempest-VolumeQuotasNegativeTestJSON-1384058415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a51479f-d259-42ae-bcca-28d5c692bd45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:07:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-435117142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0c731ce-99d5-4161-b600-8481c7df2abb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bf7bc64563c498b8ce58b939e02536a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:07:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:07:07Z,use_quota=True,user_id='62f2955e0c3047259e509b2373f140da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:07:07 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d5c348d2-7019-4611-a8d1-b18a1fefcc13 tempest-VolumeQuotasNegativeTestJSON-1384058415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f91e4a8-e98e-4fda-924f-fe2da28814ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:07:07 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d5c348d2-7019-4611-a8d1-b18a1fefcc13 tempest-VolumeQuotasNegativeTestJSON-1384058415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f91e4a8-e98e-4fda-924f-fe2da28814ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:07:07 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d5c348d2-7019-4611-a8d1-b18a1fefcc13 tempest-VolumeQuotasNegativeTestJSON-1384058415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c02cdc2e-032b-4656-a583-f1304db47945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:07:07 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d5c348d2-7019-4611-a8d1-b18a1fefcc13 tempest-VolumeQuotasNegativeTestJSON-1384058415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c02cdc2e-032b-4656-a583-f1304db47945) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0c731ce-99d5-4161-b600-8481c7df2abb', 'volume_name': 'volume-d0c731ce-99d5-4161-b600-8481c7df2abb', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:07:07 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d5c348d2-7019-4611-a8d1-b18a1fefcc13 tempest-VolumeQuotasNegativeTestJSON-1384058415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b1408a2-8623-4811-86ab-200571b55b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:07:07 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d5c348d2-7019-4611-a8d1-b18a1fefcc13 tempest-VolumeQuotasNegativeTestJSON-1384058415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b1408a2-8623-4811-86ab-200571b55b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:07:07 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d5c348d2-7019-4611-a8d1-b18a1fefcc13 tempest-VolumeQuotasNegativeTestJSON-1384058415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (361e848c-9864-4f3d-9623-4caff494f4a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:07:07 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-d5c348d2-7019-4611-a8d1-b18a1fefcc13 tempest-VolumeQuotasNegativeTestJSON-1384058415 None] Volume d0c731ce-99d5-4161-b600-8481c7df2abb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0c731ce-99d5-4161-b600-8481c7df2abb', 'volume_size': 1} Aug 10 16:07:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-d5c348d2-7019-4611-a8d1-b18a1fefcc13 tempest-VolumeQuotasNegativeTestJSON-1384058415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:07:07 devstack sudo[103090]: pam_unix(sudo:session): session closed for user root Aug 10 16:07:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bb40a154-3f94-4c77-950d-d91f29c4166f tempest-VolumeImageDependencyTests-892319928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-58b3583f-9517-458c-b9f2-5a7afe843842" returned: 0 in 0.248s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:07:07 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-bb40a154-3f94-4c77-950d-d91f29c4166f tempest-VolumeImageDependencyTests-892319928 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:07:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bb40a154-3f94-4c77-950d-d91f29c4166f tempest-VolumeImageDependencyTests-892319928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:07:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-d5c348d2-7019-4611-a8d1-b18a1fefcc13 tempest-VolumeQuotasNegativeTestJSON-1384058415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.145s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:07:07 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-d5c348d2-7019-4611-a8d1-b18a1fefcc13 tempest-VolumeQuotasNegativeTestJSON-1384058415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:07:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-435117142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0c731ce-99d5-4161-b600-8481c7df2abb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bf7bc64563c498b8ce58b939e02536a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:07:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:07:07Z,use_quota=True,user_id='62f2955e0c3047259e509b2373f140da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:07:07 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-d5c348d2-7019-4611-a8d1-b18a1fefcc13 tempest-VolumeQuotasNegativeTestJSON-1384058415 None] Creating volume d0c731ce-99d5-4161-b600-8481c7df2abb {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:07:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-d5c348d2-7019-4611-a8d1-b18a1fefcc13 tempest-VolumeQuotasNegativeTestJSON-1384058415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:07:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-d5c348d2-7019-4611-a8d1-b18a1fefcc13 tempest-VolumeQuotasNegativeTestJSON-1384058415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:07:07 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-d5c348d2-7019-4611-a8d1-b18a1fefcc13 tempest-VolumeQuotasNegativeTestJSON-1384058415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:07:07 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-d5c348d2-7019-4611-a8d1-b18a1fefcc13 tempest-VolumeQuotasNegativeTestJSON-1384058415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:07:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-d5c348d2-7019-4611-a8d1-b18a1fefcc13 tempest-VolumeQuotasNegativeTestJSON-1384058415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:07:07 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-d5c348d2-7019-4611-a8d1-b18a1fefcc13 tempest-VolumeQuotasNegativeTestJSON-1384058415 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:07:07 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-d5c348d2-7019-4611-a8d1-b18a1fefcc13 tempest-VolumeQuotasNegativeTestJSON-1384058415 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:07:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d5c348d2-7019-4611-a8d1-b18a1fefcc13 tempest-VolumeQuotasNegativeTestJSON-1384058415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d0c731ce-99d5-4161-b600-8481c7df2abb 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:07:07 devstack sudo[103093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d0c731ce-99d5-4161-b600-8481c7df2abb 1073741824 Aug 10 16:07:07 devstack sudo[103093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:07:07 devstack cinder-volume[88641]: DEBUG cinder.volume.volume_utils [None req-bb40a154-3f94-4c77-950d-d91f29c4166f tempest-VolumeImageDependencyTests-892319928 None] Attempting download of 906eda4e-0334-4920-bf6c-52d8fac45476 ((None, [{'url': 'file:///opt/stack/data/glance/images/906eda4e-0334-4920-bf6c-52d8fac45476', 'metadata': {}}])) to volume 58b3583f-9517-458c-b9f2-5a7afe843842. {{(pid=88641) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 10 16:07:07 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[30bcbade-6fde-4eac-a11c-ec606310a180]: (4, 'raw') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:07:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bb40a154-3f94-4c77-950d-d91f29c4166f tempest-VolumeImageDependencyTests-892319928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_906eda4e-0334-4920-bf6c-52d8fac45476_q4v4_vh6 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:07:07 devstack sudo[103095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_906eda4e-0334-4920-bf6c-52d8fac45476_q4v4_vh6 Aug 10 16:07:07 devstack sudo[103095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:07:07 devstack sudo[103093]: pam_unix(sudo:session): session closed for user root Aug 10 16:07:07 devstack sudo[103095]: pam_unix(sudo:session): session closed for user root Aug 10 16:07:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d5c348d2-7019-4611-a8d1-b18a1fefcc13 tempest-VolumeQuotasNegativeTestJSON-1384058415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d0c731ce-99d5-4161-b600-8481c7df2abb 1073741824" returned: 0 in 0.417s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:07:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bb40a154-3f94-4c77-950d-d91f29c4166f tempest-VolumeImageDependencyTests-892319928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_906eda4e-0334-4920-bf6c-52d8fac45476_q4v4_vh6" returned: 0 in 0.345s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:07:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bb40a154-3f94-4c77-950d-d91f29c4166f tempest-VolumeImageDependencyTests-892319928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_906eda4e-0334-4920-bf6c-52d8fac45476_q4v4_vh6 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:07:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d5c348d2-7019-4611-a8d1-b18a1fefcc13 tempest-VolumeQuotasNegativeTestJSON-1384058415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d0c731ce-99d5-4161-b600-8481c7df2abb {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:07:07 devstack sudo[103103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d0c731ce-99d5-4161-b600-8481c7df2abb Aug 10 16:07:07 devstack sudo[103103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:07:07 devstack sudo[103102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_906eda4e-0334-4920-bf6c-52d8fac45476_q4v4_vh6 Aug 10 16:07:07 devstack sudo[103102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:07:08 devstack sudo[103103]: pam_unix(sudo:session): session closed for user root Aug 10 16:07:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d5c348d2-7019-4611-a8d1-b18a1fefcc13 tempest-VolumeQuotasNegativeTestJSON-1384058415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d0c731ce-99d5-4161-b600-8481c7df2abb" returned: 0 in 0.252s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:07:08 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-d5c348d2-7019-4611-a8d1-b18a1fefcc13 tempest-VolumeQuotasNegativeTestJSON-1384058415 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:07:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-d5c348d2-7019-4611-a8d1-b18a1fefcc13 tempest-VolumeQuotasNegativeTestJSON-1384058415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.724s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:07:08 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d5c348d2-7019-4611-a8d1-b18a1fefcc13 tempest-VolumeQuotasNegativeTestJSON-1384058415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (361e848c-9864-4f3d-9623-4caff494f4a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0c731ce-99d5-4161-b600-8481c7df2abb', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:07:08 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d5c348d2-7019-4611-a8d1-b18a1fefcc13 tempest-VolumeQuotasNegativeTestJSON-1384058415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e010ec79-c213-4575-ae0d-b98ac6969423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:07:08 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-d5c348d2-7019-4611-a8d1-b18a1fefcc13 tempest-VolumeQuotasNegativeTestJSON-1384058415 None] Volume volume-d0c731ce-99d5-4161-b600-8481c7df2abb (d0c731ce-99d5-4161-b600-8481c7df2abb): created successfully Aug 10 16:07:08 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d5c348d2-7019-4611-a8d1-b18a1fefcc13 tempest-VolumeQuotasNegativeTestJSON-1384058415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e010ec79-c213-4575-ae0d-b98ac6969423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:07:08 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d5c348d2-7019-4611-a8d1-b18a1fefcc13 tempest-VolumeQuotasNegativeTestJSON-1384058415 None] Flow 'volume_create_manager' (c5fc7082-9e6f-4888-b2b3-8f539dcb51bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:07:08 devstack sudo[103102]: pam_unix(sudo:session): session closed for user root Aug 10 16:07:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bb40a154-3f94-4c77-950d-d91f29c4166f tempest-VolumeImageDependencyTests-892319928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_906eda4e-0334-4920-bf6c-52d8fac45476_q4v4_vh6" returned: 1 in 0.350s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:07:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bb40a154-3f94-4c77-950d-d91f29c4166f tempest-VolumeImageDependencyTests-892319928 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_906eda4e-0334-4920-bf6c-52d8fac45476_q4v4_vh6' failed. Not Retrying. {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 10 16:07:08 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a824a6-6ad0-4f41-820f-33282d604184]: (4, 'raw') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:07:08 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-d5c348d2-7019-4611-a8d1-b18a1fefcc13 tempest-VolumeQuotasNegativeTestJSON-1384058415 None] Created volume successfully. Aug 10 16:07:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bb40a154-3f94-4c77-950d-d91f29c4166f tempest-VolumeImageDependencyTests-892319928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_906eda4e-0334-4920-bf6c-52d8fac45476_tm2v5wdhdevstack@QuobyteHD {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:07:08 devstack sudo[103109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_906eda4e-0334-4920-bf6c-52d8fac45476_tm2v5wdhdevstack@QuobyteHD Aug 10 16:07:08 devstack sudo[103109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:07:08 devstack sudo[103109]: pam_unix(sudo:session): session closed for user root Aug 10 16:07:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bb40a154-3f94-4c77-950d-d91f29c4166f tempest-VolumeImageDependencyTests-892319928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_906eda4e-0334-4920-bf6c-52d8fac45476_tm2v5wdhdevstack@QuobyteHD" returned: 0 in 0.316s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:07:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bb40a154-3f94-4c77-950d-d91f29c4166f tempest-VolumeImageDependencyTests-892319928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_906eda4e-0334-4920-bf6c-52d8fac45476_tm2v5wdhdevstack@QuobyteHD {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:07:08 devstack sudo[103113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_906eda4e-0334-4920-bf6c-52d8fac45476_tm2v5wdhdevstack@QuobyteHD Aug 10 16:07:08 devstack sudo[103113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:07:08 devstack sudo[103113]: pam_unix(sudo:session): session closed for user root Aug 10 16:07:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bb40a154-3f94-4c77-950d-d91f29c4166f tempest-VolumeImageDependencyTests-892319928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_906eda4e-0334-4920-bf6c-52d8fac45476_tm2v5wdhdevstack@QuobyteHD" returned: 1 in 0.328s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:07:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bb40a154-3f94-4c77-950d-d91f29c4166f tempest-VolumeImageDependencyTests-892319928 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_906eda4e-0334-4920-bf6c-52d8fac45476_tm2v5wdhdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 10 16:07:08 devstack cinder-volume[88641]: DEBUG cinder.image.image_utils [None req-bb40a154-3f94-4c77-950d-d91f29c4166f tempest-VolumeImageDependencyTests-892319928 None] 906eda4e-0334-4920-bf6c-52d8fac45476 was raw, converting to qcow2 {{(pid=88641) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 10 16:07:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bb40a154-3f94-4c77-950d-d91f29c4166f tempest-VolumeImageDependencyTests-892319928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_906eda4e-0334-4920-bf6c-52d8fac45476_tm2v5wdhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-58b3583f-9517-458c-b9f2-5a7afe843842 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:07:08 devstack sudo[103118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_906eda4e-0334-4920-bf6c-52d8fac45476_tm2v5wdhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-58b3583f-9517-458c-b9f2-5a7afe843842 Aug 10 16:07:08 devstack sudo[103118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:07:09 devstack sudo[103118]: pam_unix(sudo:session): session closed for user root Aug 10 16:07:09 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bb40a154-3f94-4c77-950d-d91f29c4166f tempest-VolumeImageDependencyTests-892319928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_906eda4e-0334-4920-bf6c-52d8fac45476_tm2v5wdhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-58b3583f-9517-458c-b9f2-5a7afe843842" returned: 0 in 0.449s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:07:09 devstack cinder-volume[88641]: DEBUG cinder.image.image_utils [None req-bb40a154-3f94-4c77-950d-d91f29c4166f tempest-VolumeImageDependencyTests-892319928 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_906eda4e-0334-4920-bf6c-52d8fac45476_tm2v5wdhdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-58b3583f-9517-458c-b9f2-5a7afe843842 {{(pid=88641) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 10 16:07:09 devstack cinder-volume[88641]: INFO cinder.image.image_utils [None req-bb40a154-3f94-4c77-950d-d91f29c4166f tempest-VolumeImageDependencyTests-892319928 None] Converted 0.00 MB image at 0.00 MB/s Aug 10 16:07:09 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bb40a154-3f94-4c77-950d-d91f29c4166f tempest-VolumeImageDependencyTests-892319928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-58b3583f-9517-458c-b9f2-5a7afe843842 1G {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:07:09 devstack sudo[103124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-58b3583f-9517-458c-b9f2-5a7afe843842 1G Aug 10 16:07:09 devstack sudo[103124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:07:09 devstack sudo[103124]: pam_unix(sudo:session): session closed for user root Aug 10 16:07:09 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bb40a154-3f94-4c77-950d-d91f29c4166f tempest-VolumeImageDependencyTests-892319928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-58b3583f-9517-458c-b9f2-5a7afe843842 1G" returned: 0 in 0.348s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:07:09 devstack cinder-volume[88641]: DEBUG cinder.volume.volume_utils [None req-bb40a154-3f94-4c77-950d-d91f29c4166f tempest-VolumeImageDependencyTests-892319928 None] Downloaded image 906eda4e-0334-4920-bf6c-52d8fac45476 ((None, [{'url': 'file:///opt/stack/data/glance/images/906eda4e-0334-4920-bf6c-52d8fac45476', 'metadata': {}}])) to volume 58b3583f-9517-458c-b9f2-5a7afe843842 successfully. {{(pid=88641) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 10 16:07:09 devstack cinder-volume[88641]: DEBUG cinder.image.image_utils [None req-bb40a154-3f94-4c77-950d-d91f29c4166f tempest-VolumeImageDependencyTests-892319928 None] Temporary image 906eda4e-0334-4920-bf6c-52d8fac45476 for user d32a5afbf24340298606d054b0612b4a is deleted. {{(pid=88641) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 10 16:07:09 devstack cinder-volume[88641]: DEBUG cinder.volume.volume_utils [None req-bb40a154-3f94-4c77-950d-d91f29c4166f tempest-VolumeImageDependencyTests-892319928 None] Marking volume 58b3583f-9517-458c-b9f2-5a7afe843842 as bootable. {{(pid=88641) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 10 16:07:09 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb40a154-3f94-4c77-950d-d91f29c4166f tempest-VolumeImageDependencyTests-892319928 None] Copying metadata from image 906eda4e-0334-4920-bf6c-52d8fac45476 to 58b3583f-9517-458c-b9f2-5a7afe843842. {{(pid=88641) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 10 16:07:09 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb40a154-3f94-4c77-950d-d91f29c4166f tempest-VolumeImageDependencyTests-892319928 None] Creating volume glance metadata for volume 58b3583f-9517-458c-b9f2-5a7afe843842 backed by image 906eda4e-0334-4920-bf6c-52d8fac45476 with: {'image_id': '906eda4e-0334-4920-bf6c-52d8fac45476', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '0f4536c57ddd0442c160d1fc56ab1721', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88641) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 10 16:07:09 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bb40a154-3f94-4c77-950d-d91f29c4166f tempest-VolumeImageDependencyTests-892319928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6f6e07a-b5cb-4362-8d4b-edcc76f9ec80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58b3583f-9517-458c-b9f2-5a7afe843842', 'volume_size': 1, 'image_id': '906eda4e-0334-4920-bf6c-52d8fac45476', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/906eda4e-0334-4920-bf6c-52d8fac45476', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0f4536c57ddd0442c160d1fc56ab1721', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a4f7c2c3cb3b4e9c8c6d43cf87985c01', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e31f4d59293ed672462f8dcb2ea28e5416d8738a3357d9387c4e31c8598ff90963ce26053ac29fb9d2115d20da497345d7c9144db09796ba2b5291b05ab0c10a', 'id': '906eda4e-0334-4920-bf6c-52d8fac45476', 'created_at': datetime.datetime(2026, 8, 10, 14, 7, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 10, 14, 7, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/906eda4e-0334-4920-bf6c-52d8fac45476/file', 'properties': {}}, 'image_service': }' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:07:09 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bb40a154-3f94-4c77-950d-d91f29c4166f tempest-VolumeImageDependencyTests-892319928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e081dceb-442c-4d71-81be-5e6f55ff87db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:07:09 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-bb40a154-3f94-4c77-950d-d91f29c4166f tempest-VolumeImageDependencyTests-892319928 None] Volume volume-58b3583f-9517-458c-b9f2-5a7afe843842 (58b3583f-9517-458c-b9f2-5a7afe843842): created successfully Aug 10 16:07:09 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bb40a154-3f94-4c77-950d-d91f29c4166f tempest-VolumeImageDependencyTests-892319928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e081dceb-442c-4d71-81be-5e6f55ff87db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:07:09 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bb40a154-3f94-4c77-950d-d91f29c4166f tempest-VolumeImageDependencyTests-892319928 None] Flow 'volume_create_manager' (33db868e-9169-4f12-9a1e-7e72f7606cb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:07:09 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-bb40a154-3f94-4c77-950d-d91f29c4166f tempest-VolumeImageDependencyTests-892319928 None] Created volume successfully. Aug 10 16:07:10 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-623ea5d5-b9be-4b79-a4e4-20bb8fb39271 tempest-VolumeQuotasNegativeTestJSON-1384058415 None] Acquiring lock "cinder-d0c731ce-99d5-4161-b600-8481c7df2abb-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:07:10 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-623ea5d5-b9be-4b79-a4e4-20bb8fb39271 tempest-VolumeQuotasNegativeTestJSON-1384058415 None] Lock "cinder-d0c731ce-99d5-4161-b600-8481c7df2abb-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:07:10 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-623ea5d5-b9be-4b79-a4e4-20bb8fb39271 tempest-VolumeQuotasNegativeTestJSON-1384058415 None] Acquiring lock "cinder-quobyte-d0c731ce-99d5-4161-b600-8481c7df2abb" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:07:10 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-623ea5d5-b9be-4b79-a4e4-20bb8fb39271 tempest-VolumeQuotasNegativeTestJSON-1384058415 None] Lock "cinder-quobyte-d0c731ce-99d5-4161-b600-8481c7df2abb" acquired by "delete_volume" :: waited 0.016s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:07:10 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ae462a-3204-4172-bc7a-1b03dc4e1b90]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:07:10 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-623ea5d5-b9be-4b79-a4e4-20bb8fb39271 tempest-VolumeQuotasNegativeTestJSON-1384058415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d0c731ce-99d5-4161-b600-8481c7df2abb {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:07:10 devstack sudo[103129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d0c731ce-99d5-4161-b600-8481c7df2abb Aug 10 16:07:10 devstack sudo[103129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:07:10 devstack sudo[103129]: pam_unix(sudo:session): session closed for user root Aug 10 16:07:10 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-623ea5d5-b9be-4b79-a4e4-20bb8fb39271 tempest-VolumeQuotasNegativeTestJSON-1384058415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d0c731ce-99d5-4161-b600-8481c7df2abb" returned: 0 in 0.357s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:07:10 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-623ea5d5-b9be-4b79-a4e4-20bb8fb39271 tempest-VolumeQuotasNegativeTestJSON-1384058415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d0c731ce-99d5-4161-b600-8481c7df2abb {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:07:10 devstack sudo[103134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d0c731ce-99d5-4161-b600-8481c7df2abb Aug 10 16:07:10 devstack sudo[103134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:07:10 devstack sudo[103134]: pam_unix(sudo:session): session closed for user root Aug 10 16:07:10 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-623ea5d5-b9be-4b79-a4e4-20bb8fb39271 tempest-VolumeQuotasNegativeTestJSON-1384058415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d0c731ce-99d5-4161-b600-8481c7df2abb" returned: 0 in 0.266s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:07:10 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-7823b06e-f9aa-40a6-ab81-83962204b547 tempest-VolumeImageDependencyTests-892319928 None] Acquiring lock "cinder-58b3583f-9517-458c-b9f2-5a7afe843842-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:07:10 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-623ea5d5-b9be-4b79-a4e4-20bb8fb39271 tempest-VolumeQuotasNegativeTestJSON-1384058415 None] Lock "cinder-quobyte-d0c731ce-99d5-4161-b600-8481c7df2abb" released by "delete_volume" :: held 0.723s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:07:10 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-7823b06e-f9aa-40a6-ab81-83962204b547 tempest-VolumeImageDependencyTests-892319928 None] Lock "cinder-58b3583f-9517-458c-b9f2-5a7afe843842-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:07:10 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-7823b06e-f9aa-40a6-ab81-83962204b547 tempest-VolumeImageDependencyTests-892319928 None] Acquiring lock "cinder-quobyte-58b3583f-9517-458c-b9f2-5a7afe843842" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:07:10 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-623ea5d5-b9be-4b79-a4e4-20bb8fb39271 tempest-VolumeQuotasNegativeTestJSON-1384058415 None] Created reservations ['9d98899b-dcdf-4cfd-ad7b-ff1133acfc5e', '37379474-74d8-46a0-ae90-124b301f5d85', '4a622a3d-e19c-4685-b7f1-04d69aee5aef', '55720ce1-5bf0-4dd5-907b-f8f4c9490c0a'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:07:10 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-7823b06e-f9aa-40a6-ab81-83962204b547 tempest-VolumeImageDependencyTests-892319928 None] Lock "cinder-quobyte-58b3583f-9517-458c-b9f2-5a7afe843842" acquired by "delete_volume" :: waited 0.019s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:07:10 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e7969e9-10f6-4135-a290-74a6e2e07156]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:07:10 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7823b06e-f9aa-40a6-ab81-83962204b547 tempest-VolumeImageDependencyTests-892319928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-58b3583f-9517-458c-b9f2-5a7afe843842 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:07:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-623ea5d5-b9be-4b79-a4e4-20bb8fb39271 tempest-VolumeQuotasNegativeTestJSON-1384058415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:07:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-623ea5d5-b9be-4b79-a4e4-20bb8fb39271 tempest-VolumeQuotasNegativeTestJSON-1384058415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:07:11 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-623ea5d5-b9be-4b79-a4e4-20bb8fb39271 tempest-VolumeQuotasNegativeTestJSON-1384058415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:07:11 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-623ea5d5-b9be-4b79-a4e4-20bb8fb39271 tempest-VolumeQuotasNegativeTestJSON-1384058415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:07:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-623ea5d5-b9be-4b79-a4e4-20bb8fb39271 tempest-VolumeQuotasNegativeTestJSON-1384058415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:07:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-623ea5d5-b9be-4b79-a4e4-20bb8fb39271 tempest-VolumeQuotasNegativeTestJSON-1384058415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:07:11 devstack sudo[103138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:07:11 devstack sudo[103138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:07:11 devstack sudo[103137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-58b3583f-9517-458c-b9f2-5a7afe843842 Aug 10 16:07:11 devstack sudo[103137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:07:11 devstack sudo[103138]: pam_unix(sudo:session): session closed for user root Aug 10 16:07:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-623ea5d5-b9be-4b79-a4e4-20bb8fb39271 tempest-VolumeQuotasNegativeTestJSON-1384058415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.300s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:07:11 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-623ea5d5-b9be-4b79-a4e4-20bb8fb39271 tempest-VolumeQuotasNegativeTestJSON-1384058415 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:07:11 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-623ea5d5-b9be-4b79-a4e4-20bb8fb39271 tempest-VolumeQuotasNegativeTestJSON-1384058415 None] Deleted volume successfully. Aug 10 16:07:11 devstack sudo[103137]: pam_unix(sudo:session): session closed for user root Aug 10 16:07:11 devstack cinder-volume[88641]: DEBUG dbcounter [-] [88641] Writing DB stats cinder:SELECT=141,cinder:UPDATE=153,cinder:DELETE=12,cinder:INSERT=45 {{(pid=88641) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 16:07:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7823b06e-f9aa-40a6-ab81-83962204b547 tempest-VolumeImageDependencyTests-892319928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-58b3583f-9517-458c-b9f2-5a7afe843842" returned: 0 in 0.384s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:07:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7823b06e-f9aa-40a6-ab81-83962204b547 tempest-VolumeImageDependencyTests-892319928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-58b3583f-9517-458c-b9f2-5a7afe843842 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:07:11 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-623ea5d5-b9be-4b79-a4e4-20bb8fb39271 tempest-VolumeQuotasNegativeTestJSON-1384058415 None] Lock "cinder-d0c731ce-99d5-4161-b600-8481c7df2abb-delete_volume" released by "delete_volume" :: held 1.299s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:07:11 devstack sudo[103145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-58b3583f-9517-458c-b9f2-5a7afe843842 Aug 10 16:07:11 devstack sudo[103145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:07:11 devstack sudo[103145]: pam_unix(sudo:session): session closed for user root Aug 10 16:07:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7823b06e-f9aa-40a6-ab81-83962204b547 tempest-VolumeImageDependencyTests-892319928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-58b3583f-9517-458c-b9f2-5a7afe843842" returned: 0 in 0.275s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:07:11 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-7823b06e-f9aa-40a6-ab81-83962204b547 tempest-VolumeImageDependencyTests-892319928 None] Lock "cinder-quobyte-58b3583f-9517-458c-b9f2-5a7afe843842" released by "delete_volume" :: held 0.702s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:07:11 devstack cinder-volume[88641]: DEBUG dbcounter [-] [88641] Writing DB stats cinder:DELETE=16,cinder:SELECT=115,cinder:UPDATE=178,cinder:INSERT=46 {{(pid=88641) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 16:07:11 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-7823b06e-f9aa-40a6-ab81-83962204b547 tempest-VolumeImageDependencyTests-892319928 None] Created reservations ['7e20625f-1a03-4301-bd62-5745f97946dc', '34958dd5-8123-4bec-b1fa-3fb6cca292ef', 'd129fa86-dd1f-47da-9f81-46fbf7f0864f', '4b853b2f-047e-4e13-8360-77cbcc42e283'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:07:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-7823b06e-f9aa-40a6-ab81-83962204b547 tempest-VolumeImageDependencyTests-892319928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:07:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-7823b06e-f9aa-40a6-ab81-83962204b547 tempest-VolumeImageDependencyTests-892319928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:07:11 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-7823b06e-f9aa-40a6-ab81-83962204b547 tempest-VolumeImageDependencyTests-892319928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:07:11 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-7823b06e-f9aa-40a6-ab81-83962204b547 tempest-VolumeImageDependencyTests-892319928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:07:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-7823b06e-f9aa-40a6-ab81-83962204b547 tempest-VolumeImageDependencyTests-892319928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:07:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7823b06e-f9aa-40a6-ab81-83962204b547 tempest-VolumeImageDependencyTests-892319928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:07:11 devstack sudo[103148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:07:11 devstack sudo[103148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:07:12 devstack sudo[103148]: pam_unix(sudo:session): session closed for user root Aug 10 16:07:12 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7823b06e-f9aa-40a6-ab81-83962204b547 tempest-VolumeImageDependencyTests-892319928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.257s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:07:12 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-7823b06e-f9aa-40a6-ab81-83962204b547 tempest-VolumeImageDependencyTests-892319928 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:07:12 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-7823b06e-f9aa-40a6-ab81-83962204b547 tempest-VolumeImageDependencyTests-892319928 None] Deleted volume successfully. Aug 10 16:07:12 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-7823b06e-f9aa-40a6-ab81-83962204b547 tempest-VolumeImageDependencyTests-892319928 None] Lock "cinder-58b3583f-9517-458c-b9f2-5a7afe843842-delete_volume" released by "delete_volume" :: held 1.189s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:07:13 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-5dec83b9-b9a9-470b-99c0-b5c6c88430c5 req-c0721c6e-57bd-4838-b02a-417508240511 tempest-TestStampPattern-1573197444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:07:13 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-5dec83b9-b9a9-470b-99c0-b5c6c88430c5 req-c0721c6e-57bd-4838-b02a-417508240511 tempest-TestStampPattern-1573197444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:07:13 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-5dec83b9-b9a9-470b-99c0-b5c6c88430c5 req-c0721c6e-57bd-4838-b02a-417508240511 tempest-TestStampPattern-1573197444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:07:13 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [req-5dec83b9-b9a9-470b-99c0-b5c6c88430c5 req-c0721c6e-57bd-4838-b02a-417508240511 tempest-TestStampPattern-1573197444 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc', 'name': 'volume-4a4564b4-def3-447b-98ae-a4fa16c5d222', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7d0b5c3b-e7a6-4884-8ed8-05b10feb9a81', 'enforce_multipath': True} {{(pid=88641) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 10 16:07:13 devstack cinder-volume[88641]: INFO cinder.volume.manager [req-5dec83b9-b9a9-470b-99c0-b5c6c88430c5 req-c0721c6e-57bd-4838-b02a-417508240511 tempest-TestStampPattern-1573197444 None] attachment_update completed successfully. Aug 10 16:07:17 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-a66e71ed-e75e-41d3-8afd-c855e62a33d0 tempest-VolumeRetypeWithoutMigrationTest-332909555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:07:17 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-a66e71ed-e75e-41d3-8afd-c855e62a33d0 tempest-VolumeRetypeWithoutMigrationTest-332909555 None] Flow 'volume_create_manager' (d117128e-8507-4f3a-92c0-a8f5ccb7b479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:07:17 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-a66e71ed-e75e-41d3-8afd-c855e62a33d0 tempest-VolumeRetypeWithoutMigrationTest-332909555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce12fb10-f6fd-4b7d-b908-de8ec82dd295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:07:17 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-a66e71ed-e75e-41d3-8afd-c855e62a33d0 tempest-VolumeRetypeWithoutMigrationTest-332909555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce12fb10-f6fd-4b7d-b908-de8ec82dd295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:07:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-420813583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaa31fbe-913c-432e-b434-c50a909e1b33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad538c893cb740529e247c2afacab7ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:07:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:07:17Z,use_quota=True,user_id='da0b807e49444e7d838fd40da9802018',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba62870f-a7af-44ab-a707-ecd0e947cd95),volume_type_id=ba62870f-a7af-44ab-a707-ecd0e947cd95)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:07:17 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-a66e71ed-e75e-41d3-8afd-c855e62a33d0 tempest-VolumeRetypeWithoutMigrationTest-332909555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (481c1448-dc0c-4a1d-8949-3e4776d6a824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:07:17 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-a66e71ed-e75e-41d3-8afd-c855e62a33d0 tempest-VolumeRetypeWithoutMigrationTest-332909555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (481c1448-dc0c-4a1d-8949-3e4776d6a824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:07:17 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-a66e71ed-e75e-41d3-8afd-c855e62a33d0 tempest-VolumeRetypeWithoutMigrationTest-332909555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52e1e6a9-699d-498c-bcaf-db3a871ac66d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:07:17 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-a66e71ed-e75e-41d3-8afd-c855e62a33d0 tempest-VolumeRetypeWithoutMigrationTest-332909555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52e1e6a9-699d-498c-bcaf-db3a871ac66d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aaa31fbe-913c-432e-b434-c50a909e1b33', 'volume_name': 'volume-aaa31fbe-913c-432e-b434-c50a909e1b33', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:07:17 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-a66e71ed-e75e-41d3-8afd-c855e62a33d0 tempest-VolumeRetypeWithoutMigrationTest-332909555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdc92484-3416-4ada-ae9e-1bb69b03f03e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:07:17 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-a66e71ed-e75e-41d3-8afd-c855e62a33d0 tempest-VolumeRetypeWithoutMigrationTest-332909555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdc92484-3416-4ada-ae9e-1bb69b03f03e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:07:17 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-a66e71ed-e75e-41d3-8afd-c855e62a33d0 tempest-VolumeRetypeWithoutMigrationTest-332909555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0066572d-6591-4e0a-9d9e-2a821fbe2807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:07:17 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-a66e71ed-e75e-41d3-8afd-c855e62a33d0 tempest-VolumeRetypeWithoutMigrationTest-332909555 None] Volume aaa31fbe-913c-432e-b434-c50a909e1b33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aaa31fbe-913c-432e-b434-c50a909e1b33', 'volume_size': 1} Aug 10 16:07:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-a66e71ed-e75e-41d3-8afd-c855e62a33d0 tempest-VolumeRetypeWithoutMigrationTest-332909555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:07:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-a66e71ed-e75e-41d3-8afd-c855e62a33d0 tempest-VolumeRetypeWithoutMigrationTest-332909555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:07:17 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-a66e71ed-e75e-41d3-8afd-c855e62a33d0 tempest-VolumeRetypeWithoutMigrationTest-332909555 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:07:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-420813583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaa31fbe-913c-432e-b434-c50a909e1b33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad538c893cb740529e247c2afacab7ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:07:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:07:17Z,use_quota=True,user_id='da0b807e49444e7d838fd40da9802018',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba62870f-a7af-44ab-a707-ecd0e947cd95),volume_type_id=ba62870f-a7af-44ab-a707-ecd0e947cd95)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:07:17 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-a66e71ed-e75e-41d3-8afd-c855e62a33d0 tempest-VolumeRetypeWithoutMigrationTest-332909555 None] Creating volume aaa31fbe-913c-432e-b434-c50a909e1b33 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:07:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-a66e71ed-e75e-41d3-8afd-c855e62a33d0 tempest-VolumeRetypeWithoutMigrationTest-332909555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:07:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-a66e71ed-e75e-41d3-8afd-c855e62a33d0 tempest-VolumeRetypeWithoutMigrationTest-332909555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:07:17 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-a66e71ed-e75e-41d3-8afd-c855e62a33d0 tempest-VolumeRetypeWithoutMigrationTest-332909555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:07:17 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-a66e71ed-e75e-41d3-8afd-c855e62a33d0 tempest-VolumeRetypeWithoutMigrationTest-332909555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:07:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-a66e71ed-e75e-41d3-8afd-c855e62a33d0 tempest-VolumeRetypeWithoutMigrationTest-332909555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:07:17 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-a66e71ed-e75e-41d3-8afd-c855e62a33d0 tempest-VolumeRetypeWithoutMigrationTest-332909555 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:07:17 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-a66e71ed-e75e-41d3-8afd-c855e62a33d0 tempest-VolumeRetypeWithoutMigrationTest-332909555 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:07:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a66e71ed-e75e-41d3-8afd-c855e62a33d0 tempest-VolumeRetypeWithoutMigrationTest-332909555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-aaa31fbe-913c-432e-b434-c50a909e1b33 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:07:17 devstack sudo[103562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-aaa31fbe-913c-432e-b434-c50a909e1b33 1073741824 Aug 10 16:07:17 devstack sudo[103562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:07:17 devstack sudo[103562]: pam_unix(sudo:session): session closed for user root Aug 10 16:07:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a66e71ed-e75e-41d3-8afd-c855e62a33d0 tempest-VolumeRetypeWithoutMigrationTest-332909555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-aaa31fbe-913c-432e-b434-c50a909e1b33 1073741824" returned: 0 in 0.485s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:07:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a66e71ed-e75e-41d3-8afd-c855e62a33d0 tempest-VolumeRetypeWithoutMigrationTest-332909555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-aaa31fbe-913c-432e-b434-c50a909e1b33 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:07:18 devstack sudo[103568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-aaa31fbe-913c-432e-b434-c50a909e1b33 Aug 10 16:07:18 devstack sudo[103568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:07:18 devstack sudo[103568]: pam_unix(sudo:session): session closed for user root Aug 10 16:07:18 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a66e71ed-e75e-41d3-8afd-c855e62a33d0 tempest-VolumeRetypeWithoutMigrationTest-332909555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-aaa31fbe-913c-432e-b434-c50a909e1b33" returned: 0 in 0.273s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:07:18 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-a66e71ed-e75e-41d3-8afd-c855e62a33d0 tempest-VolumeRetypeWithoutMigrationTest-332909555 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:07:18 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-a66e71ed-e75e-41d3-8afd-c855e62a33d0 tempest-VolumeRetypeWithoutMigrationTest-332909555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:07:18 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-a66e71ed-e75e-41d3-8afd-c855e62a33d0 tempest-VolumeRetypeWithoutMigrationTest-332909555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0066572d-6591-4e0a-9d9e-2a821fbe2807) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aaa31fbe-913c-432e-b434-c50a909e1b33', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:07:18 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-a66e71ed-e75e-41d3-8afd-c855e62a33d0 tempest-VolumeRetypeWithoutMigrationTest-332909555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca4cd04d-f907-42b1-824f-7009404206bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:07:18 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-a66e71ed-e75e-41d3-8afd-c855e62a33d0 tempest-VolumeRetypeWithoutMigrationTest-332909555 None] Volume volume-aaa31fbe-913c-432e-b434-c50a909e1b33 (aaa31fbe-913c-432e-b434-c50a909e1b33): created successfully Aug 10 16:07:18 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-a66e71ed-e75e-41d3-8afd-c855e62a33d0 tempest-VolumeRetypeWithoutMigrationTest-332909555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca4cd04d-f907-42b1-824f-7009404206bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:07:18 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-a66e71ed-e75e-41d3-8afd-c855e62a33d0 tempest-VolumeRetypeWithoutMigrationTest-332909555 None] Flow 'volume_create_manager' (d117128e-8507-4f3a-92c0-a8f5ccb7b479) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:07:18 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-a66e71ed-e75e-41d3-8afd-c855e62a33d0 tempest-VolumeRetypeWithoutMigrationTest-332909555 None] Created volume successfully. Aug 10 16:07:19 devstack cinder-volume[88641]: INFO cinder.volume.manager [req-3621044d-4513-4dd7-8314-211fe6eed561 req-e6df5638-fc5a-4614-aaa9-aaa8512f334e tempest-TestStampPattern-1573197444 None] Terminate volume connection completed successfully. Aug 10 16:07:19 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [req-3621044d-4513-4dd7-8314-211fe6eed561 req-e6df5638-fc5a-4614-aaa9-aaa8512f334e tempest-TestStampPattern-1573197444 None] Deleting attachment 7d0b5c3b-e7a6-4884-8ed8-05b10feb9a81. {{(pid=88641) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 10 16:07:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-f31fd21f-691d-48bd-9e20-8d7dd259431c tempest-VolumeRetypeWithoutMigrationTest-332909555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:07:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-f31fd21f-691d-48bd-9e20-8d7dd259431c tempest-VolumeRetypeWithoutMigrationTest-332909555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:07:19 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-f31fd21f-691d-48bd-9e20-8d7dd259431c tempest-VolumeRetypeWithoutMigrationTest-332909555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:07:19 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-f31fd21f-691d-48bd-9e20-8d7dd259431c tempest-VolumeRetypeWithoutMigrationTest-332909555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:07:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-f31fd21f-691d-48bd-9e20-8d7dd259431c tempest-VolumeRetypeWithoutMigrationTest-332909555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:07:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-f31fd21f-691d-48bd-9e20-8d7dd259431c tempest-VolumeRetypeWithoutMigrationTest-332909555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:07:19 devstack sudo[103614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:07:19 devstack sudo[103614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:07:20 devstack sudo[103614]: pam_unix(sudo:session): session closed for user root Aug 10 16:07:20 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-f31fd21f-691d-48bd-9e20-8d7dd259431c tempest-VolumeRetypeWithoutMigrationTest-332909555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.256s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:07:20 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-f31fd21f-691d-48bd-9e20-8d7dd259431c tempest-VolumeRetypeWithoutMigrationTest-332909555 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:07:20 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-f31fd21f-691d-48bd-9e20-8d7dd259431c tempest-VolumeRetypeWithoutMigrationTest-332909555 None] Retype volume completed successfully. Aug 10 16:07:20 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-8d295ad6-9f38-426c-b2be-6dd190d9bfc0 tempest-TestStampPattern-1573197444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:07:20 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-8d295ad6-9f38-426c-b2be-6dd190d9bfc0 tempest-TestStampPattern-1573197444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:07:20 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-8d295ad6-9f38-426c-b2be-6dd190d9bfc0 tempest-TestStampPattern-1573197444 None] Creating offline snapshot 1dbf7b09-5a0e-4111-a483-7ec2d267f2af of volume 4a4564b4-def3-447b-98ae-a4fa16c5d222 {{(pid=88641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 16:07:20 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[591ce375-ea54-46fb-9590-52363a46da3c]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:07:20 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-8d295ad6-9f38-426c-b2be-6dd190d9bfc0 tempest-TestStampPattern-1573197444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4a4564b4-def3-447b-98ae-a4fa16c5d222 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:07:20 devstack sudo[103617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4a4564b4-def3-447b-98ae-a4fa16c5d222 Aug 10 16:07:20 devstack sudo[103617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:07:20 devstack sudo[103617]: pam_unix(sudo:session): session closed for user root Aug 10 16:07:20 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-8d295ad6-9f38-426c-b2be-6dd190d9bfc0 tempest-TestStampPattern-1573197444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4a4564b4-def3-447b-98ae-a4fa16c5d222" returned: 0 in 0.404s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:07:20 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-8d295ad6-9f38-426c-b2be-6dd190d9bfc0 tempest-TestStampPattern-1573197444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4a4564b4-def3-447b-98ae-a4fa16c5d222,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4a4564b4-def3-447b-98ae-a4fa16c5d222.1dbf7b09-5a0e-4111-a483-7ec2d267f2af 1G {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:07:20 devstack sudo[103622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4a4564b4-def3-447b-98ae-a4fa16c5d222,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4a4564b4-def3-447b-98ae-a4fa16c5d222.1dbf7b09-5a0e-4111-a483-7ec2d267f2af 1G Aug 10 16:07:20 devstack sudo[103622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:07:21 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-766a1a6e-9fb9-456e-945c-c433e0403f33 tempest-VolumeRetypeWithoutMigrationTest-332909555 None] Acquiring lock "cinder-aaa31fbe-913c-432e-b434-c50a909e1b33-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:07:21 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-766a1a6e-9fb9-456e-945c-c433e0403f33 tempest-VolumeRetypeWithoutMigrationTest-332909555 None] Lock "cinder-aaa31fbe-913c-432e-b434-c50a909e1b33-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:07:21 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-766a1a6e-9fb9-456e-945c-c433e0403f33 tempest-VolumeRetypeWithoutMigrationTest-332909555 None] Acquiring lock "cinder-quobyte-aaa31fbe-913c-432e-b434-c50a909e1b33" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:07:21 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-766a1a6e-9fb9-456e-945c-c433e0403f33 tempest-VolumeRetypeWithoutMigrationTest-332909555 None] Lock "cinder-quobyte-aaa31fbe-913c-432e-b434-c50a909e1b33" acquired by "delete_volume" :: waited 0.018s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:07:21 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf7f1d6-a93e-4844-a43c-cd3454d1de0d]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:07:21 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-766a1a6e-9fb9-456e-945c-c433e0403f33 tempest-VolumeRetypeWithoutMigrationTest-332909555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-aaa31fbe-913c-432e-b434-c50a909e1b33 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:07:21 devstack sudo[103622]: pam_unix(sudo:session): session closed for user root Aug 10 16:07:21 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-8d295ad6-9f38-426c-b2be-6dd190d9bfc0 tempest-TestStampPattern-1573197444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4a4564b4-def3-447b-98ae-a4fa16c5d222,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4a4564b4-def3-447b-98ae-a4fa16c5d222.1dbf7b09-5a0e-4111-a483-7ec2d267f2af 1G" returned: 0 in 0.522s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:07:21 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-8d295ad6-9f38-426c-b2be-6dd190d9bfc0 tempest-TestStampPattern-1573197444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a4564b4-def3-447b-98ae-a4fa16c5d222 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4a4564b4-def3-447b-98ae-a4fa16c5d222.1dbf7b09-5a0e-4111-a483-7ec2d267f2af {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:07:21 devstack sudo[103632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a4564b4-def3-447b-98ae-a4fa16c5d222 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4a4564b4-def3-447b-98ae-a4fa16c5d222.1dbf7b09-5a0e-4111-a483-7ec2d267f2af Aug 10 16:07:21 devstack sudo[103632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:07:21 devstack sudo[103630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-aaa31fbe-913c-432e-b434-c50a909e1b33 Aug 10 16:07:21 devstack sudo[103630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:07:21 devstack sudo[103632]: pam_unix(sudo:session): session closed for user root Aug 10 16:07:21 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-8d295ad6-9f38-426c-b2be-6dd190d9bfc0 tempest-TestStampPattern-1573197444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a4564b4-def3-447b-98ae-a4fa16c5d222 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4a4564b4-def3-447b-98ae-a4fa16c5d222.1dbf7b09-5a0e-4111-a483-7ec2d267f2af" returned: 0 in 0.346s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:07:21 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-8d295ad6-9f38-426c-b2be-6dd190d9bfc0 tempest-TestStampPattern-1573197444 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4a4564b4-def3-447b-98ae-a4fa16c5d222.1dbf7b09-5a0e-4111-a483-7ec2d267f2af is being set with open permissions: ugo+rw Aug 10 16:07:21 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-8d295ad6-9f38-426c-b2be-6dd190d9bfc0 tempest-TestStampPattern-1573197444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4a4564b4-def3-447b-98ae-a4fa16c5d222.1dbf7b09-5a0e-4111-a483-7ec2d267f2af {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:07:21 devstack sudo[103630]: pam_unix(sudo:session): session closed for user root Aug 10 16:07:21 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-766a1a6e-9fb9-456e-945c-c433e0403f33 tempest-VolumeRetypeWithoutMigrationTest-332909555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-aaa31fbe-913c-432e-b434-c50a909e1b33" returned: 0 in 0.390s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:07:21 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-766a1a6e-9fb9-456e-945c-c433e0403f33 tempest-VolumeRetypeWithoutMigrationTest-332909555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-aaa31fbe-913c-432e-b434-c50a909e1b33 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:07:21 devstack sudo[103641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4a4564b4-def3-447b-98ae-a4fa16c5d222.1dbf7b09-5a0e-4111-a483-7ec2d267f2af Aug 10 16:07:21 devstack sudo[103641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:07:21 devstack sudo[103642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-aaa31fbe-913c-432e-b434-c50a909e1b33 Aug 10 16:07:21 devstack sudo[103642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:07:21 devstack sudo[103641]: pam_unix(sudo:session): session closed for user root Aug 10 16:07:21 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-8d295ad6-9f38-426c-b2be-6dd190d9bfc0 tempest-TestStampPattern-1573197444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4a4564b4-def3-447b-98ae-a4fa16c5d222.1dbf7b09-5a0e-4111-a483-7ec2d267f2af" returned: 0 in 0.272s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:07:22 devstack sudo[103642]: pam_unix(sudo:session): session closed for user root Aug 10 16:07:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-766a1a6e-9fb9-456e-945c-c433e0403f33 tempest-VolumeRetypeWithoutMigrationTest-332909555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-aaa31fbe-913c-432e-b434-c50a909e1b33" returned: 0 in 0.286s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:07:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-8d295ad6-9f38-426c-b2be-6dd190d9bfc0 tempest-TestStampPattern-1573197444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4a4564b4-def3-447b-98ae-a4fa16c5d222.info {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:07:22 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-766a1a6e-9fb9-456e-945c-c433e0403f33 tempest-VolumeRetypeWithoutMigrationTest-332909555 None] Lock "cinder-quobyte-aaa31fbe-913c-432e-b434-c50a909e1b33" released by "delete_volume" :: held 0.738s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:07:22 devstack sudo[103647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4a4564b4-def3-447b-98ae-a4fa16c5d222.info Aug 10 16:07:22 devstack sudo[103647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:07:22 devstack cinder-volume[88641]: WARNING cinder.quota [None req-766a1a6e-9fb9-456e-945c-c433e0403f33 tempest-VolumeRetypeWithoutMigrationTest-332909555 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Aug 10 16:07:22 devstack cinder-volume[88641]: WARNING cinder.quota [None req-766a1a6e-9fb9-456e-945c-c433e0403f33 tempest-VolumeRetypeWithoutMigrationTest-332909555 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Aug 10 16:07:22 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-766a1a6e-9fb9-456e-945c-c433e0403f33 tempest-VolumeRetypeWithoutMigrationTest-332909555 None] Created reservations ['106fdf7f-f7e6-4029-8414-361b21d2e408', '5876e1f0-a234-463f-b776-17ebeaf97045', '0e4fff8c-7a97-4415-a34f-4126f600b8aa', '8e1131a2-a52f-4a84-860b-72967676e9db'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:07:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-766a1a6e-9fb9-456e-945c-c433e0403f33 tempest-VolumeRetypeWithoutMigrationTest-332909555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:07:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-766a1a6e-9fb9-456e-945c-c433e0403f33 tempest-VolumeRetypeWithoutMigrationTest-332909555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:07:22 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-766a1a6e-9fb9-456e-945c-c433e0403f33 tempest-VolumeRetypeWithoutMigrationTest-332909555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:07:22 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-766a1a6e-9fb9-456e-945c-c433e0403f33 tempest-VolumeRetypeWithoutMigrationTest-332909555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:07:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-766a1a6e-9fb9-456e-945c-c433e0403f33 tempest-VolumeRetypeWithoutMigrationTest-332909555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:07:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-766a1a6e-9fb9-456e-945c-c433e0403f33 tempest-VolumeRetypeWithoutMigrationTest-332909555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:07:22 devstack sudo[103650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:07:22 devstack sudo[103650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:07:22 devstack sudo[103647]: pam_unix(sudo:session): session closed for user root Aug 10 16:07:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-8d295ad6-9f38-426c-b2be-6dd190d9bfc0 tempest-TestStampPattern-1573197444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4a4564b4-def3-447b-98ae-a4fa16c5d222.info" returned: 0 in 0.336s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:07:22 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-8d295ad6-9f38-426c-b2be-6dd190d9bfc0 tempest-TestStampPattern-1573197444 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4a4564b4-def3-447b-98ae-a4fa16c5d222.info is being set with open permissions: ugo+rw Aug 10 16:07:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-8d295ad6-9f38-426c-b2be-6dd190d9bfc0 tempest-TestStampPattern-1573197444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4a4564b4-def3-447b-98ae-a4fa16c5d222.info {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:07:22 devstack sudo[103653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4a4564b4-def3-447b-98ae-a4fa16c5d222.info Aug 10 16:07:22 devstack sudo[103653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:07:22 devstack sudo[103650]: pam_unix(sudo:session): session closed for user root Aug 10 16:07:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-766a1a6e-9fb9-456e-945c-c433e0403f33 tempest-VolumeRetypeWithoutMigrationTest-332909555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.297s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:07:22 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-766a1a6e-9fb9-456e-945c-c433e0403f33 tempest-VolumeRetypeWithoutMigrationTest-332909555 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:07:22 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-766a1a6e-9fb9-456e-945c-c433e0403f33 tempest-VolumeRetypeWithoutMigrationTest-332909555 None] Deleted volume successfully. Aug 10 16:07:22 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-766a1a6e-9fb9-456e-945c-c433e0403f33 tempest-VolumeRetypeWithoutMigrationTest-332909555 None] Lock "cinder-aaa31fbe-913c-432e-b434-c50a909e1b33-delete_volume" released by "delete_volume" :: held 1.298s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:07:22 devstack sudo[103653]: pam_unix(sudo:session): session closed for user root Aug 10 16:07:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-8d295ad6-9f38-426c-b2be-6dd190d9bfc0 tempest-TestStampPattern-1573197444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4a4564b4-def3-447b-98ae-a4fa16c5d222.info" returned: 0 in 0.337s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:07:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-8d295ad6-9f38-426c-b2be-6dd190d9bfc0 tempest-TestStampPattern-1573197444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.324s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:07:22 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-8d295ad6-9f38-426c-b2be-6dd190d9bfc0 tempest-TestStampPattern-1573197444 None] Create snapshot completed successfully Aug 10 16:07:28 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ae44278-6e9b-4a9a-8bb0-8116b1c31dfb tempest-VolumesListAdminTestJSON-1662895768 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:07:28 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-4ae44278-6e9b-4a9a-8bb0-8116b1c31dfb tempest-VolumesListAdminTestJSON-1662895768 None] Flow 'volume_create_manager' (4c70b0c8-2eab-477f-8017-5a520b10c2e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:07:28 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-4ae44278-6e9b-4a9a-8bb0-8116b1c31dfb tempest-VolumesListAdminTestJSON-1662895768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78bdb9a0-1663-457a-a6d7-24182bdc757a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:07:28 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-4ae44278-6e9b-4a9a-8bb0-8116b1c31dfb tempest-VolumesListAdminTestJSON-1662895768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78bdb9a0-1663-457a-a6d7-24182bdc757a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:07:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-750281370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23c691fe-8995-49be-a4fd-218051809a4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b876661a5bfb4051b747f9b77d3f2b8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:07:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:07:28Z,use_quota=True,user_id='1ffefe5ee82e4e61bbfc2923c76d1d9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:07:28 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-4ae44278-6e9b-4a9a-8bb0-8116b1c31dfb tempest-VolumesListAdminTestJSON-1662895768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8decb0f2-e434-46ea-9237-bccecf6297e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:07:28 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-4ae44278-6e9b-4a9a-8bb0-8116b1c31dfb tempest-VolumesListAdminTestJSON-1662895768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8decb0f2-e434-46ea-9237-bccecf6297e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:07:28 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-4ae44278-6e9b-4a9a-8bb0-8116b1c31dfb tempest-VolumesListAdminTestJSON-1662895768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a720fb9-07ff-4715-8f28-872bd2ea5a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:07:28 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-4ae44278-6e9b-4a9a-8bb0-8116b1c31dfb tempest-VolumesListAdminTestJSON-1662895768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a720fb9-07ff-4715-8f28-872bd2ea5a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23c691fe-8995-49be-a4fd-218051809a4b', 'volume_name': 'volume-23c691fe-8995-49be-a4fd-218051809a4b', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:07:28 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-4ae44278-6e9b-4a9a-8bb0-8116b1c31dfb tempest-VolumesListAdminTestJSON-1662895768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f525bad-38eb-46df-b49f-1279bdad397e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:07:28 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-4ae44278-6e9b-4a9a-8bb0-8116b1c31dfb tempest-VolumesListAdminTestJSON-1662895768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f525bad-38eb-46df-b49f-1279bdad397e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:07:28 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-4ae44278-6e9b-4a9a-8bb0-8116b1c31dfb tempest-VolumesListAdminTestJSON-1662895768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9687a2e5-bdde-40d8-8037-24e776b59080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:07:28 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-4ae44278-6e9b-4a9a-8bb0-8116b1c31dfb tempest-VolumesListAdminTestJSON-1662895768 None] Volume 23c691fe-8995-49be-a4fd-218051809a4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23c691fe-8995-49be-a4fd-218051809a4b', 'volume_size': 1} Aug 10 16:07:28 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-4ae44278-6e9b-4a9a-8bb0-8116b1c31dfb tempest-VolumesListAdminTestJSON-1662895768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:07:28 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-4ae44278-6e9b-4a9a-8bb0-8116b1c31dfb tempest-VolumesListAdminTestJSON-1662895768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:07:28 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-4ae44278-6e9b-4a9a-8bb0-8116b1c31dfb tempest-VolumesListAdminTestJSON-1662895768 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:07:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-750281370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23c691fe-8995-49be-a4fd-218051809a4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b876661a5bfb4051b747f9b77d3f2b8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:07:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:07:28Z,use_quota=True,user_id='1ffefe5ee82e4e61bbfc2923c76d1d9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:07:28 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-4ae44278-6e9b-4a9a-8bb0-8116b1c31dfb tempest-VolumesListAdminTestJSON-1662895768 None] Creating volume 23c691fe-8995-49be-a4fd-218051809a4b {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:07:28 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-4ae44278-6e9b-4a9a-8bb0-8116b1c31dfb tempest-VolumesListAdminTestJSON-1662895768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:07:28 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-4ae44278-6e9b-4a9a-8bb0-8116b1c31dfb tempest-VolumesListAdminTestJSON-1662895768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:07:28 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-4ae44278-6e9b-4a9a-8bb0-8116b1c31dfb tempest-VolumesListAdminTestJSON-1662895768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:07:28 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-4ae44278-6e9b-4a9a-8bb0-8116b1c31dfb tempest-VolumesListAdminTestJSON-1662895768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:07:28 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-4ae44278-6e9b-4a9a-8bb0-8116b1c31dfb tempest-VolumesListAdminTestJSON-1662895768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:07:28 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-4ae44278-6e9b-4a9a-8bb0-8116b1c31dfb tempest-VolumesListAdminTestJSON-1662895768 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:07:28 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-4ae44278-6e9b-4a9a-8bb0-8116b1c31dfb tempest-VolumesListAdminTestJSON-1662895768 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:07:28 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4ae44278-6e9b-4a9a-8bb0-8116b1c31dfb tempest-VolumesListAdminTestJSON-1662895768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-23c691fe-8995-49be-a4fd-218051809a4b 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:07:28 devstack sudo[103688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-23c691fe-8995-49be-a4fd-218051809a4b 1073741824 Aug 10 16:07:28 devstack sudo[103688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:07:28 devstack sudo[103688]: pam_unix(sudo:session): session closed for user root Aug 10 16:07:28 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4ae44278-6e9b-4a9a-8bb0-8116b1c31dfb tempest-VolumesListAdminTestJSON-1662895768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-23c691fe-8995-49be-a4fd-218051809a4b 1073741824" returned: 0 in 0.536s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:07:28 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4ae44278-6e9b-4a9a-8bb0-8116b1c31dfb tempest-VolumesListAdminTestJSON-1662895768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-23c691fe-8995-49be-a4fd-218051809a4b {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:07:28 devstack sudo[103694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-23c691fe-8995-49be-a4fd-218051809a4b Aug 10 16:07:28 devstack sudo[103694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:07:29 devstack sudo[103694]: pam_unix(sudo:session): session closed for user root Aug 10 16:07:29 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4ae44278-6e9b-4a9a-8bb0-8116b1c31dfb tempest-VolumesListAdminTestJSON-1662895768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-23c691fe-8995-49be-a4fd-218051809a4b" returned: 0 in 0.270s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:07:29 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-4ae44278-6e9b-4a9a-8bb0-8116b1c31dfb tempest-VolumesListAdminTestJSON-1662895768 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:07:29 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-4ae44278-6e9b-4a9a-8bb0-8116b1c31dfb tempest-VolumesListAdminTestJSON-1662895768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:07:29 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-4ae44278-6e9b-4a9a-8bb0-8116b1c31dfb tempest-VolumesListAdminTestJSON-1662895768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9687a2e5-bdde-40d8-8037-24e776b59080) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23c691fe-8995-49be-a4fd-218051809a4b', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:07:29 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-4ae44278-6e9b-4a9a-8bb0-8116b1c31dfb tempest-VolumesListAdminTestJSON-1662895768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92b78f4e-f10c-4a6c-85da-c412ea4c2beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:07:29 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-4ae44278-6e9b-4a9a-8bb0-8116b1c31dfb tempest-VolumesListAdminTestJSON-1662895768 None] Volume volume-23c691fe-8995-49be-a4fd-218051809a4b (23c691fe-8995-49be-a4fd-218051809a4b): created successfully Aug 10 16:07:29 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-4ae44278-6e9b-4a9a-8bb0-8116b1c31dfb tempest-VolumesListAdminTestJSON-1662895768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92b78f4e-f10c-4a6c-85da-c412ea4c2beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:07:29 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-4ae44278-6e9b-4a9a-8bb0-8116b1c31dfb tempest-VolumesListAdminTestJSON-1662895768 None] Flow 'volume_create_manager' (4c70b0c8-2eab-477f-8017-5a520b10c2e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:07:29 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-4ae44278-6e9b-4a9a-8bb0-8116b1c31dfb tempest-VolumesListAdminTestJSON-1662895768 None] Created volume successfully. Aug 10 16:07:30 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae9f12b9-fc60-44e3-8aad-9bde47574263 tempest-VolumesListAdminTestJSON-1662895768 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:07:30 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-ae9f12b9-fc60-44e3-8aad-9bde47574263 tempest-VolumesListAdminTestJSON-1662895768 None] Flow 'volume_create_manager' (d9470968-eac2-4424-9aba-7229d0938a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:07:30 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-ae9f12b9-fc60-44e3-8aad-9bde47574263 tempest-VolumesListAdminTestJSON-1662895768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d273be33-5294-4349-8299-156aff416c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:07:30 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-ae9f12b9-fc60-44e3-8aad-9bde47574263 tempest-VolumesListAdminTestJSON-1662895768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d273be33-5294-4349-8299-156aff416c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-409832348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eb15e00-ff50-4b51-9923-45e71dcf1fd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b876661a5bfb4051b747f9b77d3f2b8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:07:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:07:31Z,use_quota=True,user_id='1ffefe5ee82e4e61bbfc2923c76d1d9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:07:30 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-ae9f12b9-fc60-44e3-8aad-9bde47574263 tempest-VolumesListAdminTestJSON-1662895768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d00fa54f-9d2c-4c3c-8202-e1a9c33c97ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:07:30 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-ae9f12b9-fc60-44e3-8aad-9bde47574263 tempest-VolumesListAdminTestJSON-1662895768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d00fa54f-9d2c-4c3c-8202-e1a9c33c97ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:07:31 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-ae9f12b9-fc60-44e3-8aad-9bde47574263 tempest-VolumesListAdminTestJSON-1662895768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4884ca22-ac74-4e4f-a29d-077c69a78954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:07:31 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-ae9f12b9-fc60-44e3-8aad-9bde47574263 tempest-VolumesListAdminTestJSON-1662895768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4884ca22-ac74-4e4f-a29d-077c69a78954) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2eb15e00-ff50-4b51-9923-45e71dcf1fd2', 'volume_name': 'volume-2eb15e00-ff50-4b51-9923-45e71dcf1fd2', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:07:31 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-ae9f12b9-fc60-44e3-8aad-9bde47574263 tempest-VolumesListAdminTestJSON-1662895768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abb57d04-f19c-4209-a415-712f545619bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:07:31 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-ae9f12b9-fc60-44e3-8aad-9bde47574263 tempest-VolumesListAdminTestJSON-1662895768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abb57d04-f19c-4209-a415-712f545619bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:07:31 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-ae9f12b9-fc60-44e3-8aad-9bde47574263 tempest-VolumesListAdminTestJSON-1662895768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f03cf8c4-6e0b-4d31-a474-a2a89fe96b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:07:31 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-ae9f12b9-fc60-44e3-8aad-9bde47574263 tempest-VolumesListAdminTestJSON-1662895768 None] Volume 2eb15e00-ff50-4b51-9923-45e71dcf1fd2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2eb15e00-ff50-4b51-9923-45e71dcf1fd2', 'volume_size': 1} Aug 10 16:07:31 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-ae9f12b9-fc60-44e3-8aad-9bde47574263 tempest-VolumesListAdminTestJSON-1662895768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:07:31 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-ae9f12b9-fc60-44e3-8aad-9bde47574263 tempest-VolumesListAdminTestJSON-1662895768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:07:31 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-ae9f12b9-fc60-44e3-8aad-9bde47574263 tempest-VolumesListAdminTestJSON-1662895768 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-409832348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eb15e00-ff50-4b51-9923-45e71dcf1fd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b876661a5bfb4051b747f9b77d3f2b8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:07:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:07:31Z,use_quota=True,user_id='1ffefe5ee82e4e61bbfc2923c76d1d9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:07:31 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-ae9f12b9-fc60-44e3-8aad-9bde47574263 tempest-VolumesListAdminTestJSON-1662895768 None] Creating volume 2eb15e00-ff50-4b51-9923-45e71dcf1fd2 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:07:31 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-ae9f12b9-fc60-44e3-8aad-9bde47574263 tempest-VolumesListAdminTestJSON-1662895768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:07:31 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-ae9f12b9-fc60-44e3-8aad-9bde47574263 tempest-VolumesListAdminTestJSON-1662895768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:07:31 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-ae9f12b9-fc60-44e3-8aad-9bde47574263 tempest-VolumesListAdminTestJSON-1662895768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:07:31 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-ae9f12b9-fc60-44e3-8aad-9bde47574263 tempest-VolumesListAdminTestJSON-1662895768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:07:31 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-ae9f12b9-fc60-44e3-8aad-9bde47574263 tempest-VolumesListAdminTestJSON-1662895768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:07:31 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-ae9f12b9-fc60-44e3-8aad-9bde47574263 tempest-VolumesListAdminTestJSON-1662895768 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:07:31 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-ae9f12b9-fc60-44e3-8aad-9bde47574263 tempest-VolumesListAdminTestJSON-1662895768 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:07:31 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ae9f12b9-fc60-44e3-8aad-9bde47574263 tempest-VolumesListAdminTestJSON-1662895768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2eb15e00-ff50-4b51-9923-45e71dcf1fd2 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:07:31 devstack sudo[103697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2eb15e00-ff50-4b51-9923-45e71dcf1fd2 1073741824 Aug 10 16:07:31 devstack sudo[103697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:07:31 devstack sudo[103697]: pam_unix(sudo:session): session closed for user root Aug 10 16:07:31 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ae9f12b9-fc60-44e3-8aad-9bde47574263 tempest-VolumesListAdminTestJSON-1662895768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2eb15e00-ff50-4b51-9923-45e71dcf1fd2 1073741824" returned: 0 in 0.567s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:07:31 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ae9f12b9-fc60-44e3-8aad-9bde47574263 tempest-VolumesListAdminTestJSON-1662895768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2eb15e00-ff50-4b51-9923-45e71dcf1fd2 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:07:31 devstack sudo[103704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2eb15e00-ff50-4b51-9923-45e71dcf1fd2 Aug 10 16:07:31 devstack sudo[103704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:07:31 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed84fe0a-6a7b-4114-8918-0f1eb811258f tempest-TestStampPattern-1573197444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:07:31 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-ed84fe0a-6a7b-4114-8918-0f1eb811258f tempest-TestStampPattern-1573197444 None] Flow 'volume_create_manager' (21b32754-7dba-433c-b4c3-e7a75b8bb56f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:07:31 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-ed84fe0a-6a7b-4114-8918-0f1eb811258f tempest-TestStampPattern-1573197444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a063482-a827-4f0b-9e90-cbef846828d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:07:31 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-ed84fe0a-6a7b-4114-8918-0f1eb811258f tempest-TestStampPattern-1573197444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a063482-a827-4f0b-9e90-cbef846828d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1023966658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d77e1b15-108f-44ee-a266-25ed0a947ab0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0d47507aa994b5a9fa6e185329cd7d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:07:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1dbf7b09-5a0e-4111-a483-7ec2d267f2af,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:07:32Z,use_quota=True,user_id='0f614f981bce4ec0845bc44f9e304e40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:07:31 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-ed84fe0a-6a7b-4114-8918-0f1eb811258f tempest-TestStampPattern-1573197444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb98c220-60e8-4d78-b297-0026d95e1666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:07:31 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-ed84fe0a-6a7b-4114-8918-0f1eb811258f tempest-TestStampPattern-1573197444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb98c220-60e8-4d78-b297-0026d95e1666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:07:31 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-ed84fe0a-6a7b-4114-8918-0f1eb811258f tempest-TestStampPattern-1573197444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4decc641-c12f-41e6-81d5-3cecb29f3058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:07:31 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-ed84fe0a-6a7b-4114-8918-0f1eb811258f tempest-TestStampPattern-1573197444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4decc641-c12f-41e6-81d5-3cecb29f3058) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd77e1b15-108f-44ee-a266-25ed0a947ab0', 'volume_name': 'volume-d77e1b15-108f-44ee-a266-25ed0a947ab0', 'volume_size': 1, 'snapshot_id': '1dbf7b09-5a0e-4111-a483-7ec2d267f2af'}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:07:31 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-ed84fe0a-6a7b-4114-8918-0f1eb811258f tempest-TestStampPattern-1573197444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4882aa60-830f-4fb0-98d8-5cd9f3bbd010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:07:31 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-ed84fe0a-6a7b-4114-8918-0f1eb811258f tempest-TestStampPattern-1573197444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4882aa60-830f-4fb0-98d8-5cd9f3bbd010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:07:31 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-ed84fe0a-6a7b-4114-8918-0f1eb811258f tempest-TestStampPattern-1573197444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbd60c40-b6f6-4522-ada2-a1ab2689cfab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:07:31 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-ed84fe0a-6a7b-4114-8918-0f1eb811258f tempest-TestStampPattern-1573197444 None] Volume d77e1b15-108f-44ee-a266-25ed0a947ab0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d77e1b15-108f-44ee-a266-25ed0a947ab0', 'volume_size': 1, 'snapshot_id': '1dbf7b09-5a0e-4111-a483-7ec2d267f2af'} Aug 10 16:07:31 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-ed84fe0a-6a7b-4114-8918-0f1eb811258f tempest-TestStampPattern-1573197444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:07:32 devstack sudo[103704]: pam_unix(sudo:session): session closed for user root Aug 10 16:07:32 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ae9f12b9-fc60-44e3-8aad-9bde47574263 tempest-VolumesListAdminTestJSON-1662895768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2eb15e00-ff50-4b51-9923-45e71dcf1fd2" returned: 0 in 0.382s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:07:32 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-ae9f12b9-fc60-44e3-8aad-9bde47574263 tempest-VolumesListAdminTestJSON-1662895768 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:07:32 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-ae9f12b9-fc60-44e3-8aad-9bde47574263 tempest-VolumesListAdminTestJSON-1662895768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:07:32 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-ed84fe0a-6a7b-4114-8918-0f1eb811258f tempest-TestStampPattern-1573197444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.159s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:07:32 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-ed84fe0a-6a7b-4114-8918-0f1eb811258f tempest-TestStampPattern-1573197444 None] Acquiring lock "cinder-quobyte-1dbf7b09-5a0e-4111-a483-7ec2d267f2af-d77e1b15-108f-44ee-a266-25ed0a947ab0" by "_create_volume_from_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:07:32 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-ae9f12b9-fc60-44e3-8aad-9bde47574263 tempest-VolumesListAdminTestJSON-1662895768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f03cf8c4-6e0b-4d31-a474-a2a89fe96b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2eb15e00-ff50-4b51-9923-45e71dcf1fd2', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:07:32 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-ae9f12b9-fc60-44e3-8aad-9bde47574263 tempest-VolumesListAdminTestJSON-1662895768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edfe3704-c08b-43a2-8422-d606f88a0f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:07:32 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-ed84fe0a-6a7b-4114-8918-0f1eb811258f tempest-TestStampPattern-1573197444 None] Lock "cinder-quobyte-1dbf7b09-5a0e-4111-a483-7ec2d267f2af-d77e1b15-108f-44ee-a266-25ed0a947ab0" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:07:32 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-ed84fe0a-6a7b-4114-8918-0f1eb811258f tempest-TestStampPattern-1573197444 None] Creating volume d77e1b15-108f-44ee-a266-25ed0a947ab0 from snapshot 1dbf7b09-5a0e-4111-a483-7ec2d267f2af {{(pid=88641) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 10 16:07:32 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-ed84fe0a-6a7b-4114-8918-0f1eb811258f tempest-TestStampPattern-1573197444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:07:32 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-ed84fe0a-6a7b-4114-8918-0f1eb811258f tempest-TestStampPattern-1573197444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:07:32 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-ed84fe0a-6a7b-4114-8918-0f1eb811258f tempest-TestStampPattern-1573197444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:07:32 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-ed84fe0a-6a7b-4114-8918-0f1eb811258f tempest-TestStampPattern-1573197444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:07:32 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-ed84fe0a-6a7b-4114-8918-0f1eb811258f tempest-TestStampPattern-1573197444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:07:32 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-ed84fe0a-6a7b-4114-8918-0f1eb811258f tempest-TestStampPattern-1573197444 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:07:32 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-ed84fe0a-6a7b-4114-8918-0f1eb811258f tempest-TestStampPattern-1573197444 None] Acquiring lock "cinder-quobyte-d77e1b15-108f-44ee-a266-25ed0a947ab0" by "_copy_volume_from_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:07:32 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-ae9f12b9-fc60-44e3-8aad-9bde47574263 tempest-VolumesListAdminTestJSON-1662895768 None] Volume volume-2eb15e00-ff50-4b51-9923-45e71dcf1fd2 (2eb15e00-ff50-4b51-9923-45e71dcf1fd2): created successfully Aug 10 16:07:32 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-ae9f12b9-fc60-44e3-8aad-9bde47574263 tempest-VolumesListAdminTestJSON-1662895768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edfe3704-c08b-43a2-8422-d606f88a0f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:07:32 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-ae9f12b9-fc60-44e3-8aad-9bde47574263 tempest-VolumesListAdminTestJSON-1662895768 None] Flow 'volume_create_manager' (d9470968-eac2-4424-9aba-7229d0938a01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:07:32 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-ed84fe0a-6a7b-4114-8918-0f1eb811258f tempest-TestStampPattern-1573197444 None] Lock "cinder-quobyte-d77e1b15-108f-44ee-a266-25ed0a947ab0" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:07:32 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-ed84fe0a-6a7b-4114-8918-0f1eb811258f tempest-TestStampPattern-1573197444 None] snapshot: 1dbf7b09-5a0e-4111-a483-7ec2d267f2af, volume: d77e1b15-108f-44ee-a266-25ed0a947ab0, {{(pid=88641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 10 16:07:32 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-ed84fe0a-6a7b-4114-8918-0f1eb811258f tempest-TestStampPattern-1573197444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:07:32 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-ed84fe0a-6a7b-4114-8918-0f1eb811258f tempest-TestStampPattern-1573197444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:07:32 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-ed84fe0a-6a7b-4114-8918-0f1eb811258f tempest-TestStampPattern-1573197444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:07:32 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-ed84fe0a-6a7b-4114-8918-0f1eb811258f tempest-TestStampPattern-1573197444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:07:32 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-ed84fe0a-6a7b-4114-8918-0f1eb811258f tempest-TestStampPattern-1573197444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:07:32 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-ae9f12b9-fc60-44e3-8aad-9bde47574263 tempest-VolumesListAdminTestJSON-1662895768 None] Created volume successfully. Aug 10 16:07:32 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[808ecbe2-2e61-469b-97d5-7f8ebf063ac2]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:07:32 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ed84fe0a-6a7b-4114-8918-0f1eb811258f tempest-TestStampPattern-1573197444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4a4564b4-def3-447b-98ae-a4fa16c5d222.1dbf7b09-5a0e-4111-a483-7ec2d267f2af {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:07:32 devstack sudo[103708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4a4564b4-def3-447b-98ae-a4fa16c5d222.1dbf7b09-5a0e-4111-a483-7ec2d267f2af Aug 10 16:07:32 devstack sudo[103708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:07:32 devstack sudo[103708]: pam_unix(sudo:session): session closed for user root Aug 10 16:07:32 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ed84fe0a-6a7b-4114-8918-0f1eb811258f tempest-TestStampPattern-1573197444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4a4564b4-def3-447b-98ae-a4fa16c5d222.1dbf7b09-5a0e-4111-a483-7ec2d267f2af" returned: 0 in 0.405s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:07:32 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-ed84fe0a-6a7b-4114-8918-0f1eb811258f tempest-TestStampPattern-1573197444 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a4564b4-def3-447b-98ae-a4fa16c5d222(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 16:07:32 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[650b9082-7069-413f-a9a4-2d114298d106]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:07:32 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ed84fe0a-6a7b-4114-8918-0f1eb811258f tempest-TestStampPattern-1573197444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4a4564b4-def3-447b-98ae-a4fa16c5d222 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:07:32 devstack sudo[103714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4a4564b4-def3-447b-98ae-a4fa16c5d222 Aug 10 16:07:32 devstack sudo[103714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:07:33 devstack sudo[103714]: pam_unix(sudo:session): session closed for user root Aug 10 16:07:33 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ed84fe0a-6a7b-4114-8918-0f1eb811258f tempest-TestStampPattern-1573197444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4a4564b4-def3-447b-98ae-a4fa16c5d222" returned: 0 in 0.498s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:07:33 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-ed84fe0a-6a7b-4114-8918-0f1eb811258f tempest-TestStampPattern-1573197444 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4a4564b4-def3-447b-98ae-a4fa16c5d222 {{(pid=88641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 10 16:07:33 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-ed84fe0a-6a7b-4114-8918-0f1eb811258f tempest-TestStampPattern-1573197444 None] Creating direct copy from snapshot {{(pid=88641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 10 16:07:33 devstack cinder-volume[88641]: DEBUG cinder.utils [None req-ed84fe0a-6a7b-4114-8918-0f1eb811258f tempest-TestStampPattern-1573197444 None] Path /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d77e1b15-108f-44ee-a266-25ed0a947ab0 not found in is_blk_device check {{(pid=88641) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 10 16:07:33 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ed84fe0a-6a7b-4114-8918-0f1eb811258f tempest-TestStampPattern-1573197444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4a4564b4-def3-447b-98ae-a4fa16c5d222 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d77e1b15-108f-44ee-a266-25ed0a947ab0 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:07:33 devstack sudo[103720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4a4564b4-def3-447b-98ae-a4fa16c5d222 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d77e1b15-108f-44ee-a266-25ed0a947ab0 Aug 10 16:07:33 devstack sudo[103720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:07:34 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-241d5c5a-f72b-4888-8ae2-3e2161d382e5 tempest-VolumesListAdminTestJSON-1662895768 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:07:34 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-241d5c5a-f72b-4888-8ae2-3e2161d382e5 tempest-VolumesListAdminTestJSON-1662895768 None] Flow 'volume_create_manager' (b1920f04-5132-4ce3-b7e8-0652e6af1eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:07:34 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-241d5c5a-f72b-4888-8ae2-3e2161d382e5 tempest-VolumesListAdminTestJSON-1662895768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db8595f6-1013-4c0a-9584-add75d6bc7a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:07:34 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-241d5c5a-f72b-4888-8ae2-3e2161d382e5 tempest-VolumesListAdminTestJSON-1662895768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db8595f6-1013-4c0a-9584-add75d6bc7a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:07:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-715298976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d869b2dc-fab6-4234-8bbb-e2ff7c6c3ebe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b876661a5bfb4051b747f9b77d3f2b8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:07:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:07:34Z,use_quota=True,user_id='1ffefe5ee82e4e61bbfc2923c76d1d9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:07:34 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-241d5c5a-f72b-4888-8ae2-3e2161d382e5 tempest-VolumesListAdminTestJSON-1662895768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84a4cd4e-43af-4a16-9905-6cfe48ef5c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:07:34 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-241d5c5a-f72b-4888-8ae2-3e2161d382e5 tempest-VolumesListAdminTestJSON-1662895768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84a4cd4e-43af-4a16-9905-6cfe48ef5c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:07:34 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-241d5c5a-f72b-4888-8ae2-3e2161d382e5 tempest-VolumesListAdminTestJSON-1662895768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8879937-e3de-4895-8944-0e331f32b59d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:07:35 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-241d5c5a-f72b-4888-8ae2-3e2161d382e5 tempest-VolumesListAdminTestJSON-1662895768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8879937-e3de-4895-8944-0e331f32b59d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd869b2dc-fab6-4234-8bbb-e2ff7c6c3ebe', 'volume_name': 'volume-d869b2dc-fab6-4234-8bbb-e2ff7c6c3ebe', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:07:35 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-241d5c5a-f72b-4888-8ae2-3e2161d382e5 tempest-VolumesListAdminTestJSON-1662895768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1070f9ba-e81a-4923-b719-ac56740a1200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:07:35 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-241d5c5a-f72b-4888-8ae2-3e2161d382e5 tempest-VolumesListAdminTestJSON-1662895768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1070f9ba-e81a-4923-b719-ac56740a1200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:07:35 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-241d5c5a-f72b-4888-8ae2-3e2161d382e5 tempest-VolumesListAdminTestJSON-1662895768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3347d9c0-6efb-458e-8e1d-d2e236cabdb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:07:35 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-241d5c5a-f72b-4888-8ae2-3e2161d382e5 tempest-VolumesListAdminTestJSON-1662895768 None] Volume d869b2dc-fab6-4234-8bbb-e2ff7c6c3ebe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d869b2dc-fab6-4234-8bbb-e2ff7c6c3ebe', 'volume_size': 1} Aug 10 16:07:35 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-241d5c5a-f72b-4888-8ae2-3e2161d382e5 tempest-VolumesListAdminTestJSON-1662895768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:07:36 devstack cinder-volume[88641]: DEBUG oslo_service.periodic_task [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88641) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 16:07:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:07:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:07:36 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:07:36 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:07:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:07:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:07:36 devstack sudo[103745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:07:36 devstack sudo[103745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:07:37 devstack sudo[103745]: pam_unix(sudo:session): session closed for user root Aug 10 16:07:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.932s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:07:37 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:07:37 devstack cinder-volume[88641]: DEBUG oslo_service.periodic_task [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Running periodic task VolumeManager._thread_info {{(pid=88641) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 16:07:37 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] thread count: 28 {{(pid=88641) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 10 16:07:37 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] thread info: [<_MainThread(MainThread, started 127361545748608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88641) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 10 16:07:40 devstack sudo[103720]: pam_unix(sudo:session): session closed for user root Aug 10 16:07:40 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ed84fe0a-6a7b-4114-8918-0f1eb811258f tempest-TestStampPattern-1573197444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4a4564b4-def3-447b-98ae-a4fa16c5d222 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d77e1b15-108f-44ee-a266-25ed0a947ab0" returned: 0 in 6.926s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:07:40 devstack cinder-volume[88641]: DEBUG cinder.image.image_utils [None req-ed84fe0a-6a7b-4114-8918-0f1eb811258f tempest-TestStampPattern-1573197444 None] Image conversion details: src /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4a4564b4-def3-447b-98ae-a4fa16c5d222, size 1024.00 MB, duration 6.93 sec, destination /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d77e1b15-108f-44ee-a266-25ed0a947ab0 {{(pid=88641) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 10 16:07:40 devstack cinder-volume[88641]: INFO cinder.image.image_utils [None req-ed84fe0a-6a7b-4114-8918-0f1eb811258f tempest-TestStampPattern-1573197444 None] Converted 1024.00 MB image at 147.82 MB/s Aug 10 16:07:40 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-ed84fe0a-6a7b-4114-8918-0f1eb811258f tempest-TestStampPattern-1573197444 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d77e1b15-108f-44ee-a266-25ed0a947ab0 is being set with open permissions: ugo+rw Aug 10 16:07:40 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ed84fe0a-6a7b-4114-8918-0f1eb811258f tempest-TestStampPattern-1573197444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d77e1b15-108f-44ee-a266-25ed0a947ab0 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:07:40 devstack sudo[103748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d77e1b15-108f-44ee-a266-25ed0a947ab0 Aug 10 16:07:40 devstack sudo[103748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:07:40 devstack sudo[103748]: pam_unix(sudo:session): session closed for user root Aug 10 16:07:40 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ed84fe0a-6a7b-4114-8918-0f1eb811258f tempest-TestStampPattern-1573197444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d77e1b15-108f-44ee-a266-25ed0a947ab0" returned: 0 in 0.438s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:07:40 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-ed84fe0a-6a7b-4114-8918-0f1eb811258f tempest-TestStampPattern-1573197444 None] Lock "cinder-quobyte-d77e1b15-108f-44ee-a266-25ed0a947ab0" released by "_copy_volume_from_snapshot" :: held 8.373s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:07:40 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-ed84fe0a-6a7b-4114-8918-0f1eb811258f tempest-TestStampPattern-1573197444 None] Lock "cinder-quobyte-1dbf7b09-5a0e-4111-a483-7ec2d267f2af-d77e1b15-108f-44ee-a266-25ed0a947ab0" released by "_create_volume_from_snapshot" :: held 8.475s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:07:40 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-ed84fe0a-6a7b-4114-8918-0f1eb811258f tempest-TestStampPattern-1573197444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.513s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:07:40 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-241d5c5a-f72b-4888-8ae2-3e2161d382e5 tempest-VolumesListAdminTestJSON-1662895768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.464s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:07:40 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-241d5c5a-f72b-4888-8ae2-3e2161d382e5 tempest-VolumesListAdminTestJSON-1662895768 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:07:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-715298976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d869b2dc-fab6-4234-8bbb-e2ff7c6c3ebe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b876661a5bfb4051b747f9b77d3f2b8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:07:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:07:34Z,use_quota=True,user_id='1ffefe5ee82e4e61bbfc2923c76d1d9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:07:40 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-241d5c5a-f72b-4888-8ae2-3e2161d382e5 tempest-VolumesListAdminTestJSON-1662895768 None] Creating volume d869b2dc-fab6-4234-8bbb-e2ff7c6c3ebe {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:07:40 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-241d5c5a-f72b-4888-8ae2-3e2161d382e5 tempest-VolumesListAdminTestJSON-1662895768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:07:40 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-241d5c5a-f72b-4888-8ae2-3e2161d382e5 tempest-VolumesListAdminTestJSON-1662895768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:07:40 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-241d5c5a-f72b-4888-8ae2-3e2161d382e5 tempest-VolumesListAdminTestJSON-1662895768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:07:40 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-241d5c5a-f72b-4888-8ae2-3e2161d382e5 tempest-VolumesListAdminTestJSON-1662895768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:07:40 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-241d5c5a-f72b-4888-8ae2-3e2161d382e5 tempest-VolumesListAdminTestJSON-1662895768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:07:40 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-241d5c5a-f72b-4888-8ae2-3e2161d382e5 tempest-VolumesListAdminTestJSON-1662895768 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:07:40 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-241d5c5a-f72b-4888-8ae2-3e2161d382e5 tempest-VolumesListAdminTestJSON-1662895768 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:07:40 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-241d5c5a-f72b-4888-8ae2-3e2161d382e5 tempest-VolumesListAdminTestJSON-1662895768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d869b2dc-fab6-4234-8bbb-e2ff7c6c3ebe 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:07:40 devstack sudo[103751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d869b2dc-fab6-4234-8bbb-e2ff7c6c3ebe 1073741824 Aug 10 16:07:40 devstack sudo[103751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:07:40 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-ed84fe0a-6a7b-4114-8918-0f1eb811258f tempest-TestStampPattern-1573197444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbd60c40-b6f6-4522-ada2-a1ab2689cfab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d77e1b15-108f-44ee-a266-25ed0a947ab0', 'volume_size': 1, 'snapshot_id': '1dbf7b09-5a0e-4111-a483-7ec2d267f2af'}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:07:40 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-ed84fe0a-6a7b-4114-8918-0f1eb811258f tempest-TestStampPattern-1573197444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6ed55d7-e656-4eb5-b9ef-e8826c7c2ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:07:40 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-ed84fe0a-6a7b-4114-8918-0f1eb811258f tempest-TestStampPattern-1573197444 None] Volume volume-d77e1b15-108f-44ee-a266-25ed0a947ab0 (d77e1b15-108f-44ee-a266-25ed0a947ab0): created successfully Aug 10 16:07:40 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-ed84fe0a-6a7b-4114-8918-0f1eb811258f tempest-TestStampPattern-1573197444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6ed55d7-e656-4eb5-b9ef-e8826c7c2ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:07:40 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-ed84fe0a-6a7b-4114-8918-0f1eb811258f tempest-TestStampPattern-1573197444 None] Flow 'volume_create_manager' (21b32754-7dba-433c-b4c3-e7a75b8bb56f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:07:40 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-ed84fe0a-6a7b-4114-8918-0f1eb811258f tempest-TestStampPattern-1573197444 None] Created volume successfully. Aug 10 16:07:41 devstack sudo[103751]: pam_unix(sudo:session): session closed for user root Aug 10 16:07:41 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-241d5c5a-f72b-4888-8ae2-3e2161d382e5 tempest-VolumesListAdminTestJSON-1662895768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d869b2dc-fab6-4234-8bbb-e2ff7c6c3ebe 1073741824" returned: 0 in 0.593s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:07:41 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-241d5c5a-f72b-4888-8ae2-3e2161d382e5 tempest-VolumesListAdminTestJSON-1662895768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d869b2dc-fab6-4234-8bbb-e2ff7c6c3ebe {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:07:41 devstack sudo[103770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d869b2dc-fab6-4234-8bbb-e2ff7c6c3ebe Aug 10 16:07:41 devstack sudo[103770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:07:41 devstack sudo[103770]: pam_unix(sudo:session): session closed for user root Aug 10 16:07:41 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-241d5c5a-f72b-4888-8ae2-3e2161d382e5 tempest-VolumesListAdminTestJSON-1662895768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d869b2dc-fab6-4234-8bbb-e2ff7c6c3ebe" returned: 0 in 0.315s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:07:41 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-241d5c5a-f72b-4888-8ae2-3e2161d382e5 tempest-VolumesListAdminTestJSON-1662895768 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:07:41 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-241d5c5a-f72b-4888-8ae2-3e2161d382e5 tempest-VolumesListAdminTestJSON-1662895768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:07:41 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-241d5c5a-f72b-4888-8ae2-3e2161d382e5 tempest-VolumesListAdminTestJSON-1662895768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3347d9c0-6efb-458e-8e1d-d2e236cabdb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d869b2dc-fab6-4234-8bbb-e2ff7c6c3ebe', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:07:41 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-241d5c5a-f72b-4888-8ae2-3e2161d382e5 tempest-VolumesListAdminTestJSON-1662895768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dec0289-de18-4653-9985-988546e7d241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:07:41 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-241d5c5a-f72b-4888-8ae2-3e2161d382e5 tempest-VolumesListAdminTestJSON-1662895768 None] Volume volume-d869b2dc-fab6-4234-8bbb-e2ff7c6c3ebe (d869b2dc-fab6-4234-8bbb-e2ff7c6c3ebe): created successfully Aug 10 16:07:41 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-241d5c5a-f72b-4888-8ae2-3e2161d382e5 tempest-VolumesListAdminTestJSON-1662895768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dec0289-de18-4653-9985-988546e7d241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:07:41 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-241d5c5a-f72b-4888-8ae2-3e2161d382e5 tempest-VolumesListAdminTestJSON-1662895768 None] Flow 'volume_create_manager' (b1920f04-5132-4ce3-b7e8-0652e6af1eaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:07:41 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-241d5c5a-f72b-4888-8ae2-3e2161d382e5 tempest-VolumesListAdminTestJSON-1662895768 None] Created volume successfully. Aug 10 16:07:43 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d663260-e115-4e15-90e7-c01e2da80f7e tempest-VolumesListAdminTestJSON-777469807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:07:43 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2d663260-e115-4e15-90e7-c01e2da80f7e tempest-VolumesListAdminTestJSON-777469807 None] Flow 'volume_create_manager' (ee6c113c-3a50-472f-b1c8-de9cd5ee1a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:07:43 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2d663260-e115-4e15-90e7-c01e2da80f7e tempest-VolumesListAdminTestJSON-777469807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd067314-a549-49d7-a280-7f3124207c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:07:43 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2d663260-e115-4e15-90e7-c01e2da80f7e tempest-VolumesListAdminTestJSON-777469807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd067314-a549-49d7-a280-7f3124207c7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:07:43Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82234568-3fe1-4bf9-9e8a-57f1bbec2ae4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25dcfa8d23b6402f88b82a9e3bf4e749',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:07:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:07:43Z,use_quota=True,user_id='d3e7eb7b524b4060812b01b04238eb78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:07:43 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2d663260-e115-4e15-90e7-c01e2da80f7e tempest-VolumesListAdminTestJSON-777469807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76eff4f3-34c8-4092-89c1-89d3d064657c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:07:43 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2d663260-e115-4e15-90e7-c01e2da80f7e tempest-VolumesListAdminTestJSON-777469807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76eff4f3-34c8-4092-89c1-89d3d064657c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:07:43 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2d663260-e115-4e15-90e7-c01e2da80f7e tempest-VolumesListAdminTestJSON-777469807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e875876d-10ca-4747-9bec-affb24e0b9b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:07:43 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2d663260-e115-4e15-90e7-c01e2da80f7e tempest-VolumesListAdminTestJSON-777469807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e875876d-10ca-4747-9bec-affb24e0b9b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82234568-3fe1-4bf9-9e8a-57f1bbec2ae4', 'volume_name': 'volume-82234568-3fe1-4bf9-9e8a-57f1bbec2ae4', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:07:43 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2d663260-e115-4e15-90e7-c01e2da80f7e tempest-VolumesListAdminTestJSON-777469807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab54d5e3-5f22-4fd0-8c89-85e3bd935213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:07:43 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2d663260-e115-4e15-90e7-c01e2da80f7e tempest-VolumesListAdminTestJSON-777469807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab54d5e3-5f22-4fd0-8c89-85e3bd935213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:07:43 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2d663260-e115-4e15-90e7-c01e2da80f7e tempest-VolumesListAdminTestJSON-777469807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b17c040-0dae-463e-8c15-5034739a5814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:07:43 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-2d663260-e115-4e15-90e7-c01e2da80f7e tempest-VolumesListAdminTestJSON-777469807 None] Volume 82234568-3fe1-4bf9-9e8a-57f1bbec2ae4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82234568-3fe1-4bf9-9e8a-57f1bbec2ae4', 'volume_size': 1} Aug 10 16:07:43 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-2d663260-e115-4e15-90e7-c01e2da80f7e tempest-VolumesListAdminTestJSON-777469807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:07:43 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-2d663260-e115-4e15-90e7-c01e2da80f7e tempest-VolumesListAdminTestJSON-777469807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:07:43 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-2d663260-e115-4e15-90e7-c01e2da80f7e tempest-VolumesListAdminTestJSON-777469807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:07:43Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82234568-3fe1-4bf9-9e8a-57f1bbec2ae4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25dcfa8d23b6402f88b82a9e3bf4e749',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:07:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:07:43Z,use_quota=True,user_id='d3e7eb7b524b4060812b01b04238eb78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:07:43 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-2d663260-e115-4e15-90e7-c01e2da80f7e tempest-VolumesListAdminTestJSON-777469807 None] Creating volume 82234568-3fe1-4bf9-9e8a-57f1bbec2ae4 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:07:43 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-2d663260-e115-4e15-90e7-c01e2da80f7e tempest-VolumesListAdminTestJSON-777469807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:07:43 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-2d663260-e115-4e15-90e7-c01e2da80f7e tempest-VolumesListAdminTestJSON-777469807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:07:43 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-2d663260-e115-4e15-90e7-c01e2da80f7e tempest-VolumesListAdminTestJSON-777469807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:07:43 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-2d663260-e115-4e15-90e7-c01e2da80f7e tempest-VolumesListAdminTestJSON-777469807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:07:43 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-2d663260-e115-4e15-90e7-c01e2da80f7e tempest-VolumesListAdminTestJSON-777469807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:07:43 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-2d663260-e115-4e15-90e7-c01e2da80f7e tempest-VolumesListAdminTestJSON-777469807 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:07:43 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-2d663260-e115-4e15-90e7-c01e2da80f7e tempest-VolumesListAdminTestJSON-777469807 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:07:43 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-2d663260-e115-4e15-90e7-c01e2da80f7e tempest-VolumesListAdminTestJSON-777469807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-82234568-3fe1-4bf9-9e8a-57f1bbec2ae4 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:07:43 devstack sudo[103822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-82234568-3fe1-4bf9-9e8a-57f1bbec2ae4 1073741824 Aug 10 16:07:43 devstack sudo[103822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:07:44 devstack sudo[103822]: pam_unix(sudo:session): session closed for user root Aug 10 16:07:44 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-2d663260-e115-4e15-90e7-c01e2da80f7e tempest-VolumesListAdminTestJSON-777469807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-82234568-3fe1-4bf9-9e8a-57f1bbec2ae4 1073741824" returned: 0 in 0.705s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:07:44 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-2d663260-e115-4e15-90e7-c01e2da80f7e tempest-VolumesListAdminTestJSON-777469807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-82234568-3fe1-4bf9-9e8a-57f1bbec2ae4 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:07:44 devstack sudo[103852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-82234568-3fe1-4bf9-9e8a-57f1bbec2ae4 Aug 10 16:07:44 devstack sudo[103852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:07:44 devstack sudo[103852]: pam_unix(sudo:session): session closed for user root Aug 10 16:07:44 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-2d663260-e115-4e15-90e7-c01e2da80f7e tempest-VolumesListAdminTestJSON-777469807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-82234568-3fe1-4bf9-9e8a-57f1bbec2ae4" returned: 0 in 0.386s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:07:44 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-2d663260-e115-4e15-90e7-c01e2da80f7e tempest-VolumesListAdminTestJSON-777469807 None] <== create_volume: return (1195ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:07:44 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-2d663260-e115-4e15-90e7-c01e2da80f7e tempest-VolumesListAdminTestJSON-777469807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.198s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:07:44 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2d663260-e115-4e15-90e7-c01e2da80f7e tempest-VolumesListAdminTestJSON-777469807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b17c040-0dae-463e-8c15-5034739a5814) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82234568-3fe1-4bf9-9e8a-57f1bbec2ae4', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:07:44 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2d663260-e115-4e15-90e7-c01e2da80f7e tempest-VolumesListAdminTestJSON-777469807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3e1e4cd-3917-41fe-9cbd-5fd58ccd2bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:07:44 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-2d663260-e115-4e15-90e7-c01e2da80f7e tempest-VolumesListAdminTestJSON-777469807 None] Volume volume-82234568-3fe1-4bf9-9e8a-57f1bbec2ae4 (82234568-3fe1-4bf9-9e8a-57f1bbec2ae4): created successfully Aug 10 16:07:44 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2d663260-e115-4e15-90e7-c01e2da80f7e tempest-VolumesListAdminTestJSON-777469807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3e1e4cd-3917-41fe-9cbd-5fd58ccd2bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:07:44 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2d663260-e115-4e15-90e7-c01e2da80f7e tempest-VolumesListAdminTestJSON-777469807 None] Flow 'volume_create_manager' (ee6c113c-3a50-472f-b1c8-de9cd5ee1a6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:07:44 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-2d663260-e115-4e15-90e7-c01e2da80f7e tempest-VolumesListAdminTestJSON-777469807 None] Created volume successfully. Aug 10 16:07:45 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-5294915a-0e8e-49ce-ba97-7521c1537df4 tempest-VolumesListAdminTestJSON-777469807 None] Acquiring lock "cinder-82234568-3fe1-4bf9-9e8a-57f1bbec2ae4-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:07:45 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-5294915a-0e8e-49ce-ba97-7521c1537df4 tempest-VolumesListAdminTestJSON-777469807 None] Lock "cinder-82234568-3fe1-4bf9-9e8a-57f1bbec2ae4-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:07:45 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-5294915a-0e8e-49ce-ba97-7521c1537df4 tempest-VolumesListAdminTestJSON-777469807 None] Acquiring lock "cinder-quobyte-82234568-3fe1-4bf9-9e8a-57f1bbec2ae4" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:07:45 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-5294915a-0e8e-49ce-ba97-7521c1537df4 tempest-VolumesListAdminTestJSON-777469807 None] Lock "cinder-quobyte-82234568-3fe1-4bf9-9e8a-57f1bbec2ae4" acquired by "delete_volume" :: waited 0.042s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:07:45 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c0773d-0b62-4463-aea6-51f6f6b291c8]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:07:45 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5294915a-0e8e-49ce-ba97-7521c1537df4 tempest-VolumesListAdminTestJSON-777469807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-82234568-3fe1-4bf9-9e8a-57f1bbec2ae4 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:07:45 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-41a03e00-a129-4269-9f97-7a18ea10522f tempest-VolumesListAdminTestJSON-1662895768 None] Acquiring lock "cinder-d869b2dc-fab6-4234-8bbb-e2ff7c6c3ebe-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:07:45 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-41a03e00-a129-4269-9f97-7a18ea10522f tempest-VolumesListAdminTestJSON-1662895768 None] Lock "cinder-d869b2dc-fab6-4234-8bbb-e2ff7c6c3ebe-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:07:46 devstack sudo[103858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-82234568-3fe1-4bf9-9e8a-57f1bbec2ae4 Aug 10 16:07:46 devstack sudo[103858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:07:46 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-41a03e00-a129-4269-9f97-7a18ea10522f tempest-VolumesListAdminTestJSON-1662895768 None] Acquiring lock "cinder-quobyte-d869b2dc-fab6-4234-8bbb-e2ff7c6c3ebe" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:07:46 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-41a03e00-a129-4269-9f97-7a18ea10522f tempest-VolumesListAdminTestJSON-1662895768 None] Lock "cinder-quobyte-d869b2dc-fab6-4234-8bbb-e2ff7c6c3ebe" acquired by "delete_volume" :: waited 0.030s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:07:46 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe02058a-3c4e-4bf8-8356-286c44d7c908]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:07:46 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-41a03e00-a129-4269-9f97-7a18ea10522f tempest-VolumesListAdminTestJSON-1662895768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d869b2dc-fab6-4234-8bbb-e2ff7c6c3ebe {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:07:46 devstack sudo[103860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d869b2dc-fab6-4234-8bbb-e2ff7c6c3ebe Aug 10 16:07:46 devstack sudo[103860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:07:46 devstack sudo[103858]: pam_unix(sudo:session): session closed for user root Aug 10 16:07:46 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5294915a-0e8e-49ce-ba97-7521c1537df4 tempest-VolumesListAdminTestJSON-777469807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-82234568-3fe1-4bf9-9e8a-57f1bbec2ae4" returned: 0 in 0.703s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:07:46 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5294915a-0e8e-49ce-ba97-7521c1537df4 tempest-VolumesListAdminTestJSON-777469807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-82234568-3fe1-4bf9-9e8a-57f1bbec2ae4 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:07:46 devstack sudo[103865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-82234568-3fe1-4bf9-9e8a-57f1bbec2ae4 Aug 10 16:07:46 devstack sudo[103865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:07:46 devstack sudo[103860]: pam_unix(sudo:session): session closed for user root Aug 10 16:07:46 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-41a03e00-a129-4269-9f97-7a18ea10522f tempest-VolumesListAdminTestJSON-1662895768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d869b2dc-fab6-4234-8bbb-e2ff7c6c3ebe" returned: 0 in 0.636s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:07:46 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-41a03e00-a129-4269-9f97-7a18ea10522f tempest-VolumesListAdminTestJSON-1662895768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d869b2dc-fab6-4234-8bbb-e2ff7c6c3ebe {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:07:46 devstack sudo[103870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d869b2dc-fab6-4234-8bbb-e2ff7c6c3ebe Aug 10 16:07:46 devstack sudo[103870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:07:46 devstack sudo[103865]: pam_unix(sudo:session): session closed for user root Aug 10 16:07:46 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5294915a-0e8e-49ce-ba97-7521c1537df4 tempest-VolumesListAdminTestJSON-777469807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-82234568-3fe1-4bf9-9e8a-57f1bbec2ae4" returned: 0 in 0.416s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:07:47 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-5294915a-0e8e-49ce-ba97-7521c1537df4 tempest-VolumesListAdminTestJSON-777469807 None] Lock "cinder-quobyte-82234568-3fe1-4bf9-9e8a-57f1bbec2ae4" released by "delete_volume" :: held 1.206s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:07:47 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-5294915a-0e8e-49ce-ba97-7521c1537df4 tempest-VolumesListAdminTestJSON-777469807 None] Created reservations ['4e729586-59ee-4dbf-8906-93e62bb03a6f', 'c75d9b57-27a1-4312-8985-df865fdb4297', 'a949e747-ab76-40e9-85b2-8e5dd7deda01', '76510cf0-21c1-4c5e-965a-4363f0b6af72'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:07:47 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-5294915a-0e8e-49ce-ba97-7521c1537df4 tempest-VolumesListAdminTestJSON-777469807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:07:47 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-5294915a-0e8e-49ce-ba97-7521c1537df4 tempest-VolumesListAdminTestJSON-777469807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:07:47 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-5294915a-0e8e-49ce-ba97-7521c1537df4 tempest-VolumesListAdminTestJSON-777469807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:07:47 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-5294915a-0e8e-49ce-ba97-7521c1537df4 tempest-VolumesListAdminTestJSON-777469807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:07:47 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-5294915a-0e8e-49ce-ba97-7521c1537df4 tempest-VolumesListAdminTestJSON-777469807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:07:47 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5294915a-0e8e-49ce-ba97-7521c1537df4 tempest-VolumesListAdminTestJSON-777469807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:07:47 devstack sudo[103874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:07:47 devstack sudo[103874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:07:47 devstack sudo[103870]: pam_unix(sudo:session): session closed for user root Aug 10 16:07:47 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-41a03e00-a129-4269-9f97-7a18ea10522f tempest-VolumesListAdminTestJSON-1662895768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d869b2dc-fab6-4234-8bbb-e2ff7c6c3ebe" returned: 0 in 0.525s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:07:47 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-41a03e00-a129-4269-9f97-7a18ea10522f tempest-VolumesListAdminTestJSON-1662895768 None] Lock "cinder-quobyte-d869b2dc-fab6-4234-8bbb-e2ff7c6c3ebe" released by "delete_volume" :: held 1.231s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:07:47 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-41a03e00-a129-4269-9f97-7a18ea10522f tempest-VolumesListAdminTestJSON-1662895768 None] Created reservations ['a09ffb34-8fb5-49b0-ad99-6142f7f4bddd', 'ab8b315a-5a5b-4b10-af28-2ecdcecc4be5', 'aa31dedf-2543-4ef1-a5f1-484cbc69efc1', 'a655ad65-5de1-4165-a923-355d25c1841e'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:07:47 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-41a03e00-a129-4269-9f97-7a18ea10522f tempest-VolumesListAdminTestJSON-1662895768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:07:47 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-41a03e00-a129-4269-9f97-7a18ea10522f tempest-VolumesListAdminTestJSON-1662895768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:07:47 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-41a03e00-a129-4269-9f97-7a18ea10522f tempest-VolumesListAdminTestJSON-1662895768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:07:47 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-41a03e00-a129-4269-9f97-7a18ea10522f tempest-VolumesListAdminTestJSON-1662895768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:07:47 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-41a03e00-a129-4269-9f97-7a18ea10522f tempest-VolumesListAdminTestJSON-1662895768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:07:47 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-41a03e00-a129-4269-9f97-7a18ea10522f tempest-VolumesListAdminTestJSON-1662895768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:07:47 devstack sudo[103877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:07:47 devstack sudo[103877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:07:47 devstack sudo[103874]: pam_unix(sudo:session): session closed for user root Aug 10 16:07:47 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5294915a-0e8e-49ce-ba97-7521c1537df4 tempest-VolumesListAdminTestJSON-777469807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.461s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:07:47 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-5294915a-0e8e-49ce-ba97-7521c1537df4 tempest-VolumesListAdminTestJSON-777469807 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:07:47 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-5294915a-0e8e-49ce-ba97-7521c1537df4 tempest-VolumesListAdminTestJSON-777469807 None] Deleted volume successfully. Aug 10 16:07:47 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-5294915a-0e8e-49ce-ba97-7521c1537df4 tempest-VolumesListAdminTestJSON-777469807 None] Lock "cinder-82234568-3fe1-4bf9-9e8a-57f1bbec2ae4-delete_volume" released by "delete_volume" :: held 2.065s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:07:47 devstack sudo[103877]: pam_unix(sudo:session): session closed for user root Aug 10 16:07:47 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-41a03e00-a129-4269-9f97-7a18ea10522f tempest-VolumesListAdminTestJSON-1662895768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.356s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:07:47 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-41a03e00-a129-4269-9f97-7a18ea10522f tempest-VolumesListAdminTestJSON-1662895768 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:07:47 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-41a03e00-a129-4269-9f97-7a18ea10522f tempest-VolumesListAdminTestJSON-1662895768 None] Deleted volume successfully. Aug 10 16:07:48 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-41a03e00-a129-4269-9f97-7a18ea10522f tempest-VolumesListAdminTestJSON-1662895768 None] Lock "cinder-d869b2dc-fab6-4234-8bbb-e2ff7c6c3ebe-delete_volume" released by "delete_volume" :: held 2.032s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:07:48 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-81802e73-10a8-4043-a514-42382b9aa556 tempest-VolumesListAdminTestJSON-1662895768 None] Acquiring lock "cinder-2eb15e00-ff50-4b51-9923-45e71dcf1fd2-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:07:48 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-81802e73-10a8-4043-a514-42382b9aa556 tempest-VolumesListAdminTestJSON-1662895768 None] Lock "cinder-2eb15e00-ff50-4b51-9923-45e71dcf1fd2-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:07:48 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-81802e73-10a8-4043-a514-42382b9aa556 tempest-VolumesListAdminTestJSON-1662895768 None] Acquiring lock "cinder-quobyte-2eb15e00-ff50-4b51-9923-45e71dcf1fd2" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:07:48 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-81802e73-10a8-4043-a514-42382b9aa556 tempest-VolumesListAdminTestJSON-1662895768 None] Lock "cinder-quobyte-2eb15e00-ff50-4b51-9923-45e71dcf1fd2" acquired by "delete_volume" :: waited 0.030s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:07:48 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[dedf32c5-9ea4-4b98-88e0-401705ccb21f]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:07:48 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-81802e73-10a8-4043-a514-42382b9aa556 tempest-VolumesListAdminTestJSON-1662895768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2eb15e00-ff50-4b51-9923-45e71dcf1fd2 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:07:48 devstack sudo[103880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2eb15e00-ff50-4b51-9923-45e71dcf1fd2 Aug 10 16:07:48 devstack sudo[103880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:07:49 devstack sudo[103880]: pam_unix(sudo:session): session closed for user root Aug 10 16:07:49 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-81802e73-10a8-4043-a514-42382b9aa556 tempest-VolumesListAdminTestJSON-1662895768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2eb15e00-ff50-4b51-9923-45e71dcf1fd2" returned: 0 in 0.433s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:07:49 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-81802e73-10a8-4043-a514-42382b9aa556 tempest-VolumesListAdminTestJSON-1662895768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2eb15e00-ff50-4b51-9923-45e71dcf1fd2 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:07:49 devstack sudo[103886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2eb15e00-ff50-4b51-9923-45e71dcf1fd2 Aug 10 16:07:49 devstack sudo[103886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:07:49 devstack sudo[103886]: pam_unix(sudo:session): session closed for user root Aug 10 16:07:49 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-81802e73-10a8-4043-a514-42382b9aa556 tempest-VolumesListAdminTestJSON-1662895768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2eb15e00-ff50-4b51-9923-45e71dcf1fd2" returned: 0 in 0.396s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:07:49 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-81802e73-10a8-4043-a514-42382b9aa556 tempest-VolumesListAdminTestJSON-1662895768 None] Lock "cinder-quobyte-2eb15e00-ff50-4b51-9923-45e71dcf1fd2" released by "delete_volume" :: held 0.945s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:07:49 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-81802e73-10a8-4043-a514-42382b9aa556 tempest-VolumesListAdminTestJSON-1662895768 None] Created reservations ['72789529-ad90-4c64-b07a-ebc17f581c96', 'b2031ce1-b23a-4937-8188-8bd18bf11571', '3c8af0a9-d487-4c0e-90bc-95befd742982', 'f4b4fac1-057a-4f40-beb7-26908ce94c2c'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:07:49 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-81802e73-10a8-4043-a514-42382b9aa556 tempest-VolumesListAdminTestJSON-1662895768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:07:49 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-81802e73-10a8-4043-a514-42382b9aa556 tempest-VolumesListAdminTestJSON-1662895768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:07:49 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-81802e73-10a8-4043-a514-42382b9aa556 tempest-VolumesListAdminTestJSON-1662895768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:07:49 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-81802e73-10a8-4043-a514-42382b9aa556 tempest-VolumesListAdminTestJSON-1662895768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:07:49 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-81802e73-10a8-4043-a514-42382b9aa556 tempest-VolumesListAdminTestJSON-1662895768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:07:49 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-81802e73-10a8-4043-a514-42382b9aa556 tempest-VolumesListAdminTestJSON-1662895768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:07:49 devstack sudo[103889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:07:49 devstack sudo[103889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:07:50 devstack sudo[103889]: pam_unix(sudo:session): session closed for user root Aug 10 16:07:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-81802e73-10a8-4043-a514-42382b9aa556 tempest-VolumesListAdminTestJSON-1662895768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.319s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:07:50 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-81802e73-10a8-4043-a514-42382b9aa556 tempest-VolumesListAdminTestJSON-1662895768 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:07:50 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-81802e73-10a8-4043-a514-42382b9aa556 tempest-VolumesListAdminTestJSON-1662895768 None] Deleted volume successfully. Aug 10 16:07:50 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-81802e73-10a8-4043-a514-42382b9aa556 tempest-VolumesListAdminTestJSON-1662895768 None] Lock "cinder-2eb15e00-ff50-4b51-9923-45e71dcf1fd2-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:07:50 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-cf616b11-c472-4807-a002-823964f7bcce tempest-VolumesListAdminTestJSON-1662895768 None] Acquiring lock "cinder-23c691fe-8995-49be-a4fd-218051809a4b-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:07:50 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-cf616b11-c472-4807-a002-823964f7bcce tempest-VolumesListAdminTestJSON-1662895768 None] Lock "cinder-23c691fe-8995-49be-a4fd-218051809a4b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:07:50 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-cf616b11-c472-4807-a002-823964f7bcce tempest-VolumesListAdminTestJSON-1662895768 None] Acquiring lock "cinder-quobyte-23c691fe-8995-49be-a4fd-218051809a4b" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:07:50 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-cf616b11-c472-4807-a002-823964f7bcce tempest-VolumesListAdminTestJSON-1662895768 None] Lock "cinder-quobyte-23c691fe-8995-49be-a4fd-218051809a4b" acquired by "delete_volume" :: waited 0.024s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:07:51 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[497169d4-7448-419e-b4df-fe3fe6129f16]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:07:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-cf616b11-c472-4807-a002-823964f7bcce tempest-VolumesListAdminTestJSON-1662895768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-23c691fe-8995-49be-a4fd-218051809a4b {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:07:51 devstack sudo[103893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-23c691fe-8995-49be-a4fd-218051809a4b Aug 10 16:07:51 devstack sudo[103893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:07:51 devstack sudo[103893]: pam_unix(sudo:session): session closed for user root Aug 10 16:07:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-cf616b11-c472-4807-a002-823964f7bcce tempest-VolumesListAdminTestJSON-1662895768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-23c691fe-8995-49be-a4fd-218051809a4b" returned: 0 in 0.467s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:07:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-cf616b11-c472-4807-a002-823964f7bcce tempest-VolumesListAdminTestJSON-1662895768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-23c691fe-8995-49be-a4fd-218051809a4b {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:07:51 devstack sudo[103899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-23c691fe-8995-49be-a4fd-218051809a4b Aug 10 16:07:51 devstack sudo[103899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:07:51 devstack sudo[103899]: pam_unix(sudo:session): session closed for user root Aug 10 16:07:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-cf616b11-c472-4807-a002-823964f7bcce tempest-VolumesListAdminTestJSON-1662895768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-23c691fe-8995-49be-a4fd-218051809a4b" returned: 0 in 0.297s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:07:51 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-cf616b11-c472-4807-a002-823964f7bcce tempest-VolumesListAdminTestJSON-1662895768 None] Lock "cinder-quobyte-23c691fe-8995-49be-a4fd-218051809a4b" released by "delete_volume" :: held 0.822s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:07:51 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-cf616b11-c472-4807-a002-823964f7bcce tempest-VolumesListAdminTestJSON-1662895768 None] Created reservations ['4eeda486-922e-4ad1-ad15-36cafd81afeb', 'b30ecc5b-e775-4b32-b48a-8a4d4eab49e2', 'ea30ea4a-23e6-47d0-bf7f-84cb33d2324f', '6a4a7caa-355b-470e-a4ad-48498ff34ad8'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:07:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-cf616b11-c472-4807-a002-823964f7bcce tempest-VolumesListAdminTestJSON-1662895768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:07:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-cf616b11-c472-4807-a002-823964f7bcce tempest-VolumesListAdminTestJSON-1662895768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:07:51 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-cf616b11-c472-4807-a002-823964f7bcce tempest-VolumesListAdminTestJSON-1662895768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:07:51 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-cf616b11-c472-4807-a002-823964f7bcce tempest-VolumesListAdminTestJSON-1662895768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:07:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-cf616b11-c472-4807-a002-823964f7bcce tempest-VolumesListAdminTestJSON-1662895768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:07:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-cf616b11-c472-4807-a002-823964f7bcce tempest-VolumesListAdminTestJSON-1662895768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:07:52 devstack sudo[103903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:07:52 devstack sudo[103903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:07:52 devstack sudo[103903]: pam_unix(sudo:session): session closed for user root Aug 10 16:07:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-cf616b11-c472-4807-a002-823964f7bcce tempest-VolumesListAdminTestJSON-1662895768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.312s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:07:52 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-cf616b11-c472-4807-a002-823964f7bcce tempest-VolumesListAdminTestJSON-1662895768 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:07:52 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-cf616b11-c472-4807-a002-823964f7bcce tempest-VolumesListAdminTestJSON-1662895768 None] Deleted volume successfully. Aug 10 16:07:52 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-cf616b11-c472-4807-a002-823964f7bcce tempest-VolumesListAdminTestJSON-1662895768 None] Lock "cinder-23c691fe-8995-49be-a4fd-218051809a4b-delete_volume" released by "delete_volume" :: held 1.438s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:07:58 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-b85c74ba-262c-4d9a-a529-ede325019cd9 tempest-SnapshotDependencyTests-816823493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:07:58 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b85c74ba-262c-4d9a-a529-ede325019cd9 tempest-SnapshotDependencyTests-816823493 None] Flow 'volume_create_manager' (f703a52c-56c3-4922-851a-5d6a16000617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:07:58 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b85c74ba-262c-4d9a-a529-ede325019cd9 tempest-SnapshotDependencyTests-816823493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69386756-aa36-42be-94b5-6be3bbb009dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:07:58 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b85c74ba-262c-4d9a-a529-ede325019cd9 tempest-SnapshotDependencyTests-816823493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69386756-aa36-42be-94b5-6be3bbb009dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:07:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1410089235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83834923-68aa-4d55-9ca5-748c53495ce7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5ae345e03d34d279b5927838e487099',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:07:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:07:58Z,use_quota=True,user_id='8929286aa377475baa94523335079123',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:07:58 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b85c74ba-262c-4d9a-a529-ede325019cd9 tempest-SnapshotDependencyTests-816823493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee9d60ac-8b43-41dc-8ef4-7408c987f88b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:07:58 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b85c74ba-262c-4d9a-a529-ede325019cd9 tempest-SnapshotDependencyTests-816823493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee9d60ac-8b43-41dc-8ef4-7408c987f88b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:07:58 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b85c74ba-262c-4d9a-a529-ede325019cd9 tempest-SnapshotDependencyTests-816823493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1292b9aa-7580-4302-992a-b1a417e469e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:07:58 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b85c74ba-262c-4d9a-a529-ede325019cd9 tempest-SnapshotDependencyTests-816823493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1292b9aa-7580-4302-992a-b1a417e469e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83834923-68aa-4d55-9ca5-748c53495ce7', 'volume_name': 'volume-83834923-68aa-4d55-9ca5-748c53495ce7', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:07:58 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b85c74ba-262c-4d9a-a529-ede325019cd9 tempest-SnapshotDependencyTests-816823493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2efe6370-97c5-4f62-9211-f4d91c1b2d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:07:58 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b85c74ba-262c-4d9a-a529-ede325019cd9 tempest-SnapshotDependencyTests-816823493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2efe6370-97c5-4f62-9211-f4d91c1b2d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:07:58 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b85c74ba-262c-4d9a-a529-ede325019cd9 tempest-SnapshotDependencyTests-816823493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc6e609d-e6b0-49a2-87ac-7bf84ab9d17f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:07:58 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-b85c74ba-262c-4d9a-a529-ede325019cd9 tempest-SnapshotDependencyTests-816823493 None] Volume 83834923-68aa-4d55-9ca5-748c53495ce7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83834923-68aa-4d55-9ca5-748c53495ce7', 'volume_size': 1} Aug 10 16:07:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-b85c74ba-262c-4d9a-a529-ede325019cd9 tempest-SnapshotDependencyTests-816823493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:07:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-b85c74ba-262c-4d9a-a529-ede325019cd9 tempest-SnapshotDependencyTests-816823493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:07:58 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-b85c74ba-262c-4d9a-a529-ede325019cd9 tempest-SnapshotDependencyTests-816823493 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:07:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1410089235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83834923-68aa-4d55-9ca5-748c53495ce7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5ae345e03d34d279b5927838e487099',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:07:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:07:58Z,use_quota=True,user_id='8929286aa377475baa94523335079123',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:07:58 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-b85c74ba-262c-4d9a-a529-ede325019cd9 tempest-SnapshotDependencyTests-816823493 None] Creating volume 83834923-68aa-4d55-9ca5-748c53495ce7 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:07:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-b85c74ba-262c-4d9a-a529-ede325019cd9 tempest-SnapshotDependencyTests-816823493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:07:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-b85c74ba-262c-4d9a-a529-ede325019cd9 tempest-SnapshotDependencyTests-816823493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:07:58 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-b85c74ba-262c-4d9a-a529-ede325019cd9 tempest-SnapshotDependencyTests-816823493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:07:58 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-b85c74ba-262c-4d9a-a529-ede325019cd9 tempest-SnapshotDependencyTests-816823493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:07:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-b85c74ba-262c-4d9a-a529-ede325019cd9 tempest-SnapshotDependencyTests-816823493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:07:58 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-b85c74ba-262c-4d9a-a529-ede325019cd9 tempest-SnapshotDependencyTests-816823493 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:07:58 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-b85c74ba-262c-4d9a-a529-ede325019cd9 tempest-SnapshotDependencyTests-816823493 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:07:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b85c74ba-262c-4d9a-a529-ede325019cd9 tempest-SnapshotDependencyTests-816823493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-83834923-68aa-4d55-9ca5-748c53495ce7 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:07:58 devstack sudo[103951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-83834923-68aa-4d55-9ca5-748c53495ce7 1073741824 Aug 10 16:07:58 devstack sudo[103951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:07:58 devstack sudo[103951]: pam_unix(sudo:session): session closed for user root Aug 10 16:07:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b85c74ba-262c-4d9a-a529-ede325019cd9 tempest-SnapshotDependencyTests-816823493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-83834923-68aa-4d55-9ca5-748c53495ce7 1073741824" returned: 0 in 0.447s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:07:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b85c74ba-262c-4d9a-a529-ede325019cd9 tempest-SnapshotDependencyTests-816823493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-83834923-68aa-4d55-9ca5-748c53495ce7 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:07:58 devstack sudo[103957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-83834923-68aa-4d55-9ca5-748c53495ce7 Aug 10 16:07:58 devstack sudo[103957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:07:58 devstack sudo[103957]: pam_unix(sudo:session): session closed for user root Aug 10 16:07:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b85c74ba-262c-4d9a-a529-ede325019cd9 tempest-SnapshotDependencyTests-816823493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-83834923-68aa-4d55-9ca5-748c53495ce7" returned: 0 in 0.257s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:07:58 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-b85c74ba-262c-4d9a-a529-ede325019cd9 tempest-SnapshotDependencyTests-816823493 None] <== create_volume: return (747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:07:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-b85c74ba-262c-4d9a-a529-ede325019cd9 tempest-SnapshotDependencyTests-816823493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:07:58 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b85c74ba-262c-4d9a-a529-ede325019cd9 tempest-SnapshotDependencyTests-816823493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc6e609d-e6b0-49a2-87ac-7bf84ab9d17f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83834923-68aa-4d55-9ca5-748c53495ce7', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:07:58 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b85c74ba-262c-4d9a-a529-ede325019cd9 tempest-SnapshotDependencyTests-816823493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc763313-7d6d-47bd-8562-e8b943b3fb10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:07:58 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-b85c74ba-262c-4d9a-a529-ede325019cd9 tempest-SnapshotDependencyTests-816823493 None] Volume volume-83834923-68aa-4d55-9ca5-748c53495ce7 (83834923-68aa-4d55-9ca5-748c53495ce7): created successfully Aug 10 16:07:58 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b85c74ba-262c-4d9a-a529-ede325019cd9 tempest-SnapshotDependencyTests-816823493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc763313-7d6d-47bd-8562-e8b943b3fb10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:07:58 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b85c74ba-262c-4d9a-a529-ede325019cd9 tempest-SnapshotDependencyTests-816823493 None] Flow 'volume_create_manager' (f703a52c-56c3-4922-851a-5d6a16000617) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:07:58 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-b85c74ba-262c-4d9a-a529-ede325019cd9 tempest-SnapshotDependencyTests-816823493 None] Created volume successfully. Aug 10 16:07:59 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-89583233-bd1d-48ff-8dcd-2f143d8dfc70 tempest-SnapshotDependencyTests-816823493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:07:59 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-89583233-bd1d-48ff-8dcd-2f143d8dfc70 tempest-SnapshotDependencyTests-816823493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:07:59 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-89583233-bd1d-48ff-8dcd-2f143d8dfc70 tempest-SnapshotDependencyTests-816823493 None] Creating offline snapshot 6ba63e48-e4af-4850-b018-35f81739bfd7 of volume 83834923-68aa-4d55-9ca5-748c53495ce7 {{(pid=88641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 16:07:59 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[c92f8751-0179-4bdb-bd51-21782ede7015]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:07:59 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-89583233-bd1d-48ff-8dcd-2f143d8dfc70 tempest-SnapshotDependencyTests-816823493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-83834923-68aa-4d55-9ca5-748c53495ce7 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:07:59 devstack sudo[103960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-83834923-68aa-4d55-9ca5-748c53495ce7 Aug 10 16:07:59 devstack sudo[103960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:07:59 devstack sudo[103960]: pam_unix(sudo:session): session closed for user root Aug 10 16:07:59 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-89583233-bd1d-48ff-8dcd-2f143d8dfc70 tempest-SnapshotDependencyTests-816823493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-83834923-68aa-4d55-9ca5-748c53495ce7" returned: 0 in 0.385s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:07:59 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-89583233-bd1d-48ff-8dcd-2f143d8dfc70 tempest-SnapshotDependencyTests-816823493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-83834923-68aa-4d55-9ca5-748c53495ce7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-83834923-68aa-4d55-9ca5-748c53495ce7.6ba63e48-e4af-4850-b018-35f81739bfd7 1G {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:07:59 devstack sudo[103965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-83834923-68aa-4d55-9ca5-748c53495ce7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-83834923-68aa-4d55-9ca5-748c53495ce7.6ba63e48-e4af-4850-b018-35f81739bfd7 1G Aug 10 16:07:59 devstack sudo[103965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:08:00 devstack sudo[103965]: pam_unix(sudo:session): session closed for user root Aug 10 16:08:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-89583233-bd1d-48ff-8dcd-2f143d8dfc70 tempest-SnapshotDependencyTests-816823493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-83834923-68aa-4d55-9ca5-748c53495ce7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-83834923-68aa-4d55-9ca5-748c53495ce7.6ba63e48-e4af-4850-b018-35f81739bfd7 1G" returned: 0 in 0.459s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:08:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-89583233-bd1d-48ff-8dcd-2f143d8dfc70 tempest-SnapshotDependencyTests-816823493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83834923-68aa-4d55-9ca5-748c53495ce7 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-83834923-68aa-4d55-9ca5-748c53495ce7.6ba63e48-e4af-4850-b018-35f81739bfd7 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:08:00 devstack sudo[103970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83834923-68aa-4d55-9ca5-748c53495ce7 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-83834923-68aa-4d55-9ca5-748c53495ce7.6ba63e48-e4af-4850-b018-35f81739bfd7 Aug 10 16:08:00 devstack sudo[103970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:08:00 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3efbee3-a76a-4bd7-9280-27640db5eb8d tempest-VolumesImageMetadata-2130965181 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:08:00 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c3efbee3-a76a-4bd7-9280-27640db5eb8d tempest-VolumesImageMetadata-2130965181 None] Flow 'volume_create_manager' (ed8b5dc4-9aa5-43b4-9604-9c381ba223b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:08:00 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c3efbee3-a76a-4bd7-9280-27640db5eb8d tempest-VolumesImageMetadata-2130965181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65446f52-bc19-4d38-99cd-6eac0a9b5a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:08:00 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c3efbee3-a76a-4bd7-9280-27640db5eb8d tempest-VolumesImageMetadata-2130965181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65446f52-bc19-4d38-99cd-6eac0a9b5a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:08:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1607846941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c492526-d54d-4b8f-8c09-a041b54a82ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcd3a47c2fc743a3bd4c8cd8f8bbf831',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:08:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:08:00Z,use_quota=True,user_id='4f40b0b9b4f84778b8d98d0a25e6ed3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:08:00 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c3efbee3-a76a-4bd7-9280-27640db5eb8d tempest-VolumesImageMetadata-2130965181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2669ce10-9544-4fae-907f-1e2e773d0b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:08:00 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c3efbee3-a76a-4bd7-9280-27640db5eb8d tempest-VolumesImageMetadata-2130965181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2669ce10-9544-4fae-907f-1e2e773d0b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:08:00 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c3efbee3-a76a-4bd7-9280-27640db5eb8d tempest-VolumesImageMetadata-2130965181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (654ddf91-07e7-4953-93d2-7fe109e9bdc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:08:00 devstack cinder-volume[88641]: DEBUG cinder.image.glance [None req-c3efbee3-a76a-4bd7-9280-27640db5eb8d tempest-VolumesImageMetadata-2130965181 None] Creating Keystone auth plugin from conf {{(pid=88641) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 10 16:08:00 devstack sudo[103970]: pam_unix(sudo:session): session closed for user root Aug 10 16:08:00 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c3efbee3-a76a-4bd7-9280-27640db5eb8d tempest-VolumesImageMetadata-2130965181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (654ddf91-07e7-4953-93d2-7fe109e9bdc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0c492526-d54d-4b8f-8c09-a041b54a82ee', 'volume_name': 'volume-0c492526-d54d-4b8f-8c09-a041b54a82ee', 'volume_size': 1, 'image_id': '94d8702e-9652-4319-94ff-fc0294ea1b4b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/94d8702e-9652-4319-94ff-fc0294ea1b4b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9e18d747214f4822be3dc7f3bd0a3775', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '94d8702e-9652-4319-94ff-fc0294ea1b4b', 'created_at': datetime.datetime(2026, 8, 10, 13, 48, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 10, 13, 48, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/94d8702e-9652-4319-94ff-fc0294ea1b4b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:08:00 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c3efbee3-a76a-4bd7-9280-27640db5eb8d tempest-VolumesImageMetadata-2130965181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f50c1278-f286-47a0-8f5e-36186c247b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:08:00 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c3efbee3-a76a-4bd7-9280-27640db5eb8d tempest-VolumesImageMetadata-2130965181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f50c1278-f286-47a0-8f5e-36186c247b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:08:00 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c3efbee3-a76a-4bd7-9280-27640db5eb8d tempest-VolumesImageMetadata-2130965181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a276896-4be0-4aa3-823a-d8980808eb24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:08:00 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-c3efbee3-a76a-4bd7-9280-27640db5eb8d tempest-VolumesImageMetadata-2130965181 None] Volume 0c492526-d54d-4b8f-8c09-a041b54a82ee: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0c492526-d54d-4b8f-8c09-a041b54a82ee', 'volume_size': 1, 'image_id': '94d8702e-9652-4319-94ff-fc0294ea1b4b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/94d8702e-9652-4319-94ff-fc0294ea1b4b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9e18d747214f4822be3dc7f3bd0a3775', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '94d8702e-9652-4319-94ff-fc0294ea1b4b', 'created_at': datetime.datetime(2026, 8, 10, 13, 48, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 10, 13, 48, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/94d8702e-9652-4319-94ff-fc0294ea1b4b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 10 16:08:00 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3efbee3-a76a-4bd7-9280-27640db5eb8d tempest-VolumesImageMetadata-2130965181 None] Trying to clone 0c492526-d54d-4b8f-8c09-a041b54a82ee from image 94d8702e-9652-4319-94ff-fc0294ea1b4b at location (None, [{'url': 'file:///opt/stack/data/glance/images/94d8702e-9652-4319-94ff-fc0294ea1b4b', 'metadata': {}}]). {{(pid=88641) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 10 16:08:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-89583233-bd1d-48ff-8dcd-2f143d8dfc70 tempest-SnapshotDependencyTests-816823493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83834923-68aa-4d55-9ca5-748c53495ce7 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-83834923-68aa-4d55-9ca5-748c53495ce7.6ba63e48-e4af-4850-b018-35f81739bfd7" returned: 0 in 0.341s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:08:00 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-89583233-bd1d-48ff-8dcd-2f143d8dfc70 tempest-SnapshotDependencyTests-816823493 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-83834923-68aa-4d55-9ca5-748c53495ce7.6ba63e48-e4af-4850-b018-35f81739bfd7 is being set with open permissions: ugo+rw Aug 10 16:08:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-89583233-bd1d-48ff-8dcd-2f143d8dfc70 tempest-SnapshotDependencyTests-816823493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-83834923-68aa-4d55-9ca5-748c53495ce7.6ba63e48-e4af-4850-b018-35f81739bfd7 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:08:00 devstack sudo[103975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-83834923-68aa-4d55-9ca5-748c53495ce7.6ba63e48-e4af-4850-b018-35f81739bfd7 Aug 10 16:08:00 devstack sudo[103975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:08:00 devstack sudo[103975]: pam_unix(sudo:session): session closed for user root Aug 10 16:08:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-89583233-bd1d-48ff-8dcd-2f143d8dfc70 tempest-SnapshotDependencyTests-816823493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-83834923-68aa-4d55-9ca5-748c53495ce7.6ba63e48-e4af-4850-b018-35f81739bfd7" returned: 0 in 0.259s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:08:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-89583233-bd1d-48ff-8dcd-2f143d8dfc70 tempest-SnapshotDependencyTests-816823493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-83834923-68aa-4d55-9ca5-748c53495ce7.info {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:08:00 devstack cinder-volume[88641]: DEBUG cinder.image.image_utils [None req-c3efbee3-a76a-4bd7-9280-27640db5eb8d tempest-VolumesImageMetadata-2130965181 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_94d8702e-9652-4319-94ff-fc0294ea1b4b_l0j0xiqcdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88641) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 10 16:08:00 devstack cinder-volume[88641]: INFO cinder.image.image_utils [None req-c3efbee3-a76a-4bd7-9280-27640db5eb8d tempest-VolumesImageMetadata-2130965181 None] Image download 20.69 MB at 20.69 MB/s Aug 10 16:08:00 devstack sudo[103979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-83834923-68aa-4d55-9ca5-748c53495ce7.info Aug 10 16:08:00 devstack sudo[103979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:08:00 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[653486ca-f0cf-4b10-bd7b-312ddd57ed7b]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:08:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c3efbee3-a76a-4bd7-9280-27640db5eb8d tempest-VolumesImageMetadata-2130965181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94d8702e-9652-4319-94ff-fc0294ea1b4b_l0j0xiqcdevstack@QuobyteHD {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:08:01 devstack sudo[103981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94d8702e-9652-4319-94ff-fc0294ea1b4b_l0j0xiqcdevstack@QuobyteHD Aug 10 16:08:01 devstack sudo[103981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:08:01 devstack sudo[103979]: pam_unix(sudo:session): session closed for user root Aug 10 16:08:01 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-89583233-bd1d-48ff-8dcd-2f143d8dfc70 tempest-SnapshotDependencyTests-816823493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-83834923-68aa-4d55-9ca5-748c53495ce7.info" returned: 0 in 0.264s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:08:01 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-89583233-bd1d-48ff-8dcd-2f143d8dfc70 tempest-SnapshotDependencyTests-816823493 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-83834923-68aa-4d55-9ca5-748c53495ce7.info is being set with open permissions: ugo+rw Aug 10 16:08:01 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-89583233-bd1d-48ff-8dcd-2f143d8dfc70 tempest-SnapshotDependencyTests-816823493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-83834923-68aa-4d55-9ca5-748c53495ce7.info {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:08:01 devstack sudo[103984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-83834923-68aa-4d55-9ca5-748c53495ce7.info Aug 10 16:08:01 devstack sudo[103984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:08:01 devstack sudo[103981]: pam_unix(sudo:session): session closed for user root Aug 10 16:08:01 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c3efbee3-a76a-4bd7-9280-27640db5eb8d tempest-VolumesImageMetadata-2130965181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94d8702e-9652-4319-94ff-fc0294ea1b4b_l0j0xiqcdevstack@QuobyteHD" returned: 0 in 0.341s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:08:01 devstack cinder-volume[88641]: DEBUG cinder.image.image_utils [None req-c3efbee3-a76a-4bd7-9280-27640db5eb8d tempest-VolumesImageMetadata-2130965181 None] Temporary image 94d8702e-9652-4319-94ff-fc0294ea1b4b is fetched for user 4f40b0b9b4f84778b8d98d0a25e6ed3e. {{(pid=88641) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 10 16:08:01 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ef7b44-46b5-4dfd-af17-966e03847cc4]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:08:01 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c3efbee3-a76a-4bd7-9280-27640db5eb8d tempest-VolumesImageMetadata-2130965181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94d8702e-9652-4319-94ff-fc0294ea1b4b_l0j0xiqcdevstack@QuobyteHD {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:08:01 devstack sudo[103984]: pam_unix(sudo:session): session closed for user root Aug 10 16:08:01 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-89583233-bd1d-48ff-8dcd-2f143d8dfc70 tempest-SnapshotDependencyTests-816823493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-83834923-68aa-4d55-9ca5-748c53495ce7.info" returned: 0 in 0.249s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:08:01 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-89583233-bd1d-48ff-8dcd-2f143d8dfc70 tempest-SnapshotDependencyTests-816823493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.102s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:08:01 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-89583233-bd1d-48ff-8dcd-2f143d8dfc70 tempest-SnapshotDependencyTests-816823493 None] Create snapshot completed successfully Aug 10 16:08:01 devstack sudo[103990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94d8702e-9652-4319-94ff-fc0294ea1b4b_l0j0xiqcdevstack@QuobyteHD Aug 10 16:08:01 devstack sudo[103990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:08:01 devstack sudo[103990]: pam_unix(sudo:session): session closed for user root Aug 10 16:08:01 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c3efbee3-a76a-4bd7-9280-27640db5eb8d tempest-VolumesImageMetadata-2130965181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94d8702e-9652-4319-94ff-fc0294ea1b4b_l0j0xiqcdevstack@QuobyteHD" returned: 0 in 0.325s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:08:01 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-c3efbee3-a76a-4bd7-9280-27640db5eb8d tempest-VolumesImageMetadata-2130965181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:08:01 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-c3efbee3-a76a-4bd7-9280-27640db5eb8d tempest-VolumesImageMetadata-2130965181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:08:01 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-c3efbee3-a76a-4bd7-9280-27640db5eb8d tempest-VolumesImageMetadata-2130965181 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:08:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1607846941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c492526-d54d-4b8f-8c09-a041b54a82ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcd3a47c2fc743a3bd4c8cd8f8bbf831',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:08:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:08:00Z,use_quota=True,user_id='4f40b0b9b4f84778b8d98d0a25e6ed3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:08:01 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-c3efbee3-a76a-4bd7-9280-27640db5eb8d tempest-VolumesImageMetadata-2130965181 None] Creating volume 0c492526-d54d-4b8f-8c09-a041b54a82ee {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:08:01 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-c3efbee3-a76a-4bd7-9280-27640db5eb8d tempest-VolumesImageMetadata-2130965181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:08:01 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-c3efbee3-a76a-4bd7-9280-27640db5eb8d tempest-VolumesImageMetadata-2130965181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:08:01 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-c3efbee3-a76a-4bd7-9280-27640db5eb8d tempest-VolumesImageMetadata-2130965181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:08:01 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-c3efbee3-a76a-4bd7-9280-27640db5eb8d tempest-VolumesImageMetadata-2130965181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:08:01 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-c3efbee3-a76a-4bd7-9280-27640db5eb8d tempest-VolumesImageMetadata-2130965181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:08:01 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-c3efbee3-a76a-4bd7-9280-27640db5eb8d tempest-VolumesImageMetadata-2130965181 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:08:01 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-c3efbee3-a76a-4bd7-9280-27640db5eb8d tempest-VolumesImageMetadata-2130965181 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:08:01 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c3efbee3-a76a-4bd7-9280-27640db5eb8d tempest-VolumesImageMetadata-2130965181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-0c492526-d54d-4b8f-8c09-a041b54a82ee 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:08:01 devstack sudo[103995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-0c492526-d54d-4b8f-8c09-a041b54a82ee 1073741824 Aug 10 16:08:01 devstack sudo[103995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:08:02 devstack sudo[103995]: pam_unix(sudo:session): session closed for user root Aug 10 16:08:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c3efbee3-a76a-4bd7-9280-27640db5eb8d tempest-VolumesImageMetadata-2130965181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-0c492526-d54d-4b8f-8c09-a041b54a82ee 1073741824" returned: 0 in 0.397s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:08:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c3efbee3-a76a-4bd7-9280-27640db5eb8d tempest-VolumesImageMetadata-2130965181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-0c492526-d54d-4b8f-8c09-a041b54a82ee {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:08:02 devstack sudo[104001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-0c492526-d54d-4b8f-8c09-a041b54a82ee Aug 10 16:08:02 devstack sudo[104001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:08:02 devstack sudo[104001]: pam_unix(sudo:session): session closed for user root Aug 10 16:08:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c3efbee3-a76a-4bd7-9280-27640db5eb8d tempest-VolumesImageMetadata-2130965181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-0c492526-d54d-4b8f-8c09-a041b54a82ee" returned: 0 in 0.289s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:08:02 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-c3efbee3-a76a-4bd7-9280-27640db5eb8d tempest-VolumesImageMetadata-2130965181 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:08:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-c3efbee3-a76a-4bd7-9280-27640db5eb8d tempest-VolumesImageMetadata-2130965181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:08:02 devstack cinder-volume[88641]: DEBUG cinder.volume.volume_utils [None req-c3efbee3-a76a-4bd7-9280-27640db5eb8d tempest-VolumesImageMetadata-2130965181 None] Attempting download of 94d8702e-9652-4319-94ff-fc0294ea1b4b ((None, [{'url': 'file:///opt/stack/data/glance/images/94d8702e-9652-4319-94ff-fc0294ea1b4b', 'metadata': {}}])) to volume 0c492526-d54d-4b8f-8c09-a041b54a82ee. {{(pid=88641) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 10 16:08:02 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[92c2b02d-29ff-4344-8b68-7955e6a4300e]: (4, 'raw') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:08:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c3efbee3-a76a-4bd7-9280-27640db5eb8d tempest-VolumesImageMetadata-2130965181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_94d8702e-9652-4319-94ff-fc0294ea1b4b_1pw3kf1_ {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:08:02 devstack sudo[104004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_94d8702e-9652-4319-94ff-fc0294ea1b4b_1pw3kf1_ Aug 10 16:08:02 devstack sudo[104004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:08:02 devstack sudo[104004]: pam_unix(sudo:session): session closed for user root Aug 10 16:08:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c3efbee3-a76a-4bd7-9280-27640db5eb8d tempest-VolumesImageMetadata-2130965181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_94d8702e-9652-4319-94ff-fc0294ea1b4b_1pw3kf1_" returned: 0 in 0.327s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:08:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c3efbee3-a76a-4bd7-9280-27640db5eb8d tempest-VolumesImageMetadata-2130965181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_94d8702e-9652-4319-94ff-fc0294ea1b4b_1pw3kf1_ {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:08:02 devstack sudo[104008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_94d8702e-9652-4319-94ff-fc0294ea1b4b_1pw3kf1_ Aug 10 16:08:02 devstack sudo[104008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:08:03 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-edfb909a-fae7-47a3-a0b3-9460d0ddcbb8 tempest-SnapshotDependencyTests-816823493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:08:03 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-edfb909a-fae7-47a3-a0b3-9460d0ddcbb8 tempest-SnapshotDependencyTests-816823493 None] Flow 'volume_create_manager' (67612928-3771-4fbd-975c-acb5c2f92d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:08:03 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-edfb909a-fae7-47a3-a0b3-9460d0ddcbb8 tempest-SnapshotDependencyTests-816823493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (114a0f44-76fa-4539-97f0-e5c934569528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:08:03 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-edfb909a-fae7-47a3-a0b3-9460d0ddcbb8 tempest-SnapshotDependencyTests-816823493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (114a0f44-76fa-4539-97f0-e5c934569528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:08:03Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ad00346-3672-48fd-85ae-36b40c6b58c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5ae345e03d34d279b5927838e487099',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:08:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6ba63e48-e4af-4850-b018-35f81739bfd7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:08:03Z,use_quota=True,user_id='8929286aa377475baa94523335079123',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:08:03 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-edfb909a-fae7-47a3-a0b3-9460d0ddcbb8 tempest-SnapshotDependencyTests-816823493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb785812-1219-4c28-b228-40427e5af02e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:08:03 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-edfb909a-fae7-47a3-a0b3-9460d0ddcbb8 tempest-SnapshotDependencyTests-816823493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb785812-1219-4c28-b228-40427e5af02e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:08:03 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-edfb909a-fae7-47a3-a0b3-9460d0ddcbb8 tempest-SnapshotDependencyTests-816823493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd7bcf82-7e84-45a5-88bd-5203decd663d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:08:03 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-edfb909a-fae7-47a3-a0b3-9460d0ddcbb8 tempest-SnapshotDependencyTests-816823493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd7bcf82-7e84-45a5-88bd-5203decd663d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4ad00346-3672-48fd-85ae-36b40c6b58c0', 'volume_name': 'volume-4ad00346-3672-48fd-85ae-36b40c6b58c0', 'volume_size': 1, 'snapshot_id': '6ba63e48-e4af-4850-b018-35f81739bfd7'}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:08:03 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-edfb909a-fae7-47a3-a0b3-9460d0ddcbb8 tempest-SnapshotDependencyTests-816823493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad238a1f-a157-4322-92ad-583da297f7b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:08:03 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-edfb909a-fae7-47a3-a0b3-9460d0ddcbb8 tempest-SnapshotDependencyTests-816823493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad238a1f-a157-4322-92ad-583da297f7b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:08:03 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-edfb909a-fae7-47a3-a0b3-9460d0ddcbb8 tempest-SnapshotDependencyTests-816823493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (267e4a88-05d7-4474-b750-3b86defe2e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:08:03 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-edfb909a-fae7-47a3-a0b3-9460d0ddcbb8 tempest-SnapshotDependencyTests-816823493 None] Volume 4ad00346-3672-48fd-85ae-36b40c6b58c0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4ad00346-3672-48fd-85ae-36b40c6b58c0', 'volume_size': 1, 'snapshot_id': '6ba63e48-e4af-4850-b018-35f81739bfd7'} Aug 10 16:08:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-edfb909a-fae7-47a3-a0b3-9460d0ddcbb8 tempest-SnapshotDependencyTests-816823493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:08:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-edfb909a-fae7-47a3-a0b3-9460d0ddcbb8 tempest-SnapshotDependencyTests-816823493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:08:03 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-edfb909a-fae7-47a3-a0b3-9460d0ddcbb8 tempest-SnapshotDependencyTests-816823493 None] Acquiring lock "cinder-quobyte-6ba63e48-e4af-4850-b018-35f81739bfd7-4ad00346-3672-48fd-85ae-36b40c6b58c0" by "_create_volume_from_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:08:03 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-edfb909a-fae7-47a3-a0b3-9460d0ddcbb8 tempest-SnapshotDependencyTests-816823493 None] Lock "cinder-quobyte-6ba63e48-e4af-4850-b018-35f81739bfd7-4ad00346-3672-48fd-85ae-36b40c6b58c0" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:08:03 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-edfb909a-fae7-47a3-a0b3-9460d0ddcbb8 tempest-SnapshotDependencyTests-816823493 None] Creating volume 4ad00346-3672-48fd-85ae-36b40c6b58c0 from snapshot 6ba63e48-e4af-4850-b018-35f81739bfd7 {{(pid=88641) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 10 16:08:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-edfb909a-fae7-47a3-a0b3-9460d0ddcbb8 tempest-SnapshotDependencyTests-816823493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:08:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-edfb909a-fae7-47a3-a0b3-9460d0ddcbb8 tempest-SnapshotDependencyTests-816823493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:08:03 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-edfb909a-fae7-47a3-a0b3-9460d0ddcbb8 tempest-SnapshotDependencyTests-816823493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:08:03 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-edfb909a-fae7-47a3-a0b3-9460d0ddcbb8 tempest-SnapshotDependencyTests-816823493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:08:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-edfb909a-fae7-47a3-a0b3-9460d0ddcbb8 tempest-SnapshotDependencyTests-816823493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:08:03 devstack sudo[104008]: pam_unix(sudo:session): session closed for user root Aug 10 16:08:03 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-edfb909a-fae7-47a3-a0b3-9460d0ddcbb8 tempest-SnapshotDependencyTests-816823493 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:08:03 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-edfb909a-fae7-47a3-a0b3-9460d0ddcbb8 tempest-SnapshotDependencyTests-816823493 None] Acquiring lock "cinder-quobyte-4ad00346-3672-48fd-85ae-36b40c6b58c0" by "_copy_volume_from_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:08:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c3efbee3-a76a-4bd7-9280-27640db5eb8d tempest-VolumesImageMetadata-2130965181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_94d8702e-9652-4319-94ff-fc0294ea1b4b_1pw3kf1_" returned: 1 in 0.332s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:08:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c3efbee3-a76a-4bd7-9280-27640db5eb8d tempest-VolumesImageMetadata-2130965181 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_94d8702e-9652-4319-94ff-fc0294ea1b4b_1pw3kf1_' failed. Not Retrying. {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 10 16:08:03 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[b867f3e4-c849-46ee-8588-1ea3deafe89a]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:08:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c3efbee3-a76a-4bd7-9280-27640db5eb8d tempest-VolumesImageMetadata-2130965181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94d8702e-9652-4319-94ff-fc0294ea1b4b_l0j0xiqcdevstack@QuobyteHD {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:08:03 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-edfb909a-fae7-47a3-a0b3-9460d0ddcbb8 tempest-SnapshotDependencyTests-816823493 None] Lock "cinder-quobyte-4ad00346-3672-48fd-85ae-36b40c6b58c0" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:08:03 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-edfb909a-fae7-47a3-a0b3-9460d0ddcbb8 tempest-SnapshotDependencyTests-816823493 None] snapshot: 6ba63e48-e4af-4850-b018-35f81739bfd7, volume: 4ad00346-3672-48fd-85ae-36b40c6b58c0, {{(pid=88641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 10 16:08:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-edfb909a-fae7-47a3-a0b3-9460d0ddcbb8 tempest-SnapshotDependencyTests-816823493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:08:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-edfb909a-fae7-47a3-a0b3-9460d0ddcbb8 tempest-SnapshotDependencyTests-816823493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:08:03 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-edfb909a-fae7-47a3-a0b3-9460d0ddcbb8 tempest-SnapshotDependencyTests-816823493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:08:03 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-edfb909a-fae7-47a3-a0b3-9460d0ddcbb8 tempest-SnapshotDependencyTests-816823493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:08:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-edfb909a-fae7-47a3-a0b3-9460d0ddcbb8 tempest-SnapshotDependencyTests-816823493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:08:03 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[33054656-b2e1-4911-8fb9-7ea5c3ef8e8d]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:08:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-edfb909a-fae7-47a3-a0b3-9460d0ddcbb8 tempest-SnapshotDependencyTests-816823493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-83834923-68aa-4d55-9ca5-748c53495ce7.6ba63e48-e4af-4850-b018-35f81739bfd7 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:08:03 devstack sudo[104012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94d8702e-9652-4319-94ff-fc0294ea1b4b_l0j0xiqcdevstack@QuobyteHD Aug 10 16:08:03 devstack sudo[104012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:08:03 devstack sudo[104013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-83834923-68aa-4d55-9ca5-748c53495ce7.6ba63e48-e4af-4850-b018-35f81739bfd7 Aug 10 16:08:03 devstack sudo[104013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:08:03 devstack sudo[104012]: pam_unix(sudo:session): session closed for user root Aug 10 16:08:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c3efbee3-a76a-4bd7-9280-27640db5eb8d tempest-VolumesImageMetadata-2130965181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94d8702e-9652-4319-94ff-fc0294ea1b4b_l0j0xiqcdevstack@QuobyteHD" returned: 0 in 0.330s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:08:03 devstack cinder-volume[88641]: DEBUG cinder.image.image_utils [None req-c3efbee3-a76a-4bd7-9280-27640db5eb8d tempest-VolumesImageMetadata-2130965181 None] 94d8702e-9652-4319-94ff-fc0294ea1b4b was qcow2, converting to qcow2 {{(pid=88641) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 10 16:08:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c3efbee3-a76a-4bd7-9280-27640db5eb8d tempest-VolumesImageMetadata-2130965181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_94d8702e-9652-4319-94ff-fc0294ea1b4b_l0j0xiqcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-0c492526-d54d-4b8f-8c09-a041b54a82ee {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:08:03 devstack sudo[104019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_94d8702e-9652-4319-94ff-fc0294ea1b4b_l0j0xiqcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-0c492526-d54d-4b8f-8c09-a041b54a82ee Aug 10 16:08:03 devstack sudo[104019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:08:03 devstack sudo[104013]: pam_unix(sudo:session): session closed for user root Aug 10 16:08:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-edfb909a-fae7-47a3-a0b3-9460d0ddcbb8 tempest-SnapshotDependencyTests-816823493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-83834923-68aa-4d55-9ca5-748c53495ce7.6ba63e48-e4af-4850-b018-35f81739bfd7" returned: 0 in 0.372s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:08:03 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-edfb909a-fae7-47a3-a0b3-9460d0ddcbb8 tempest-SnapshotDependencyTests-816823493 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83834923-68aa-4d55-9ca5-748c53495ce7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 16:08:03 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[800006b4-4bca-4a64-9320-fd75444326c7]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:08:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-edfb909a-fae7-47a3-a0b3-9460d0ddcbb8 tempest-SnapshotDependencyTests-816823493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-83834923-68aa-4d55-9ca5-748c53495ce7 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:08:03 devstack sudo[104024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-83834923-68aa-4d55-9ca5-748c53495ce7 Aug 10 16:08:03 devstack sudo[104024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:08:04 devstack sudo[104024]: pam_unix(sudo:session): session closed for user root Aug 10 16:08:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-edfb909a-fae7-47a3-a0b3-9460d0ddcbb8 tempest-SnapshotDependencyTests-816823493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-83834923-68aa-4d55-9ca5-748c53495ce7" returned: 0 in 0.406s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:08:04 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-edfb909a-fae7-47a3-a0b3-9460d0ddcbb8 tempest-SnapshotDependencyTests-816823493 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-83834923-68aa-4d55-9ca5-748c53495ce7 {{(pid=88641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 10 16:08:04 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-edfb909a-fae7-47a3-a0b3-9460d0ddcbb8 tempest-SnapshotDependencyTests-816823493 None] Creating direct copy from snapshot {{(pid=88641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 10 16:08:04 devstack cinder-volume[88641]: DEBUG cinder.utils [None req-edfb909a-fae7-47a3-a0b3-9460d0ddcbb8 tempest-SnapshotDependencyTests-816823493 None] Path /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4ad00346-3672-48fd-85ae-36b40c6b58c0 not found in is_blk_device check {{(pid=88641) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 10 16:08:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-edfb909a-fae7-47a3-a0b3-9460d0ddcbb8 tempest-SnapshotDependencyTests-816823493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-83834923-68aa-4d55-9ca5-748c53495ce7 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4ad00346-3672-48fd-85ae-36b40c6b58c0 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:08:04 devstack sudo[104034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-83834923-68aa-4d55-9ca5-748c53495ce7 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4ad00346-3672-48fd-85ae-36b40c6b58c0 Aug 10 16:08:04 devstack sudo[104034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:08:05 devstack sudo[104019]: pam_unix(sudo:session): session closed for user root Aug 10 16:08:05 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c3efbee3-a76a-4bd7-9280-27640db5eb8d tempest-VolumesImageMetadata-2130965181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_94d8702e-9652-4319-94ff-fc0294ea1b4b_l0j0xiqcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-0c492526-d54d-4b8f-8c09-a041b54a82ee" returned: 0 in 2.362s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:08:05 devstack cinder-volume[88641]: DEBUG cinder.image.image_utils [None req-c3efbee3-a76a-4bd7-9280-27640db5eb8d tempest-VolumesImageMetadata-2130965181 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_94d8702e-9652-4319-94ff-fc0294ea1b4b_l0j0xiqcdevstack@QuobyteHD, size 112.00 MB, duration 2.36 sec, destination /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-0c492526-d54d-4b8f-8c09-a041b54a82ee {{(pid=88641) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 10 16:08:05 devstack cinder-volume[88641]: INFO cinder.image.image_utils [None req-c3efbee3-a76a-4bd7-9280-27640db5eb8d tempest-VolumesImageMetadata-2130965181 None] Converted 112.00 MB image at 47.40 MB/s Aug 10 16:08:05 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c3efbee3-a76a-4bd7-9280-27640db5eb8d tempest-VolumesImageMetadata-2130965181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-0c492526-d54d-4b8f-8c09-a041b54a82ee 1G {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:08:05 devstack sudo[104053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-0c492526-d54d-4b8f-8c09-a041b54a82ee 1G Aug 10 16:08:05 devstack sudo[104053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:08:06 devstack sudo[104053]: pam_unix(sudo:session): session closed for user root Aug 10 16:08:06 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c3efbee3-a76a-4bd7-9280-27640db5eb8d tempest-VolumesImageMetadata-2130965181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-0c492526-d54d-4b8f-8c09-a041b54a82ee 1G" returned: 0 in 0.750s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:08:06 devstack cinder-volume[88641]: DEBUG cinder.volume.volume_utils [None req-c3efbee3-a76a-4bd7-9280-27640db5eb8d tempest-VolumesImageMetadata-2130965181 None] Downloaded image 94d8702e-9652-4319-94ff-fc0294ea1b4b ((None, [{'url': 'file:///opt/stack/data/glance/images/94d8702e-9652-4319-94ff-fc0294ea1b4b', 'metadata': {}}])) to volume 0c492526-d54d-4b8f-8c09-a041b54a82ee successfully. {{(pid=88641) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 10 16:08:06 devstack cinder-volume[88641]: DEBUG cinder.image.image_utils [None req-c3efbee3-a76a-4bd7-9280-27640db5eb8d tempest-VolumesImageMetadata-2130965181 None] Temporary image 94d8702e-9652-4319-94ff-fc0294ea1b4b for user 4f40b0b9b4f84778b8d98d0a25e6ed3e is deleted. {{(pid=88641) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 10 16:08:06 devstack cinder-volume[88641]: DEBUG cinder.volume.volume_utils [None req-c3efbee3-a76a-4bd7-9280-27640db5eb8d tempest-VolumesImageMetadata-2130965181 None] Marking volume 0c492526-d54d-4b8f-8c09-a041b54a82ee as bootable. {{(pid=88641) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 10 16:08:06 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3efbee3-a76a-4bd7-9280-27640db5eb8d tempest-VolumesImageMetadata-2130965181 None] Copying metadata from image 94d8702e-9652-4319-94ff-fc0294ea1b4b to 0c492526-d54d-4b8f-8c09-a041b54a82ee. {{(pid=88641) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 10 16:08:06 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3efbee3-a76a-4bd7-9280-27640db5eb8d tempest-VolumesImageMetadata-2130965181 None] Creating volume glance metadata for volume 0c492526-d54d-4b8f-8c09-a041b54a82ee backed by image 94d8702e-9652-4319-94ff-fc0294ea1b4b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '94d8702e-9652-4319-94ff-fc0294ea1b4b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88641) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 10 16:08:06 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c3efbee3-a76a-4bd7-9280-27640db5eb8d tempest-VolumesImageMetadata-2130965181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a276896-4be0-4aa3-823a-d8980808eb24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c492526-d54d-4b8f-8c09-a041b54a82ee', 'volume_size': 1, 'image_id': '94d8702e-9652-4319-94ff-fc0294ea1b4b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/94d8702e-9652-4319-94ff-fc0294ea1b4b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9e18d747214f4822be3dc7f3bd0a3775', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '94d8702e-9652-4319-94ff-fc0294ea1b4b', 'created_at': datetime.datetime(2026, 8, 10, 13, 48, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 10, 13, 48, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/94d8702e-9652-4319-94ff-fc0294ea1b4b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:08:06 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c3efbee3-a76a-4bd7-9280-27640db5eb8d tempest-VolumesImageMetadata-2130965181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65a882b8-673b-42e8-8902-55e3f222d37a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:08:06 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-c3efbee3-a76a-4bd7-9280-27640db5eb8d tempest-VolumesImageMetadata-2130965181 None] Volume volume-0c492526-d54d-4b8f-8c09-a041b54a82ee (0c492526-d54d-4b8f-8c09-a041b54a82ee): created successfully Aug 10 16:08:06 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c3efbee3-a76a-4bd7-9280-27640db5eb8d tempest-VolumesImageMetadata-2130965181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65a882b8-673b-42e8-8902-55e3f222d37a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:08:06 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c3efbee3-a76a-4bd7-9280-27640db5eb8d tempest-VolumesImageMetadata-2130965181 None] Flow 'volume_create_manager' (ed8b5dc4-9aa5-43b4-9604-9c381ba223b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:08:06 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-c3efbee3-a76a-4bd7-9280-27640db5eb8d tempest-VolumesImageMetadata-2130965181 None] Created volume successfully. Aug 10 16:08:08 devstack sudo[104034]: pam_unix(sudo:session): session closed for user root Aug 10 16:08:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-edfb909a-fae7-47a3-a0b3-9460d0ddcbb8 tempest-SnapshotDependencyTests-816823493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-83834923-68aa-4d55-9ca5-748c53495ce7 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4ad00346-3672-48fd-85ae-36b40c6b58c0" returned: 0 in 4.659s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:08:08 devstack cinder-volume[88641]: DEBUG cinder.image.image_utils [None req-edfb909a-fae7-47a3-a0b3-9460d0ddcbb8 tempest-SnapshotDependencyTests-816823493 None] Image conversion details: src /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-83834923-68aa-4d55-9ca5-748c53495ce7, size 1024.00 MB, duration 4.66 sec, destination /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4ad00346-3672-48fd-85ae-36b40c6b58c0 {{(pid=88641) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 10 16:08:08 devstack cinder-volume[88641]: INFO cinder.image.image_utils [None req-edfb909a-fae7-47a3-a0b3-9460d0ddcbb8 tempest-SnapshotDependencyTests-816823493 None] Converted 1024.00 MB image at 219.73 MB/s Aug 10 16:08:08 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-edfb909a-fae7-47a3-a0b3-9460d0ddcbb8 tempest-SnapshotDependencyTests-816823493 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4ad00346-3672-48fd-85ae-36b40c6b58c0 is being set with open permissions: ugo+rw Aug 10 16:08:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-edfb909a-fae7-47a3-a0b3-9460d0ddcbb8 tempest-SnapshotDependencyTests-816823493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4ad00346-3672-48fd-85ae-36b40c6b58c0 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:08:08 devstack sudo[104058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4ad00346-3672-48fd-85ae-36b40c6b58c0 Aug 10 16:08:08 devstack sudo[104058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:08:08 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-433f0803-504c-46fd-b73f-67f5bab9505b tempest-VolumesImageMetadata-2130965181 None] Acquiring lock "cinder-0c492526-d54d-4b8f-8c09-a041b54a82ee-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:08:08 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-433f0803-504c-46fd-b73f-67f5bab9505b tempest-VolumesImageMetadata-2130965181 None] Lock "cinder-0c492526-d54d-4b8f-8c09-a041b54a82ee-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:08:08 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-433f0803-504c-46fd-b73f-67f5bab9505b tempest-VolumesImageMetadata-2130965181 None] Acquiring lock "cinder-quobyte-0c492526-d54d-4b8f-8c09-a041b54a82ee" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:08:08 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-433f0803-504c-46fd-b73f-67f5bab9505b tempest-VolumesImageMetadata-2130965181 None] Lock "cinder-quobyte-0c492526-d54d-4b8f-8c09-a041b54a82ee" acquired by "delete_volume" :: waited 0.017s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:08:08 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[3faee2c2-d3fc-44e2-9ea9-6fa21f93011d]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:08:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-433f0803-504c-46fd-b73f-67f5bab9505b tempest-VolumesImageMetadata-2130965181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-0c492526-d54d-4b8f-8c09-a041b54a82ee {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:08:09 devstack sudo[104058]: pam_unix(sudo:session): session closed for user root Aug 10 16:08:09 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-edfb909a-fae7-47a3-a0b3-9460d0ddcbb8 tempest-SnapshotDependencyTests-816823493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4ad00346-3672-48fd-85ae-36b40c6b58c0" returned: 0 in 0.267s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:08:09 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-edfb909a-fae7-47a3-a0b3-9460d0ddcbb8 tempest-SnapshotDependencyTests-816823493 None] Lock "cinder-quobyte-4ad00346-3672-48fd-85ae-36b40c6b58c0" released by "_copy_volume_from_snapshot" :: held 5.806s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:08:09 devstack sudo[104060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-0c492526-d54d-4b8f-8c09-a041b54a82ee Aug 10 16:08:09 devstack sudo[104060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:08:09 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-edfb909a-fae7-47a3-a0b3-9460d0ddcbb8 tempest-SnapshotDependencyTests-816823493 None] Lock "cinder-quobyte-6ba63e48-e4af-4850-b018-35f81739bfd7-4ad00346-3672-48fd-85ae-36b40c6b58c0" released by "_create_volume_from_snapshot" :: held 5.879s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:08:09 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-edfb909a-fae7-47a3-a0b3-9460d0ddcbb8 tempest-SnapshotDependencyTests-816823493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.896s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:08:09 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-edfb909a-fae7-47a3-a0b3-9460d0ddcbb8 tempest-SnapshotDependencyTests-816823493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (267e4a88-05d7-4474-b750-3b86defe2e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ad00346-3672-48fd-85ae-36b40c6b58c0', 'volume_size': 1, 'snapshot_id': '6ba63e48-e4af-4850-b018-35f81739bfd7'}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:08:09 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-edfb909a-fae7-47a3-a0b3-9460d0ddcbb8 tempest-SnapshotDependencyTests-816823493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6f71e33-e516-4d3d-b1d5-073828e21028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:08:09 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-edfb909a-fae7-47a3-a0b3-9460d0ddcbb8 tempest-SnapshotDependencyTests-816823493 None] Volume volume-4ad00346-3672-48fd-85ae-36b40c6b58c0 (4ad00346-3672-48fd-85ae-36b40c6b58c0): created successfully Aug 10 16:08:09 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-edfb909a-fae7-47a3-a0b3-9460d0ddcbb8 tempest-SnapshotDependencyTests-816823493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6f71e33-e516-4d3d-b1d5-073828e21028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:08:09 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-edfb909a-fae7-47a3-a0b3-9460d0ddcbb8 tempest-SnapshotDependencyTests-816823493 None] Flow 'volume_create_manager' (67612928-3771-4fbd-975c-acb5c2f92d2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:08:09 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-edfb909a-fae7-47a3-a0b3-9460d0ddcbb8 tempest-SnapshotDependencyTests-816823493 None] Created volume successfully. Aug 10 16:08:09 devstack sudo[104060]: pam_unix(sudo:session): session closed for user root Aug 10 16:08:09 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-433f0803-504c-46fd-b73f-67f5bab9505b tempest-VolumesImageMetadata-2130965181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-0c492526-d54d-4b8f-8c09-a041b54a82ee" returned: 0 in 0.368s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:08:09 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-433f0803-504c-46fd-b73f-67f5bab9505b tempest-VolumesImageMetadata-2130965181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-0c492526-d54d-4b8f-8c09-a041b54a82ee {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:08:09 devstack sudo[104066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-0c492526-d54d-4b8f-8c09-a041b54a82ee Aug 10 16:08:09 devstack sudo[104066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:08:09 devstack sudo[104066]: pam_unix(sudo:session): session closed for user root Aug 10 16:08:09 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-433f0803-504c-46fd-b73f-67f5bab9505b tempest-VolumesImageMetadata-2130965181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-0c492526-d54d-4b8f-8c09-a041b54a82ee" returned: 0 in 0.250s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:08:09 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-433f0803-504c-46fd-b73f-67f5bab9505b tempest-VolumesImageMetadata-2130965181 None] Lock "cinder-quobyte-0c492526-d54d-4b8f-8c09-a041b54a82ee" released by "delete_volume" :: held 0.658s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:08:09 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-433f0803-504c-46fd-b73f-67f5bab9505b tempest-VolumesImageMetadata-2130965181 None] Created reservations ['1a98669f-8dc0-4c8c-8d3a-9023d5b57069', '88d38302-5900-4517-9a39-04bde464fd39', '08c3fc1c-0cee-4419-bc6f-bbbc8266f7ad', '0ad0da03-cfa5-4070-bed0-1b231e0f2812'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:08:09 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-433f0803-504c-46fd-b73f-67f5bab9505b tempest-VolumesImageMetadata-2130965181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:08:09 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-433f0803-504c-46fd-b73f-67f5bab9505b tempest-VolumesImageMetadata-2130965181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:08:09 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-433f0803-504c-46fd-b73f-67f5bab9505b tempest-VolumesImageMetadata-2130965181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:08:09 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-433f0803-504c-46fd-b73f-67f5bab9505b tempest-VolumesImageMetadata-2130965181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:08:09 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-433f0803-504c-46fd-b73f-67f5bab9505b tempest-VolumesImageMetadata-2130965181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:08:09 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-433f0803-504c-46fd-b73f-67f5bab9505b tempest-VolumesImageMetadata-2130965181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:08:09 devstack sudo[104069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:08:09 devstack sudo[104069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:08:09 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-a4694439-333e-421c-a015-af27bd6d24e4 tempest-SnapshotDependencyTests-816823493 None] Acquiring lock "cinder-6ba63e48-e4af-4850-b018-35f81739bfd7-delete_snapshot" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:08:09 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-a4694439-333e-421c-a015-af27bd6d24e4 tempest-SnapshotDependencyTests-816823493 None] Lock "cinder-6ba63e48-e4af-4850-b018-35f81739bfd7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:08:09 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-a4694439-333e-421c-a015-af27bd6d24e4 tempest-SnapshotDependencyTests-816823493 None] Acquiring lock "cinder-quobyte-83834923-68aa-4d55-9ca5-748c53495ce7" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:08:09 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-a4694439-333e-421c-a015-af27bd6d24e4 tempest-SnapshotDependencyTests-816823493 None] Lock "cinder-quobyte-83834923-68aa-4d55-9ca5-748c53495ce7" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:08:09 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-a4694439-333e-421c-a015-af27bd6d24e4 tempest-SnapshotDependencyTests-816823493 None] Acquiring lock "cinder-quobyte-6ba63e48-e4af-4850-b018-35f81739bfd7" by "_delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:08:09 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-a4694439-333e-421c-a015-af27bd6d24e4 tempest-SnapshotDependencyTests-816823493 None] Lock "cinder-quobyte-6ba63e48-e4af-4850-b018-35f81739bfd7" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:08:09 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-a4694439-333e-421c-a015-af27bd6d24e4 tempest-SnapshotDependencyTests-816823493 None] Deleting offline snapshot 6ba63e48-e4af-4850-b018-35f81739bfd7 of volume 83834923-68aa-4d55-9ca5-748c53495ce7 {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 16:08:09 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-a4694439-333e-421c-a015-af27bd6d24e4 tempest-SnapshotDependencyTests-816823493 None] snapshot_file for this snap is: volume-83834923-68aa-4d55-9ca5-748c53495ce7.6ba63e48-e4af-4850-b018-35f81739bfd7 {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 16:08:09 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[53951c71-46f3-4f6e-ab25-dbf2fe089895]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:08:09 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a4694439-333e-421c-a015-af27bd6d24e4 tempest-SnapshotDependencyTests-816823493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-83834923-68aa-4d55-9ca5-748c53495ce7.6ba63e48-e4af-4850-b018-35f81739bfd7 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:08:10 devstack sudo[104069]: pam_unix(sudo:session): session closed for user root Aug 10 16:08:10 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-433f0803-504c-46fd-b73f-67f5bab9505b tempest-VolumesImageMetadata-2130965181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.304s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:08:10 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-433f0803-504c-46fd-b73f-67f5bab9505b tempest-VolumesImageMetadata-2130965181 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:08:10 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-433f0803-504c-46fd-b73f-67f5bab9505b tempest-VolumesImageMetadata-2130965181 None] Deleted volume successfully. Aug 10 16:08:10 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-433f0803-504c-46fd-b73f-67f5bab9505b tempest-VolumesImageMetadata-2130965181 None] Lock "cinder-0c492526-d54d-4b8f-8c09-a041b54a82ee-delete_volume" released by "delete_volume" :: held 1.210s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:08:10 devstack sudo[104071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-83834923-68aa-4d55-9ca5-748c53495ce7.6ba63e48-e4af-4850-b018-35f81739bfd7 Aug 10 16:08:10 devstack sudo[104071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:08:10 devstack sudo[104071]: pam_unix(sudo:session): session closed for user root Aug 10 16:08:10 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a4694439-333e-421c-a015-af27bd6d24e4 tempest-SnapshotDependencyTests-816823493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-83834923-68aa-4d55-9ca5-748c53495ce7.6ba63e48-e4af-4850-b018-35f81739bfd7" returned: 0 in 0.454s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:08:10 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-a4694439-333e-421c-a015-af27bd6d24e4 tempest-SnapshotDependencyTests-816823493 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83834923-68aa-4d55-9ca5-748c53495ce7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 16:08:10 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[07e65124-90b3-46c8-83e6-0a812480499c]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:08:10 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a4694439-333e-421c-a015-af27bd6d24e4 tempest-SnapshotDependencyTests-816823493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-83834923-68aa-4d55-9ca5-748c53495ce7 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:08:10 devstack sudo[104077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-83834923-68aa-4d55-9ca5-748c53495ce7 Aug 10 16:08:10 devstack sudo[104077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:08:11 devstack sudo[104077]: pam_unix(sudo:session): session closed for user root Aug 10 16:08:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a4694439-333e-421c-a015-af27bd6d24e4 tempest-SnapshotDependencyTests-816823493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-83834923-68aa-4d55-9ca5-748c53495ce7" returned: 0 in 0.639s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:08:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a4694439-333e-421c-a015-af27bd6d24e4 tempest-SnapshotDependencyTests-816823493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-83834923-68aa-4d55-9ca5-748c53495ce7.6ba63e48-e4af-4850-b018-35f81739bfd7 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:08:11 devstack sudo[104082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-83834923-68aa-4d55-9ca5-748c53495ce7.6ba63e48-e4af-4850-b018-35f81739bfd7 Aug 10 16:08:11 devstack sudo[104082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:08:11 devstack sudo[104082]: pam_unix(sudo:session): session closed for user root Aug 10 16:08:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a4694439-333e-421c-a015-af27bd6d24e4 tempest-SnapshotDependencyTests-816823493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-83834923-68aa-4d55-9ca5-748c53495ce7.6ba63e48-e4af-4850-b018-35f81739bfd7" returned: 0 in 0.460s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:08:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a4694439-333e-421c-a015-af27bd6d24e4 tempest-SnapshotDependencyTests-816823493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-83834923-68aa-4d55-9ca5-748c53495ce7.6ba63e48-e4af-4850-b018-35f81739bfd7 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:08:11 devstack sudo[104088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-83834923-68aa-4d55-9ca5-748c53495ce7.6ba63e48-e4af-4850-b018-35f81739bfd7 Aug 10 16:08:11 devstack sudo[104088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:08:11 devstack sudo[104088]: pam_unix(sudo:session): session closed for user root Aug 10 16:08:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a4694439-333e-421c-a015-af27bd6d24e4 tempest-SnapshotDependencyTests-816823493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-83834923-68aa-4d55-9ca5-748c53495ce7.6ba63e48-e4af-4850-b018-35f81739bfd7" returned: 0 in 0.294s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:08:11 devstack cinder-volume[88641]: DEBUG dbcounter [-] [88641] Writing DB stats cinder:INSERT=30,cinder:UPDATE=100,cinder:DELETE=7,cinder:SELECT=79 {{(pid=88641) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 16:08:11 devstack cinder-volume[88641]: DEBUG dbcounter [-] [88641] Writing DB stats cinder:SELECT=91,cinder:INSERT=22,cinder:UPDATE=87,cinder:DELETE=11 {{(pid=88641) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 16:08:11 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-a4694439-333e-421c-a015-af27bd6d24e4 tempest-SnapshotDependencyTests-816823493 None] Lock "cinder-quobyte-6ba63e48-e4af-4850-b018-35f81739bfd7" released by "_delete_snapshot" :: held 1.986s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:08:11 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-a4694439-333e-421c-a015-af27bd6d24e4 tempest-SnapshotDependencyTests-816823493 None] Lock "cinder-quobyte-83834923-68aa-4d55-9ca5-748c53495ce7" released by "delete_snapshot" :: held 2.038s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:08:11 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-a4694439-333e-421c-a015-af27bd6d24e4 tempest-SnapshotDependencyTests-816823493 None] Created reservations ['379e811b-39ad-44c4-9125-44a14832ab47', '204eee93-61aa-48df-8de3-d070bf7d226e', '15fc029e-e0f7-40ef-a708-c210ff61e037', '0b03cc1f-2c82-4b67-8f3e-171546b91603'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:08:12 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-a4694439-333e-421c-a015-af27bd6d24e4 tempest-SnapshotDependencyTests-816823493 None] Delete snapshot completed successfully. Aug 10 16:08:12 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-a4694439-333e-421c-a015-af27bd6d24e4 tempest-SnapshotDependencyTests-816823493 None] Lock "cinder-6ba63e48-e4af-4850-b018-35f81739bfd7-delete_snapshot" released by "delete_snapshot" :: held 2.211s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:08:13 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-96b68012-055b-443a-92de-44338cbad42d tempest-SnapshotDependencyTests-816823493 None] Acquiring lock "cinder-83834923-68aa-4d55-9ca5-748c53495ce7-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:08:13 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-96b68012-055b-443a-92de-44338cbad42d tempest-SnapshotDependencyTests-816823493 None] Lock "cinder-83834923-68aa-4d55-9ca5-748c53495ce7-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:08:13 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-96b68012-055b-443a-92de-44338cbad42d tempest-SnapshotDependencyTests-816823493 None] Acquiring lock "cinder-quobyte-83834923-68aa-4d55-9ca5-748c53495ce7" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:08:13 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-96b68012-055b-443a-92de-44338cbad42d tempest-SnapshotDependencyTests-816823493 None] Lock "cinder-quobyte-83834923-68aa-4d55-9ca5-748c53495ce7" acquired by "delete_volume" :: waited 0.020s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:08:13 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a7bf909-59ee-40fa-a2b6-6c75379282f6]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:08:13 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-96b68012-055b-443a-92de-44338cbad42d tempest-SnapshotDependencyTests-816823493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-83834923-68aa-4d55-9ca5-748c53495ce7 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:08:13 devstack sudo[104099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-83834923-68aa-4d55-9ca5-748c53495ce7 Aug 10 16:08:13 devstack sudo[104099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:08:13 devstack sudo[104099]: pam_unix(sudo:session): session closed for user root Aug 10 16:08:13 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-96b68012-055b-443a-92de-44338cbad42d tempest-SnapshotDependencyTests-816823493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-83834923-68aa-4d55-9ca5-748c53495ce7" returned: 0 in 0.433s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:08:13 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-96b68012-055b-443a-92de-44338cbad42d tempest-SnapshotDependencyTests-816823493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-83834923-68aa-4d55-9ca5-748c53495ce7 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:08:13 devstack sudo[104108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-83834923-68aa-4d55-9ca5-748c53495ce7 Aug 10 16:08:13 devstack sudo[104108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:08:13 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-45ca241f-57ff-44d2-a7f3-ec680796be81 req-f68cbab1-28b7-4fef-881a-07e9c0e9befc tempest-TestStampPattern-1573197444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:08:13 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-45ca241f-57ff-44d2-a7f3-ec680796be81 req-f68cbab1-28b7-4fef-881a-07e9c0e9befc tempest-TestStampPattern-1573197444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:08:13 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-45ca241f-57ff-44d2-a7f3-ec680796be81 req-f68cbab1-28b7-4fef-881a-07e9c0e9befc tempest-TestStampPattern-1573197444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:08:13 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [req-45ca241f-57ff-44d2-a7f3-ec680796be81 req-f68cbab1-28b7-4fef-881a-07e9c0e9befc tempest-TestStampPattern-1573197444 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc', 'name': 'volume-d77e1b15-108f-44ee-a266-25ed0a947ab0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c5219112-cf65-4e85-b1d8-3970bb430279', 'enforce_multipath': True} {{(pid=88641) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 10 16:08:13 devstack sudo[104108]: pam_unix(sudo:session): session closed for user root Aug 10 16:08:13 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-96b68012-055b-443a-92de-44338cbad42d tempest-SnapshotDependencyTests-816823493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-83834923-68aa-4d55-9ca5-748c53495ce7" returned: 0 in 0.296s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:08:13 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-96b68012-055b-443a-92de-44338cbad42d tempest-SnapshotDependencyTests-816823493 None] Lock "cinder-quobyte-83834923-68aa-4d55-9ca5-748c53495ce7" released by "delete_volume" :: held 0.809s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:08:14 devstack cinder-volume[88641]: INFO cinder.volume.manager [req-45ca241f-57ff-44d2-a7f3-ec680796be81 req-f68cbab1-28b7-4fef-881a-07e9c0e9befc tempest-TestStampPattern-1573197444 None] attachment_update completed successfully. Aug 10 16:08:14 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-96b68012-055b-443a-92de-44338cbad42d tempest-SnapshotDependencyTests-816823493 None] Created reservations ['296e783b-0c25-476b-aa41-d1194d03bc22', '15af68d1-11dc-4d0b-9295-ae3ab89f275a', 'a6498c37-310e-4d93-8fda-a9365d80d123', 'bcfbe5b3-1b65-4177-bf9b-380d8104cd79'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:08:14 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-96b68012-055b-443a-92de-44338cbad42d tempest-SnapshotDependencyTests-816823493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:08:14 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-96b68012-055b-443a-92de-44338cbad42d tempest-SnapshotDependencyTests-816823493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:08:14 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-96b68012-055b-443a-92de-44338cbad42d tempest-SnapshotDependencyTests-816823493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:08:14 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-96b68012-055b-443a-92de-44338cbad42d tempest-SnapshotDependencyTests-816823493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:08:14 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-96b68012-055b-443a-92de-44338cbad42d tempest-SnapshotDependencyTests-816823493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:08:14 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-96b68012-055b-443a-92de-44338cbad42d tempest-SnapshotDependencyTests-816823493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:08:14 devstack sudo[104116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:08:14 devstack sudo[104116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:08:14 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-a8f2f68b-8549-467e-a145-c2df1091317c tempest-SnapshotDependencyTests-816823493 None] Acquiring lock "cinder-4ad00346-3672-48fd-85ae-36b40c6b58c0-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:08:14 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-a8f2f68b-8549-467e-a145-c2df1091317c tempest-SnapshotDependencyTests-816823493 None] Lock "cinder-4ad00346-3672-48fd-85ae-36b40c6b58c0-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:08:14 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-a8f2f68b-8549-467e-a145-c2df1091317c tempest-SnapshotDependencyTests-816823493 None] Acquiring lock "cinder-quobyte-4ad00346-3672-48fd-85ae-36b40c6b58c0" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:08:14 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-a8f2f68b-8549-467e-a145-c2df1091317c tempest-SnapshotDependencyTests-816823493 None] Lock "cinder-quobyte-4ad00346-3672-48fd-85ae-36b40c6b58c0" acquired by "delete_volume" :: waited 0.016s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:08:14 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd249df6-85bb-4a78-88ef-dc7a013baaef]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:08:14 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a8f2f68b-8549-467e-a145-c2df1091317c tempest-SnapshotDependencyTests-816823493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4ad00346-3672-48fd-85ae-36b40c6b58c0 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:08:14 devstack sudo[104116]: pam_unix(sudo:session): session closed for user root Aug 10 16:08:14 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-96b68012-055b-443a-92de-44338cbad42d tempest-SnapshotDependencyTests-816823493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.342s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:08:14 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-96b68012-055b-443a-92de-44338cbad42d tempest-SnapshotDependencyTests-816823493 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:08:14 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-96b68012-055b-443a-92de-44338cbad42d tempest-SnapshotDependencyTests-816823493 None] Deleted volume successfully. Aug 10 16:08:14 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-96b68012-055b-443a-92de-44338cbad42d tempest-SnapshotDependencyTests-816823493 None] Lock "cinder-83834923-68aa-4d55-9ca5-748c53495ce7-delete_volume" released by "delete_volume" :: held 1.437s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:08:14 devstack sudo[104481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4ad00346-3672-48fd-85ae-36b40c6b58c0 Aug 10 16:08:14 devstack sudo[104481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:08:14 devstack sudo[104481]: pam_unix(sudo:session): session closed for user root Aug 10 16:08:14 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a8f2f68b-8549-467e-a145-c2df1091317c tempest-SnapshotDependencyTests-816823493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4ad00346-3672-48fd-85ae-36b40c6b58c0" returned: 0 in 0.465s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:08:14 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a8f2f68b-8549-467e-a145-c2df1091317c tempest-SnapshotDependencyTests-816823493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4ad00346-3672-48fd-85ae-36b40c6b58c0 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:08:14 devstack sudo[104508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4ad00346-3672-48fd-85ae-36b40c6b58c0 Aug 10 16:08:14 devstack sudo[104508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:08:15 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba7fad90-3dbe-4783-9bc7-433bce634a32 tempest-VolumesTransfersV357Test-581937947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:08:15 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-ba7fad90-3dbe-4783-9bc7-433bce634a32 tempest-VolumesTransfersV357Test-581937947 None] Flow 'volume_create_manager' (77220770-d537-4088-b49b-9e8afd64a148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:08:15 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-ba7fad90-3dbe-4783-9bc7-433bce634a32 tempest-VolumesTransfersV357Test-581937947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95136cc8-56b6-4a80-be30-97c98af7f164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:08:15 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-ba7fad90-3dbe-4783-9bc7-433bce634a32 tempest-VolumesTransfersV357Test-581937947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95136cc8-56b6-4a80-be30-97c98af7f164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:08:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-889500478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34c2f3bf-70bd-4277-8ef5-e906b9c62e31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19c5ecd2bdea426ebaea2c5a42e9992b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:08:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:08:15Z,use_quota=True,user_id='82e165aa5be84467b9a53d118e7e058e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:08:15 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-ba7fad90-3dbe-4783-9bc7-433bce634a32 tempest-VolumesTransfersV357Test-581937947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51fe90d6-f411-4136-acd7-4f9c5f0950a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:08:15 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-ba7fad90-3dbe-4783-9bc7-433bce634a32 tempest-VolumesTransfersV357Test-581937947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51fe90d6-f411-4136-acd7-4f9c5f0950a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:08:15 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-ba7fad90-3dbe-4783-9bc7-433bce634a32 tempest-VolumesTransfersV357Test-581937947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (395e0736-2e6c-4912-a6b8-fc16a2bc7768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:08:15 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-ba7fad90-3dbe-4783-9bc7-433bce634a32 tempest-VolumesTransfersV357Test-581937947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (395e0736-2e6c-4912-a6b8-fc16a2bc7768) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34c2f3bf-70bd-4277-8ef5-e906b9c62e31', 'volume_name': 'volume-34c2f3bf-70bd-4277-8ef5-e906b9c62e31', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:08:15 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-ba7fad90-3dbe-4783-9bc7-433bce634a32 tempest-VolumesTransfersV357Test-581937947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfdf5dbd-9de7-4985-84a0-eaf5cee3c047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:08:15 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-ba7fad90-3dbe-4783-9bc7-433bce634a32 tempest-VolumesTransfersV357Test-581937947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfdf5dbd-9de7-4985-84a0-eaf5cee3c047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:08:15 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-ba7fad90-3dbe-4783-9bc7-433bce634a32 tempest-VolumesTransfersV357Test-581937947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2484484-89ed-4fb6-9673-79649c037b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:08:15 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-ba7fad90-3dbe-4783-9bc7-433bce634a32 tempest-VolumesTransfersV357Test-581937947 None] Volume 34c2f3bf-70bd-4277-8ef5-e906b9c62e31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34c2f3bf-70bd-4277-8ef5-e906b9c62e31', 'volume_size': 1} Aug 10 16:08:15 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-ba7fad90-3dbe-4783-9bc7-433bce634a32 tempest-VolumesTransfersV357Test-581937947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:08:15 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-ba7fad90-3dbe-4783-9bc7-433bce634a32 tempest-VolumesTransfersV357Test-581937947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:08:15 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-ba7fad90-3dbe-4783-9bc7-433bce634a32 tempest-VolumesTransfersV357Test-581937947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:08:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-889500478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34c2f3bf-70bd-4277-8ef5-e906b9c62e31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19c5ecd2bdea426ebaea2c5a42e9992b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:08:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:08:15Z,use_quota=True,user_id='82e165aa5be84467b9a53d118e7e058e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:08:15 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-ba7fad90-3dbe-4783-9bc7-433bce634a32 tempest-VolumesTransfersV357Test-581937947 None] Creating volume 34c2f3bf-70bd-4277-8ef5-e906b9c62e31 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:08:15 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-ba7fad90-3dbe-4783-9bc7-433bce634a32 tempest-VolumesTransfersV357Test-581937947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:08:15 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-ba7fad90-3dbe-4783-9bc7-433bce634a32 tempest-VolumesTransfersV357Test-581937947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:08:15 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-ba7fad90-3dbe-4783-9bc7-433bce634a32 tempest-VolumesTransfersV357Test-581937947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:08:15 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-ba7fad90-3dbe-4783-9bc7-433bce634a32 tempest-VolumesTransfersV357Test-581937947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:08:15 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-ba7fad90-3dbe-4783-9bc7-433bce634a32 tempest-VolumesTransfersV357Test-581937947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:08:15 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-ba7fad90-3dbe-4783-9bc7-433bce634a32 tempest-VolumesTransfersV357Test-581937947 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:08:15 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-ba7fad90-3dbe-4783-9bc7-433bce634a32 tempest-VolumesTransfersV357Test-581937947 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:08:15 devstack sudo[104508]: pam_unix(sudo:session): session closed for user root Aug 10 16:08:15 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ba7fad90-3dbe-4783-9bc7-433bce634a32 tempest-VolumesTransfersV357Test-581937947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-34c2f3bf-70bd-4277-8ef5-e906b9c62e31 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:08:15 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a8f2f68b-8549-467e-a145-c2df1091317c tempest-SnapshotDependencyTests-816823493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4ad00346-3672-48fd-85ae-36b40c6b58c0" returned: 0 in 0.354s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:08:15 devstack sudo[104511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-34c2f3bf-70bd-4277-8ef5-e906b9c62e31 1073741824 Aug 10 16:08:15 devstack sudo[104511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:08:15 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-a8f2f68b-8549-467e-a145-c2df1091317c tempest-SnapshotDependencyTests-816823493 None] Lock "cinder-quobyte-4ad00346-3672-48fd-85ae-36b40c6b58c0" released by "delete_volume" :: held 0.886s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:08:15 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-a8f2f68b-8549-467e-a145-c2df1091317c tempest-SnapshotDependencyTests-816823493 None] Created reservations ['bf1f813b-f0c1-446a-9e25-b9a9b818f93a', '304eebbf-6a34-4cfa-b1e9-33b894fed849', 'b91373b6-ce7a-45ad-a020-d552db26b582', '73093128-beae-43d3-b652-7e4853f38485'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:08:15 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-a8f2f68b-8549-467e-a145-c2df1091317c tempest-SnapshotDependencyTests-816823493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:08:15 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-a8f2f68b-8549-467e-a145-c2df1091317c tempest-SnapshotDependencyTests-816823493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:08:15 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-a8f2f68b-8549-467e-a145-c2df1091317c tempest-SnapshotDependencyTests-816823493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:08:15 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-a8f2f68b-8549-467e-a145-c2df1091317c tempest-SnapshotDependencyTests-816823493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:08:15 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-a8f2f68b-8549-467e-a145-c2df1091317c tempest-SnapshotDependencyTests-816823493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:08:15 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a8f2f68b-8549-467e-a145-c2df1091317c tempest-SnapshotDependencyTests-816823493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:08:15 devstack sudo[104513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:08:15 devstack sudo[104513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:08:15 devstack sudo[104513]: pam_unix(sudo:session): session closed for user root Aug 10 16:08:15 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a8f2f68b-8549-467e-a145-c2df1091317c tempest-SnapshotDependencyTests-816823493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.295s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:08:15 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-a8f2f68b-8549-467e-a145-c2df1091317c tempest-SnapshotDependencyTests-816823493 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:08:15 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-a8f2f68b-8549-467e-a145-c2df1091317c tempest-SnapshotDependencyTests-816823493 None] Deleted volume successfully. Aug 10 16:08:15 devstack sudo[104511]: pam_unix(sudo:session): session closed for user root Aug 10 16:08:15 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ba7fad90-3dbe-4783-9bc7-433bce634a32 tempest-VolumesTransfersV357Test-581937947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-34c2f3bf-70bd-4277-8ef5-e906b9c62e31 1073741824" returned: 0 in 0.493s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:08:15 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-a8f2f68b-8549-467e-a145-c2df1091317c tempest-SnapshotDependencyTests-816823493 None] Lock "cinder-4ad00346-3672-48fd-85ae-36b40c6b58c0-delete_volume" released by "delete_volume" :: held 1.444s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:08:15 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ba7fad90-3dbe-4783-9bc7-433bce634a32 tempest-VolumesTransfersV357Test-581937947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-34c2f3bf-70bd-4277-8ef5-e906b9c62e31 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:08:15 devstack sudo[104520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-34c2f3bf-70bd-4277-8ef5-e906b9c62e31 Aug 10 16:08:15 devstack sudo[104520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:08:16 devstack sudo[104520]: pam_unix(sudo:session): session closed for user root Aug 10 16:08:16 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ba7fad90-3dbe-4783-9bc7-433bce634a32 tempest-VolumesTransfersV357Test-581937947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-34c2f3bf-70bd-4277-8ef5-e906b9c62e31" returned: 0 in 0.274s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:08:16 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-ba7fad90-3dbe-4783-9bc7-433bce634a32 tempest-VolumesTransfersV357Test-581937947 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:08:16 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-ba7fad90-3dbe-4783-9bc7-433bce634a32 tempest-VolumesTransfersV357Test-581937947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:08:16 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-ba7fad90-3dbe-4783-9bc7-433bce634a32 tempest-VolumesTransfersV357Test-581937947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2484484-89ed-4fb6-9673-79649c037b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34c2f3bf-70bd-4277-8ef5-e906b9c62e31', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:08:16 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-ba7fad90-3dbe-4783-9bc7-433bce634a32 tempest-VolumesTransfersV357Test-581937947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ba3f7b4-bfad-4632-b074-196b1158556c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:08:16 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-ba7fad90-3dbe-4783-9bc7-433bce634a32 tempest-VolumesTransfersV357Test-581937947 None] Volume volume-34c2f3bf-70bd-4277-8ef5-e906b9c62e31 (34c2f3bf-70bd-4277-8ef5-e906b9c62e31): created successfully Aug 10 16:08:16 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-ba7fad90-3dbe-4783-9bc7-433bce634a32 tempest-VolumesTransfersV357Test-581937947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ba3f7b4-bfad-4632-b074-196b1158556c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:08:16 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-ba7fad90-3dbe-4783-9bc7-433bce634a32 tempest-VolumesTransfersV357Test-581937947 None] Flow 'volume_create_manager' (77220770-d537-4088-b49b-9e8afd64a148) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:08:16 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-ba7fad90-3dbe-4783-9bc7-433bce634a32 tempest-VolumesTransfersV357Test-581937947 None] Created volume successfully. Aug 10 16:08:17 devstack cinder-volume[88641]: INFO cinder.volume.manager [req-72cf2faf-661e-4cfa-bda4-d488ce1d8726 req-7ce53a34-cc9c-4b70-abbd-fc3769744491 tempest-TestStampPattern-1573197444 None] Terminate volume connection completed successfully. Aug 10 16:08:17 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [req-72cf2faf-661e-4cfa-bda4-d488ce1d8726 req-7ce53a34-cc9c-4b70-abbd-fc3769744491 tempest-TestStampPattern-1573197444 None] Deleting attachment c5219112-cf65-4e85-b1d8-3970bb430279. {{(pid=88641) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 10 16:08:17 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-493677dd-dbcb-4339-958a-9d8581b9df4c tempest-VolumesTransfersV357Test-1902402162 None] Transfer volume completed successfully. Aug 10 16:08:18 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-e38e8ce5-98aa-4ada-ad28-030299b2655f tempest-VolumesTransfersV357Test-2008595388 None] Acquiring lock "cinder-34c2f3bf-70bd-4277-8ef5-e906b9c62e31-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:08:18 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-e38e8ce5-98aa-4ada-ad28-030299b2655f tempest-VolumesTransfersV357Test-2008595388 None] Lock "cinder-34c2f3bf-70bd-4277-8ef5-e906b9c62e31-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:08:18 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-e38e8ce5-98aa-4ada-ad28-030299b2655f tempest-VolumesTransfersV357Test-2008595388 None] Acquiring lock "cinder-quobyte-34c2f3bf-70bd-4277-8ef5-e906b9c62e31" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:08:18 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-e38e8ce5-98aa-4ada-ad28-030299b2655f tempest-VolumesTransfersV357Test-2008595388 None] Lock "cinder-quobyte-34c2f3bf-70bd-4277-8ef5-e906b9c62e31" acquired by "delete_volume" :: waited 0.018s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:08:18 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af0e075-0c39-4d9c-92b5-2d54ac63a08a]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:08:18 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e38e8ce5-98aa-4ada-ad28-030299b2655f tempest-VolumesTransfersV357Test-2008595388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-34c2f3bf-70bd-4277-8ef5-e906b9c62e31 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:08:18 devstack sudo[104570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-34c2f3bf-70bd-4277-8ef5-e906b9c62e31 Aug 10 16:08:18 devstack sudo[104570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:08:19 devstack sudo[104570]: pam_unix(sudo:session): session closed for user root Aug 10 16:08:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e38e8ce5-98aa-4ada-ad28-030299b2655f tempest-VolumesTransfersV357Test-2008595388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-34c2f3bf-70bd-4277-8ef5-e906b9c62e31" returned: 0 in 0.479s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:08:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e38e8ce5-98aa-4ada-ad28-030299b2655f tempest-VolumesTransfersV357Test-2008595388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-34c2f3bf-70bd-4277-8ef5-e906b9c62e31 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:08:19 devstack sudo[104578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-34c2f3bf-70bd-4277-8ef5-e906b9c62e31 Aug 10 16:08:19 devstack sudo[104578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:08:19 devstack sudo[104578]: pam_unix(sudo:session): session closed for user root Aug 10 16:08:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e38e8ce5-98aa-4ada-ad28-030299b2655f tempest-VolumesTransfersV357Test-2008595388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-34c2f3bf-70bd-4277-8ef5-e906b9c62e31" returned: 0 in 0.416s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:08:19 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-e38e8ce5-98aa-4ada-ad28-030299b2655f tempest-VolumesTransfersV357Test-2008595388 None] Lock "cinder-quobyte-34c2f3bf-70bd-4277-8ef5-e906b9c62e31" released by "delete_volume" :: held 0.943s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:08:19 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-e38e8ce5-98aa-4ada-ad28-030299b2655f tempest-VolumesTransfersV357Test-2008595388 None] Created reservations ['60f4ff2c-6da9-4e49-8c5d-d3804f67b48b', 'a36aa2ad-4904-4480-a128-046297d7573f', 'aaa02720-1684-4a87-87c6-a7889cf7dd79', '5a532c8e-1ef7-41a4-b49a-0146bb83eb0b'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:08:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-e38e8ce5-98aa-4ada-ad28-030299b2655f tempest-VolumesTransfersV357Test-2008595388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:08:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-e38e8ce5-98aa-4ada-ad28-030299b2655f tempest-VolumesTransfersV357Test-2008595388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:08:19 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-e38e8ce5-98aa-4ada-ad28-030299b2655f tempest-VolumesTransfersV357Test-2008595388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:08:19 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-e38e8ce5-98aa-4ada-ad28-030299b2655f tempest-VolumesTransfersV357Test-2008595388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:08:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-e38e8ce5-98aa-4ada-ad28-030299b2655f tempest-VolumesTransfersV357Test-2008595388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:08:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e38e8ce5-98aa-4ada-ad28-030299b2655f tempest-VolumesTransfersV357Test-2008595388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:08:19 devstack sudo[104585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:08:19 devstack sudo[104585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:08:20 devstack sudo[104585]: pam_unix(sudo:session): session closed for user root Aug 10 16:08:20 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e38e8ce5-98aa-4ada-ad28-030299b2655f tempest-VolumesTransfersV357Test-2008595388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.473s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:08:20 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-e38e8ce5-98aa-4ada-ad28-030299b2655f tempest-VolumesTransfersV357Test-2008595388 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:08:20 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-e38e8ce5-98aa-4ada-ad28-030299b2655f tempest-VolumesTransfersV357Test-2008595388 None] Deleted volume successfully. Aug 10 16:08:20 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-e38e8ce5-98aa-4ada-ad28-030299b2655f tempest-VolumesTransfersV357Test-2008595388 None] Lock "cinder-34c2f3bf-70bd-4277-8ef5-e906b9c62e31-delete_volume" released by "delete_volume" :: held 1.718s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:08:21 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-8afee66d-db89-4300-acf2-234c7afda993 tempest-VolumesTransfersV357Test-581937947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:08:21 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-8afee66d-db89-4300-acf2-234c7afda993 tempest-VolumesTransfersV357Test-581937947 None] Flow 'volume_create_manager' (65e350be-8729-4c34-bbc9-2bf085e936ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:08:21 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-8afee66d-db89-4300-acf2-234c7afda993 tempest-VolumesTransfersV357Test-581937947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (813a62d4-70ed-4679-8603-945d7aec18cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:08:21 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-8afee66d-db89-4300-acf2-234c7afda993 tempest-VolumesTransfersV357Test-581937947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (813a62d4-70ed-4679-8603-945d7aec18cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:08:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2034383651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8af6605e-83b9-4663-8e6b-121580246954,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19c5ecd2bdea426ebaea2c5a42e9992b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:08:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:08:21Z,use_quota=True,user_id='82e165aa5be84467b9a53d118e7e058e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:08:21 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-8afee66d-db89-4300-acf2-234c7afda993 tempest-VolumesTransfersV357Test-581937947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fecf90d-394b-45f0-bc7c-2584c08f94d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:08:21 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-8afee66d-db89-4300-acf2-234c7afda993 tempest-VolumesTransfersV357Test-581937947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fecf90d-394b-45f0-bc7c-2584c08f94d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:08:21 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-8afee66d-db89-4300-acf2-234c7afda993 tempest-VolumesTransfersV357Test-581937947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc59bb37-ee2e-42ca-b0b1-d4d39ada4676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:08:21 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-8afee66d-db89-4300-acf2-234c7afda993 tempest-VolumesTransfersV357Test-581937947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc59bb37-ee2e-42ca-b0b1-d4d39ada4676) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8af6605e-83b9-4663-8e6b-121580246954', 'volume_name': 'volume-8af6605e-83b9-4663-8e6b-121580246954', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:08:21 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-8afee66d-db89-4300-acf2-234c7afda993 tempest-VolumesTransfersV357Test-581937947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b02e22f-d80e-49ed-8eff-abae6fd62da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:08:21 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-8afee66d-db89-4300-acf2-234c7afda993 tempest-VolumesTransfersV357Test-581937947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b02e22f-d80e-49ed-8eff-abae6fd62da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:08:21 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-8afee66d-db89-4300-acf2-234c7afda993 tempest-VolumesTransfersV357Test-581937947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd5d9d7e-7b61-4a98-9e18-060b390424db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:08:21 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-8afee66d-db89-4300-acf2-234c7afda993 tempest-VolumesTransfersV357Test-581937947 None] Volume 8af6605e-83b9-4663-8e6b-121580246954: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8af6605e-83b9-4663-8e6b-121580246954', 'volume_size': 1} Aug 10 16:08:21 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-8afee66d-db89-4300-acf2-234c7afda993 tempest-VolumesTransfersV357Test-581937947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:08:21 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-8afee66d-db89-4300-acf2-234c7afda993 tempest-VolumesTransfersV357Test-581937947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:08:21 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-8afee66d-db89-4300-acf2-234c7afda993 tempest-VolumesTransfersV357Test-581937947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:08:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2034383651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8af6605e-83b9-4663-8e6b-121580246954,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19c5ecd2bdea426ebaea2c5a42e9992b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:08:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:08:21Z,use_quota=True,user_id='82e165aa5be84467b9a53d118e7e058e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:08:21 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-8afee66d-db89-4300-acf2-234c7afda993 tempest-VolumesTransfersV357Test-581937947 None] Creating volume 8af6605e-83b9-4663-8e6b-121580246954 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:08:21 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-8afee66d-db89-4300-acf2-234c7afda993 tempest-VolumesTransfersV357Test-581937947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:08:21 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-8afee66d-db89-4300-acf2-234c7afda993 tempest-VolumesTransfersV357Test-581937947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:08:21 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-8afee66d-db89-4300-acf2-234c7afda993 tempest-VolumesTransfersV357Test-581937947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:08:21 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-8afee66d-db89-4300-acf2-234c7afda993 tempest-VolumesTransfersV357Test-581937947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:08:21 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-8afee66d-db89-4300-acf2-234c7afda993 tempest-VolumesTransfersV357Test-581937947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:08:21 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-8afee66d-db89-4300-acf2-234c7afda993 tempest-VolumesTransfersV357Test-581937947 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:08:21 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-8afee66d-db89-4300-acf2-234c7afda993 tempest-VolumesTransfersV357Test-581937947 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:08:21 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-8afee66d-db89-4300-acf2-234c7afda993 tempest-VolumesTransfersV357Test-581937947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-8af6605e-83b9-4663-8e6b-121580246954 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:08:21 devstack sudo[104615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-8af6605e-83b9-4663-8e6b-121580246954 1073741824 Aug 10 16:08:21 devstack sudo[104615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:08:22 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-a6962bd4-74ce-4881-a94f-677c1374d021 tempest-TestStampPattern-1573197444 None] Acquiring lock "cinder-d77e1b15-108f-44ee-a266-25ed0a947ab0-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:08:22 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-a6962bd4-74ce-4881-a94f-677c1374d021 tempest-TestStampPattern-1573197444 None] Lock "cinder-d77e1b15-108f-44ee-a266-25ed0a947ab0-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:08:22 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-a6962bd4-74ce-4881-a94f-677c1374d021 tempest-TestStampPattern-1573197444 None] Acquiring lock "cinder-quobyte-d77e1b15-108f-44ee-a266-25ed0a947ab0" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:08:22 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-a6962bd4-74ce-4881-a94f-677c1374d021 tempest-TestStampPattern-1573197444 None] Lock "cinder-quobyte-d77e1b15-108f-44ee-a266-25ed0a947ab0" acquired by "delete_volume" :: waited 0.017s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:08:22 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c2a65d8-a2d9-446b-a1bd-5e8e2964ff5f]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:08:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a6962bd4-74ce-4881-a94f-677c1374d021 tempest-TestStampPattern-1573197444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d77e1b15-108f-44ee-a266-25ed0a947ab0 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:08:22 devstack sudo[104615]: pam_unix(sudo:session): session closed for user root Aug 10 16:08:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-8afee66d-db89-4300-acf2-234c7afda993 tempest-VolumesTransfersV357Test-581937947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-8af6605e-83b9-4663-8e6b-121580246954 1073741824" returned: 0 in 0.548s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:08:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-8afee66d-db89-4300-acf2-234c7afda993 tempest-VolumesTransfersV357Test-581937947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-8af6605e-83b9-4663-8e6b-121580246954 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:08:22 devstack sudo[104623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-8af6605e-83b9-4663-8e6b-121580246954 Aug 10 16:08:22 devstack sudo[104623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:08:22 devstack sudo[104622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d77e1b15-108f-44ee-a266-25ed0a947ab0 Aug 10 16:08:22 devstack sudo[104622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:08:22 devstack sudo[104623]: pam_unix(sudo:session): session closed for user root Aug 10 16:08:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-8afee66d-db89-4300-acf2-234c7afda993 tempest-VolumesTransfersV357Test-581937947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-8af6605e-83b9-4663-8e6b-121580246954" returned: 0 in 0.314s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:08:22 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-8afee66d-db89-4300-acf2-234c7afda993 tempest-VolumesTransfersV357Test-581937947 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:08:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-8afee66d-db89-4300-acf2-234c7afda993 tempest-VolumesTransfersV357Test-581937947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:08:22 devstack sudo[104622]: pam_unix(sudo:session): session closed for user root Aug 10 16:08:22 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-8afee66d-db89-4300-acf2-234c7afda993 tempest-VolumesTransfersV357Test-581937947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd5d9d7e-7b61-4a98-9e18-060b390424db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8af6605e-83b9-4663-8e6b-121580246954', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:08:22 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-8afee66d-db89-4300-acf2-234c7afda993 tempest-VolumesTransfersV357Test-581937947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1694d224-1e34-4ef9-b606-254d14b3786d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:08:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a6962bd4-74ce-4881-a94f-677c1374d021 tempest-TestStampPattern-1573197444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d77e1b15-108f-44ee-a266-25ed0a947ab0" returned: 0 in 0.416s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:08:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a6962bd4-74ce-4881-a94f-677c1374d021 tempest-TestStampPattern-1573197444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d77e1b15-108f-44ee-a266-25ed0a947ab0 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:08:22 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-8afee66d-db89-4300-acf2-234c7afda993 tempest-VolumesTransfersV357Test-581937947 None] Volume volume-8af6605e-83b9-4663-8e6b-121580246954 (8af6605e-83b9-4663-8e6b-121580246954): created successfully Aug 10 16:08:22 devstack sudo[104630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d77e1b15-108f-44ee-a266-25ed0a947ab0 Aug 10 16:08:22 devstack sudo[104630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:08:22 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-8afee66d-db89-4300-acf2-234c7afda993 tempest-VolumesTransfersV357Test-581937947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1694d224-1e34-4ef9-b606-254d14b3786d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:08:22 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-8afee66d-db89-4300-acf2-234c7afda993 tempest-VolumesTransfersV357Test-581937947 None] Flow 'volume_create_manager' (65e350be-8729-4c34-bbc9-2bf085e936ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:08:22 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-8afee66d-db89-4300-acf2-234c7afda993 tempest-VolumesTransfersV357Test-581937947 None] Created volume successfully. Aug 10 16:08:22 devstack sudo[104630]: pam_unix(sudo:session): session closed for user root Aug 10 16:08:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a6962bd4-74ce-4881-a94f-677c1374d021 tempest-TestStampPattern-1573197444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d77e1b15-108f-44ee-a266-25ed0a947ab0" returned: 0 in 0.341s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:08:22 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-a6962bd4-74ce-4881-a94f-677c1374d021 tempest-TestStampPattern-1573197444 None] Lock "cinder-quobyte-d77e1b15-108f-44ee-a266-25ed0a947ab0" released by "delete_volume" :: held 0.804s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:08:22 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-a6962bd4-74ce-4881-a94f-677c1374d021 tempest-TestStampPattern-1573197444 None] Created reservations ['02c29ae8-1517-4265-929c-fdfb6d53ac8f', 'efbcdf11-105b-41dc-8b70-432b3a53b492', '7833a2a2-0b3f-4373-929c-d79670b227b7', '00f97454-f5d4-4b93-8c42-6b86a10f407b'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:08:23 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-a6962bd4-74ce-4881-a94f-677c1374d021 tempest-TestStampPattern-1573197444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:08:23 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-a6962bd4-74ce-4881-a94f-677c1374d021 tempest-TestStampPattern-1573197444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:08:23 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-a6962bd4-74ce-4881-a94f-677c1374d021 tempest-TestStampPattern-1573197444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:08:23 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-a6962bd4-74ce-4881-a94f-677c1374d021 tempest-TestStampPattern-1573197444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:08:23 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-a6962bd4-74ce-4881-a94f-677c1374d021 tempest-TestStampPattern-1573197444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:08:23 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a6962bd4-74ce-4881-a94f-677c1374d021 tempest-TestStampPattern-1573197444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:08:23 devstack sudo[104634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:08:23 devstack sudo[104634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:08:23 devstack sudo[104634]: pam_unix(sudo:session): session closed for user root Aug 10 16:08:23 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a6962bd4-74ce-4881-a94f-677c1374d021 tempest-TestStampPattern-1573197444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.263s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:08:23 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-a6962bd4-74ce-4881-a94f-677c1374d021 tempest-TestStampPattern-1573197444 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:08:23 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-a6962bd4-74ce-4881-a94f-677c1374d021 tempest-TestStampPattern-1573197444 None] Deleted volume successfully. Aug 10 16:08:23 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-a6962bd4-74ce-4881-a94f-677c1374d021 tempest-TestStampPattern-1573197444 None] Lock "cinder-d77e1b15-108f-44ee-a266-25ed0a947ab0-delete_volume" released by "delete_volume" :: held 1.295s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:08:23 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-95e3c30e-6997-4789-976a-05bfbebfc878 tempest-TestStampPattern-1573197444 None] Acquiring lock "cinder-1dbf7b09-5a0e-4111-a483-7ec2d267f2af-delete_snapshot" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:08:23 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-95e3c30e-6997-4789-976a-05bfbebfc878 tempest-TestStampPattern-1573197444 None] Lock "cinder-1dbf7b09-5a0e-4111-a483-7ec2d267f2af-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:08:23 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-95e3c30e-6997-4789-976a-05bfbebfc878 tempest-TestStampPattern-1573197444 None] Acquiring lock "cinder-quobyte-4a4564b4-def3-447b-98ae-a4fa16c5d222" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:08:23 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-95e3c30e-6997-4789-976a-05bfbebfc878 tempest-TestStampPattern-1573197444 None] Lock "cinder-quobyte-4a4564b4-def3-447b-98ae-a4fa16c5d222" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:08:23 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-95e3c30e-6997-4789-976a-05bfbebfc878 tempest-TestStampPattern-1573197444 None] Acquiring lock "cinder-quobyte-1dbf7b09-5a0e-4111-a483-7ec2d267f2af" by "_delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:08:23 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-95e3c30e-6997-4789-976a-05bfbebfc878 tempest-TestStampPattern-1573197444 None] Lock "cinder-quobyte-1dbf7b09-5a0e-4111-a483-7ec2d267f2af" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:08:23 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-95e3c30e-6997-4789-976a-05bfbebfc878 tempest-TestStampPattern-1573197444 None] Deleting offline snapshot 1dbf7b09-5a0e-4111-a483-7ec2d267f2af of volume 4a4564b4-def3-447b-98ae-a4fa16c5d222 {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 16:08:23 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-95e3c30e-6997-4789-976a-05bfbebfc878 tempest-TestStampPattern-1573197444 None] snapshot_file for this snap is: volume-4a4564b4-def3-447b-98ae-a4fa16c5d222.1dbf7b09-5a0e-4111-a483-7ec2d267f2af {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 16:08:23 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[f23e3e49-433c-4c7c-b9ff-444d8a775f6e]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:08:23 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-95e3c30e-6997-4789-976a-05bfbebfc878 tempest-TestStampPattern-1573197444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4a4564b4-def3-447b-98ae-a4fa16c5d222.1dbf7b09-5a0e-4111-a483-7ec2d267f2af {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:08:23 devstack sudo[104637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4a4564b4-def3-447b-98ae-a4fa16c5d222.1dbf7b09-5a0e-4111-a483-7ec2d267f2af Aug 10 16:08:23 devstack sudo[104637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:08:23 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-0731f5f5-86e7-440c-98c3-9e5c353ba15e tempest-VolumesTransfersV357Test-2008595388 None] Acquiring lock "cinder-8af6605e-83b9-4663-8e6b-121580246954-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:08:24 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-0731f5f5-86e7-440c-98c3-9e5c353ba15e tempest-VolumesTransfersV357Test-2008595388 None] Lock "cinder-8af6605e-83b9-4663-8e6b-121580246954-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:08:24 devstack sudo[104637]: pam_unix(sudo:session): session closed for user root Aug 10 16:08:24 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-95e3c30e-6997-4789-976a-05bfbebfc878 tempest-TestStampPattern-1573197444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4a4564b4-def3-447b-98ae-a4fa16c5d222.1dbf7b09-5a0e-4111-a483-7ec2d267f2af" returned: 0 in 0.467s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:08:24 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-95e3c30e-6997-4789-976a-05bfbebfc878 tempest-TestStampPattern-1573197444 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a4564b4-def3-447b-98ae-a4fa16c5d222(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 16:08:24 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-0731f5f5-86e7-440c-98c3-9e5c353ba15e tempest-VolumesTransfersV357Test-2008595388 None] Acquiring lock "cinder-quobyte-8af6605e-83b9-4663-8e6b-121580246954" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:08:24 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a700a9f-5df3-4371-9d40-b0ef7a82ac69]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:08:24 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-95e3c30e-6997-4789-976a-05bfbebfc878 tempest-TestStampPattern-1573197444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4a4564b4-def3-447b-98ae-a4fa16c5d222 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:08:24 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-0731f5f5-86e7-440c-98c3-9e5c353ba15e tempest-VolumesTransfersV357Test-2008595388 None] Lock "cinder-quobyte-8af6605e-83b9-4663-8e6b-121580246954" acquired by "delete_volume" :: waited 0.031s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:08:24 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[abbaba87-18ab-444c-93b9-35491b74b639]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:08:24 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0731f5f5-86e7-440c-98c3-9e5c353ba15e tempest-VolumesTransfersV357Test-2008595388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-8af6605e-83b9-4663-8e6b-121580246954 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:08:24 devstack sudo[104642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4a4564b4-def3-447b-98ae-a4fa16c5d222 Aug 10 16:08:24 devstack sudo[104642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:08:24 devstack sudo[104643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-8af6605e-83b9-4663-8e6b-121580246954 Aug 10 16:08:24 devstack sudo[104643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:08:24 devstack sudo[104643]: pam_unix(sudo:session): session closed for user root Aug 10 16:08:24 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0731f5f5-86e7-440c-98c3-9e5c353ba15e tempest-VolumesTransfersV357Test-2008595388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-8af6605e-83b9-4663-8e6b-121580246954" returned: 0 in 0.368s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:08:24 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0731f5f5-86e7-440c-98c3-9e5c353ba15e tempest-VolumesTransfersV357Test-2008595388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-8af6605e-83b9-4663-8e6b-121580246954 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:08:24 devstack sudo[104651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-8af6605e-83b9-4663-8e6b-121580246954 Aug 10 16:08:24 devstack sudo[104651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:08:24 devstack sudo[104642]: pam_unix(sudo:session): session closed for user root Aug 10 16:08:24 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-95e3c30e-6997-4789-976a-05bfbebfc878 tempest-TestStampPattern-1573197444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4a4564b4-def3-447b-98ae-a4fa16c5d222" returned: 0 in 0.549s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:08:24 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-95e3c30e-6997-4789-976a-05bfbebfc878 tempest-TestStampPattern-1573197444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4a4564b4-def3-447b-98ae-a4fa16c5d222.1dbf7b09-5a0e-4111-a483-7ec2d267f2af {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:08:24 devstack sudo[104654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4a4564b4-def3-447b-98ae-a4fa16c5d222.1dbf7b09-5a0e-4111-a483-7ec2d267f2af Aug 10 16:08:24 devstack sudo[104654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:08:24 devstack sudo[104651]: pam_unix(sudo:session): session closed for user root Aug 10 16:08:24 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0731f5f5-86e7-440c-98c3-9e5c353ba15e tempest-VolumesTransfersV357Test-2008595388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-8af6605e-83b9-4663-8e6b-121580246954" returned: 0 in 0.261s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:08:24 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-0731f5f5-86e7-440c-98c3-9e5c353ba15e tempest-VolumesTransfersV357Test-2008595388 None] Lock "cinder-quobyte-8af6605e-83b9-4663-8e6b-121580246954" released by "delete_volume" :: held 0.674s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:08:24 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-0731f5f5-86e7-440c-98c3-9e5c353ba15e tempest-VolumesTransfersV357Test-2008595388 None] Created reservations ['feb98191-ae9d-443b-b6a3-025d21f9a694', '9a4a6456-17ab-4208-8531-1dc512176aa9', '23ec0336-0ea5-48ae-97c8-4662dd120d94', '56a6b427-577b-4149-9b62-a531f43de091'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:08:24 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-0731f5f5-86e7-440c-98c3-9e5c353ba15e tempest-VolumesTransfersV357Test-2008595388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:08:24 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-0731f5f5-86e7-440c-98c3-9e5c353ba15e tempest-VolumesTransfersV357Test-2008595388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:08:24 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-0731f5f5-86e7-440c-98c3-9e5c353ba15e tempest-VolumesTransfersV357Test-2008595388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:08:24 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-0731f5f5-86e7-440c-98c3-9e5c353ba15e tempest-VolumesTransfersV357Test-2008595388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:08:24 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-0731f5f5-86e7-440c-98c3-9e5c353ba15e tempest-VolumesTransfersV357Test-2008595388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:08:24 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0731f5f5-86e7-440c-98c3-9e5c353ba15e tempest-VolumesTransfersV357Test-2008595388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:08:24 devstack sudo[104660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:08:24 devstack sudo[104660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:08:25 devstack sudo[104654]: pam_unix(sudo:session): session closed for user root Aug 10 16:08:25 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-95e3c30e-6997-4789-976a-05bfbebfc878 tempest-TestStampPattern-1573197444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4a4564b4-def3-447b-98ae-a4fa16c5d222.1dbf7b09-5a0e-4111-a483-7ec2d267f2af" returned: 0 in 0.471s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:08:25 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-95e3c30e-6997-4789-976a-05bfbebfc878 tempest-TestStampPattern-1573197444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4a4564b4-def3-447b-98ae-a4fa16c5d222.1dbf7b09-5a0e-4111-a483-7ec2d267f2af {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:08:25 devstack sudo[104663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4a4564b4-def3-447b-98ae-a4fa16c5d222.1dbf7b09-5a0e-4111-a483-7ec2d267f2af Aug 10 16:08:25 devstack sudo[104663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:08:25 devstack sudo[104660]: pam_unix(sudo:session): session closed for user root Aug 10 16:08:25 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0731f5f5-86e7-440c-98c3-9e5c353ba15e tempest-VolumesTransfersV357Test-2008595388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.367s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:08:25 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-0731f5f5-86e7-440c-98c3-9e5c353ba15e tempest-VolumesTransfersV357Test-2008595388 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:08:25 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-0731f5f5-86e7-440c-98c3-9e5c353ba15e tempest-VolumesTransfersV357Test-2008595388 None] Deleted volume successfully. Aug 10 16:08:25 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-0731f5f5-86e7-440c-98c3-9e5c353ba15e tempest-VolumesTransfersV357Test-2008595388 None] Lock "cinder-8af6605e-83b9-4663-8e6b-121580246954-delete_volume" released by "delete_volume" :: held 1.336s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:08:25 devstack sudo[104663]: pam_unix(sudo:session): session closed for user root Aug 10 16:08:25 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-95e3c30e-6997-4789-976a-05bfbebfc878 tempest-TestStampPattern-1573197444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4a4564b4-def3-447b-98ae-a4fa16c5d222.1dbf7b09-5a0e-4111-a483-7ec2d267f2af" returned: 0 in 0.327s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:08:25 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-95e3c30e-6997-4789-976a-05bfbebfc878 tempest-TestStampPattern-1573197444 None] Lock "cinder-quobyte-1dbf7b09-5a0e-4111-a483-7ec2d267f2af" released by "_delete_snapshot" :: held 1.918s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:08:25 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-95e3c30e-6997-4789-976a-05bfbebfc878 tempest-TestStampPattern-1573197444 None] Lock "cinder-quobyte-4a4564b4-def3-447b-98ae-a4fa16c5d222" released by "delete_snapshot" :: held 1.944s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:08:25 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-95e3c30e-6997-4789-976a-05bfbebfc878 tempest-TestStampPattern-1573197444 None] Created reservations ['8b67bbd2-cb93-42a8-bcd4-67e63f2c1467', 'c437f4ea-4c71-4b9b-95a4-facf1fe61e9a', '02ac2c22-bd20-48e6-950e-b4d16d981261', '3c6a3037-be40-4d3a-bc34-5edd0b8b62e3'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:08:25 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-95e3c30e-6997-4789-976a-05bfbebfc878 tempest-TestStampPattern-1573197444 None] Delete snapshot completed successfully. Aug 10 16:08:25 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-95e3c30e-6997-4789-976a-05bfbebfc878 tempest-TestStampPattern-1573197444 None] Lock "cinder-1dbf7b09-5a0e-4111-a483-7ec2d267f2af-delete_snapshot" released by "delete_snapshot" :: held 2.111s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:08:29 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-5068da2c-1ec8-4a06-a0ba-be3a473c597e tempest-TestStampPattern-1573197444 None] Acquiring lock "cinder-4a4564b4-def3-447b-98ae-a4fa16c5d222-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:08:29 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-5068da2c-1ec8-4a06-a0ba-be3a473c597e tempest-TestStampPattern-1573197444 None] Lock "cinder-4a4564b4-def3-447b-98ae-a4fa16c5d222-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:08:30 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-5068da2c-1ec8-4a06-a0ba-be3a473c597e tempest-TestStampPattern-1573197444 None] Acquiring lock "cinder-quobyte-4a4564b4-def3-447b-98ae-a4fa16c5d222" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:08:30 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-5068da2c-1ec8-4a06-a0ba-be3a473c597e tempest-TestStampPattern-1573197444 None] Lock "cinder-quobyte-4a4564b4-def3-447b-98ae-a4fa16c5d222" acquired by "delete_volume" :: waited 0.020s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:08:30 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[81cbafe1-c026-49e1-a44a-400160f28faf]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:08:30 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5068da2c-1ec8-4a06-a0ba-be3a473c597e tempest-TestStampPattern-1573197444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4a4564b4-def3-447b-98ae-a4fa16c5d222 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:08:30 devstack sudo[104698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4a4564b4-def3-447b-98ae-a4fa16c5d222 Aug 10 16:08:30 devstack sudo[104698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:08:30 devstack sudo[104698]: pam_unix(sudo:session): session closed for user root Aug 10 16:08:30 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5068da2c-1ec8-4a06-a0ba-be3a473c597e tempest-TestStampPattern-1573197444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4a4564b4-def3-447b-98ae-a4fa16c5d222" returned: 0 in 0.388s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:08:30 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5068da2c-1ec8-4a06-a0ba-be3a473c597e tempest-TestStampPattern-1573197444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4a4564b4-def3-447b-98ae-a4fa16c5d222 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:08:30 devstack sudo[104703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4a4564b4-def3-447b-98ae-a4fa16c5d222 Aug 10 16:08:30 devstack sudo[104703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:08:30 devstack sudo[104703]: pam_unix(sudo:session): session closed for user root Aug 10 16:08:30 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5068da2c-1ec8-4a06-a0ba-be3a473c597e tempest-TestStampPattern-1573197444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4a4564b4-def3-447b-98ae-a4fa16c5d222" returned: 0 in 0.278s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:08:30 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-5068da2c-1ec8-4a06-a0ba-be3a473c597e tempest-TestStampPattern-1573197444 None] Lock "cinder-quobyte-4a4564b4-def3-447b-98ae-a4fa16c5d222" released by "delete_volume" :: held 0.736s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:08:30 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-5068da2c-1ec8-4a06-a0ba-be3a473c597e tempest-TestStampPattern-1573197444 None] Created reservations ['7fd1834f-ea86-479a-9eb0-73b5ece9bedc', '230e0fb2-b61c-4a8b-8ec7-d454f83f6567', 'cd0a739a-47d4-45ed-af11-7f1f830666ea', '86148e59-9866-41b5-bbf6-26f81c1a67a6'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:08:30 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-5068da2c-1ec8-4a06-a0ba-be3a473c597e tempest-TestStampPattern-1573197444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:08:30 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-5068da2c-1ec8-4a06-a0ba-be3a473c597e tempest-TestStampPattern-1573197444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:08:30 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-5068da2c-1ec8-4a06-a0ba-be3a473c597e tempest-TestStampPattern-1573197444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:08:30 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-5068da2c-1ec8-4a06-a0ba-be3a473c597e tempest-TestStampPattern-1573197444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:08:30 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-5068da2c-1ec8-4a06-a0ba-be3a473c597e tempest-TestStampPattern-1573197444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:08:30 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5068da2c-1ec8-4a06-a0ba-be3a473c597e tempest-TestStampPattern-1573197444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:08:30 devstack sudo[104706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:08:30 devstack sudo[104706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:08:31 devstack sudo[104706]: pam_unix(sudo:session): session closed for user root Aug 10 16:08:31 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5068da2c-1ec8-4a06-a0ba-be3a473c597e tempest-TestStampPattern-1573197444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.265s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:08:31 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-5068da2c-1ec8-4a06-a0ba-be3a473c597e tempest-TestStampPattern-1573197444 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:08:31 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-5068da2c-1ec8-4a06-a0ba-be3a473c597e tempest-TestStampPattern-1573197444 None] Deleted volume successfully. Aug 10 16:08:31 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-5068da2c-1ec8-4a06-a0ba-be3a473c597e tempest-TestStampPattern-1573197444 None] Lock "cinder-4a4564b4-def3-447b-98ae-a4fa16c5d222-delete_volume" released by "delete_volume" :: held 1.223s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:08:36 devstack cinder-volume[88641]: DEBUG oslo_service.periodic_task [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88641) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 16:08:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:08:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:08:36 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:08:36 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:08:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:08:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:08:36 devstack sudo[104716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:08:36 devstack sudo[104716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:08:36 devstack sudo[104716]: pam_unix(sudo:session): session closed for user root Aug 10 16:08:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.334s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:08:36 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:08:36 devstack cinder-volume[88641]: DEBUG oslo_service.periodic_task [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Running periodic task VolumeManager._thread_info {{(pid=88641) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 16:08:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] thread count: 28 {{(pid=88641) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 10 16:08:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] thread info: [<_MainThread(MainThread, started 127361545748608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88641) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 10 16:08:40 devstack cinder-volume[88641]: DEBUG dbcounter [-] [88641] Writing DB stats cinder:SELECT=48,cinder:INSERT=15,cinder:UPDATE=60,cinder:DELETE=5 {{(pid=88641) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 16:08:41 devstack cinder-volume[88641]: DEBUG dbcounter [-] [88641] Writing DB stats cinder:SELECT=56,cinder:INSERT=19,cinder:UPDATE=73,cinder:DELETE=3 {{(pid=88641) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 16:08:43 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-e584935a-cd52-4c86-b0eb-13d2f81c92e7 tempest-VolumesActionsTest-864365452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:08:43 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-e584935a-cd52-4c86-b0eb-13d2f81c92e7 tempest-VolumesActionsTest-864365452 None] Flow 'volume_create_manager' (0522f678-0717-477a-8cf1-c8f7842fd913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:08:43 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-e584935a-cd52-4c86-b0eb-13d2f81c92e7 tempest-VolumesActionsTest-864365452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eccde50-311f-4910-9a5b-1a4e9562a279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:08:43 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-e584935a-cd52-4c86-b0eb-13d2f81c92e7 tempest-VolumesActionsTest-864365452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eccde50-311f-4910-9a5b-1a4e9562a279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:08:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-954382793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=298c2771-cbf9-47fb-ae03-174525ba5571,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eafb4d9ba8a84c058ec84acb2d323dc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:08:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:08:43Z,use_quota=True,user_id='e8a88594ad49443da1eb134116ea9733',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:08:43 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-e584935a-cd52-4c86-b0eb-13d2f81c92e7 tempest-VolumesActionsTest-864365452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d489bb80-6ab2-4786-a723-ac1603452c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:08:43 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-e584935a-cd52-4c86-b0eb-13d2f81c92e7 tempest-VolumesActionsTest-864365452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d489bb80-6ab2-4786-a723-ac1603452c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:08:43 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-e584935a-cd52-4c86-b0eb-13d2f81c92e7 tempest-VolumesActionsTest-864365452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71e57506-7fc1-4641-b56c-055ba20d466c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:08:43 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-e584935a-cd52-4c86-b0eb-13d2f81c92e7 tempest-VolumesActionsTest-864365452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71e57506-7fc1-4641-b56c-055ba20d466c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '298c2771-cbf9-47fb-ae03-174525ba5571', 'volume_name': 'volume-298c2771-cbf9-47fb-ae03-174525ba5571', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:08:43 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-e584935a-cd52-4c86-b0eb-13d2f81c92e7 tempest-VolumesActionsTest-864365452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86167154-9945-41b4-8929-71de252a0a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:08:43 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-e584935a-cd52-4c86-b0eb-13d2f81c92e7 tempest-VolumesActionsTest-864365452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86167154-9945-41b4-8929-71de252a0a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:08:43 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-e584935a-cd52-4c86-b0eb-13d2f81c92e7 tempest-VolumesActionsTest-864365452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96f40d7d-8368-4c07-9101-1fc733fbb7ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:08:43 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-e584935a-cd52-4c86-b0eb-13d2f81c92e7 tempest-VolumesActionsTest-864365452 None] Volume 298c2771-cbf9-47fb-ae03-174525ba5571: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-298c2771-cbf9-47fb-ae03-174525ba5571', 'volume_size': 1} Aug 10 16:08:43 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-e584935a-cd52-4c86-b0eb-13d2f81c92e7 tempest-VolumesActionsTest-864365452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:08:43 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-e584935a-cd52-4c86-b0eb-13d2f81c92e7 tempest-VolumesActionsTest-864365452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:08:43 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-e584935a-cd52-4c86-b0eb-13d2f81c92e7 tempest-VolumesActionsTest-864365452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:08:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-954382793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=298c2771-cbf9-47fb-ae03-174525ba5571,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eafb4d9ba8a84c058ec84acb2d323dc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:08:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:08:43Z,use_quota=True,user_id='e8a88594ad49443da1eb134116ea9733',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:08:43 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-e584935a-cd52-4c86-b0eb-13d2f81c92e7 tempest-VolumesActionsTest-864365452 None] Creating volume 298c2771-cbf9-47fb-ae03-174525ba5571 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:08:43 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-e584935a-cd52-4c86-b0eb-13d2f81c92e7 tempest-VolumesActionsTest-864365452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:08:43 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-e584935a-cd52-4c86-b0eb-13d2f81c92e7 tempest-VolumesActionsTest-864365452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:08:43 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-e584935a-cd52-4c86-b0eb-13d2f81c92e7 tempest-VolumesActionsTest-864365452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:08:43 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-e584935a-cd52-4c86-b0eb-13d2f81c92e7 tempest-VolumesActionsTest-864365452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:08:43 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-e584935a-cd52-4c86-b0eb-13d2f81c92e7 tempest-VolumesActionsTest-864365452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:08:43 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-e584935a-cd52-4c86-b0eb-13d2f81c92e7 tempest-VolumesActionsTest-864365452 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:08:43 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-e584935a-cd52-4c86-b0eb-13d2f81c92e7 tempest-VolumesActionsTest-864365452 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:08:43 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e584935a-cd52-4c86-b0eb-13d2f81c92e7 tempest-VolumesActionsTest-864365452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-298c2771-cbf9-47fb-ae03-174525ba5571 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:08:43 devstack sudo[104722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-298c2771-cbf9-47fb-ae03-174525ba5571 1073741824 Aug 10 16:08:43 devstack sudo[104722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:08:43 devstack sudo[104722]: pam_unix(sudo:session): session closed for user root Aug 10 16:08:43 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e584935a-cd52-4c86-b0eb-13d2f81c92e7 tempest-VolumesActionsTest-864365452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-298c2771-cbf9-47fb-ae03-174525ba5571 1073741824" returned: 0 in 0.474s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:08:44 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e584935a-cd52-4c86-b0eb-13d2f81c92e7 tempest-VolumesActionsTest-864365452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-298c2771-cbf9-47fb-ae03-174525ba5571 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:08:44 devstack sudo[104728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-298c2771-cbf9-47fb-ae03-174525ba5571 Aug 10 16:08:44 devstack sudo[104728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:08:44 devstack sudo[104728]: pam_unix(sudo:session): session closed for user root Aug 10 16:08:44 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e584935a-cd52-4c86-b0eb-13d2f81c92e7 tempest-VolumesActionsTest-864365452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-298c2771-cbf9-47fb-ae03-174525ba5571" returned: 0 in 0.272s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:08:44 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-e584935a-cd52-4c86-b0eb-13d2f81c92e7 tempest-VolumesActionsTest-864365452 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:08:44 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-e584935a-cd52-4c86-b0eb-13d2f81c92e7 tempest-VolumesActionsTest-864365452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:08:44 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-e584935a-cd52-4c86-b0eb-13d2f81c92e7 tempest-VolumesActionsTest-864365452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96f40d7d-8368-4c07-9101-1fc733fbb7ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-298c2771-cbf9-47fb-ae03-174525ba5571', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:08:44 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-e584935a-cd52-4c86-b0eb-13d2f81c92e7 tempest-VolumesActionsTest-864365452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17bcdf72-5f2a-452d-873c-081fc69592c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:08:44 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-e584935a-cd52-4c86-b0eb-13d2f81c92e7 tempest-VolumesActionsTest-864365452 None] Volume volume-298c2771-cbf9-47fb-ae03-174525ba5571 (298c2771-cbf9-47fb-ae03-174525ba5571): created successfully Aug 10 16:08:44 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-e584935a-cd52-4c86-b0eb-13d2f81c92e7 tempest-VolumesActionsTest-864365452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17bcdf72-5f2a-452d-873c-081fc69592c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:08:44 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-e584935a-cd52-4c86-b0eb-13d2f81c92e7 tempest-VolumesActionsTest-864365452 None] Flow 'volume_create_manager' (0522f678-0717-477a-8cf1-c8f7842fd913) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:08:44 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-e584935a-cd52-4c86-b0eb-13d2f81c92e7 tempest-VolumesActionsTest-864365452 None] Created volume successfully. Aug 10 16:08:49 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a391571-4d4b-4fc4-aa6f-4824578c6b42 tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:08:49 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-0a391571-4d4b-4fc4-aa6f-4824578c6b42 tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] Flow 'volume_create_manager' (4a104412-bf51-47b9-be6a-cc95ac0ffa4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:08:49 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-0a391571-4d4b-4fc4-aa6f-4824578c6b42 tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0e90b2f-2484-4380-a956-06de261255c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:08:49 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-0a391571-4d4b-4fc4-aa6f-4824578c6b42 tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0e90b2f-2484-4380-a956-06de261255c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:08:49Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=297e664c-4c1e-4d61-b72b-716fd3bb7fb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7e37808dcf240b488ec5e39e419073a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:08:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:08:49Z,use_quota=True,user_id='26cfcc16056946c0a8751af0c7d5e7fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(19f106e6-25e0-41c9-ad3b-1c7162a207da),volume_type_id=19f106e6-25e0-41c9-ad3b-1c7162a207da)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:08:49 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-0a391571-4d4b-4fc4-aa6f-4824578c6b42 tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07a85c87-1616-4950-b0bd-e2cc101be524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:08:49 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-0a391571-4d4b-4fc4-aa6f-4824578c6b42 tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07a85c87-1616-4950-b0bd-e2cc101be524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:08:49 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-0a391571-4d4b-4fc4-aa6f-4824578c6b42 tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05e2493c-ac42-49b0-97f5-a9c7cd690deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:08:49 devstack cinder-volume[88641]: DEBUG cinder.image.glance [None req-0a391571-4d4b-4fc4-aa6f-4824578c6b42 tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] Creating Keystone auth plugin from conf {{(pid=88641) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 10 16:08:49 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-0a391571-4d4b-4fc4-aa6f-4824578c6b42 tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05e2493c-ac42-49b0-97f5-a9c7cd690deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '297e664c-4c1e-4d61-b72b-716fd3bb7fb8', 'volume_name': 'volume-297e664c-4c1e-4d61-b72b-716fd3bb7fb8', 'volume_size': 1, 'image_id': 'e00fae29-45bd-4626-b513-4617dc92c4ab', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e00fae29-45bd-4626-b513-4617dc92c4ab', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'aa6479bbc38d4e67718a9d778c66e0f7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f7e37808dcf240b488ec5e39e419073a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '22039558d97eb18301847998163f01342b70fb4b83fc41e3d1b0c0fa84885ab50aa31472bc98c9d67e4b6b4bb6587a6ae2691ca76466109ed492de4691800560', 'id': 'e00fae29-45bd-4626-b513-4617dc92c4ab', 'created_at': datetime.datetime(2026, 8, 10, 14, 8, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 10, 14, 8, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e00fae29-45bd-4626-b513-4617dc92c4ab/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:08:49 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-0a391571-4d4b-4fc4-aa6f-4824578c6b42 tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12670969-fb61-4fad-adfe-0f498a5764c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:08:49 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-0a391571-4d4b-4fc4-aa6f-4824578c6b42 tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12670969-fb61-4fad-adfe-0f498a5764c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:08:49 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-0a391571-4d4b-4fc4-aa6f-4824578c6b42 tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8517d159-8fec-423b-b128-8ce2e814c76e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:08:49 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-0a391571-4d4b-4fc4-aa6f-4824578c6b42 tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] Volume 297e664c-4c1e-4d61-b72b-716fd3bb7fb8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-297e664c-4c1e-4d61-b72b-716fd3bb7fb8', 'volume_size': 1, 'image_id': 'e00fae29-45bd-4626-b513-4617dc92c4ab', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e00fae29-45bd-4626-b513-4617dc92c4ab', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'aa6479bbc38d4e67718a9d778c66e0f7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f7e37808dcf240b488ec5e39e419073a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '22039558d97eb18301847998163f01342b70fb4b83fc41e3d1b0c0fa84885ab50aa31472bc98c9d67e4b6b4bb6587a6ae2691ca76466109ed492de4691800560', 'id': 'e00fae29-45bd-4626-b513-4617dc92c4ab', 'created_at': datetime.datetime(2026, 8, 10, 14, 8, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 10, 14, 8, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e00fae29-45bd-4626-b513-4617dc92c4ab/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Aug 10 16:08:49 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a391571-4d4b-4fc4-aa6f-4824578c6b42 tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] Trying to clone 297e664c-4c1e-4d61-b72b-716fd3bb7fb8 from image e00fae29-45bd-4626-b513-4617dc92c4ab at location (None, [{'url': 'file:///opt/stack/data/glance/images/e00fae29-45bd-4626-b513-4617dc92c4ab', 'metadata': {}}]). {{(pid=88641) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 10 16:08:49 devstack cinder-volume[88641]: DEBUG cinder.image.image_utils [None req-0a391571-4d4b-4fc4-aa6f-4824578c6b42 tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e00fae29-45bd-4626-b513-4617dc92c4ab_mu8mq7gydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88641) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 10 16:08:49 devstack cinder-volume[88641]: INFO cinder.image.image_utils [None req-0a391571-4d4b-4fc4-aa6f-4824578c6b42 tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] Image download 0.00 MB at 0.00 MB/s Aug 10 16:08:49 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a593d02-1d91-447d-8d21-a12a4ddf0edb]: (4, 'raw') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:08:49 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0a391571-4d4b-4fc4-aa6f-4824578c6b42 tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e00fae29-45bd-4626-b513-4617dc92c4ab_mu8mq7gydevstack@QuobyteHD {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:08:49 devstack sudo[104753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e00fae29-45bd-4626-b513-4617dc92c4ab_mu8mq7gydevstack@QuobyteHD Aug 10 16:08:49 devstack sudo[104753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:08:49 devstack sudo[104753]: pam_unix(sudo:session): session closed for user root Aug 10 16:08:49 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0a391571-4d4b-4fc4-aa6f-4824578c6b42 tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e00fae29-45bd-4626-b513-4617dc92c4ab_mu8mq7gydevstack@QuobyteHD" returned: 0 in 0.359s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:08:49 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0a391571-4d4b-4fc4-aa6f-4824578c6b42 tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e00fae29-45bd-4626-b513-4617dc92c4ab_mu8mq7gydevstack@QuobyteHD {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:08:50 devstack sudo[104757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e00fae29-45bd-4626-b513-4617dc92c4ab_mu8mq7gydevstack@QuobyteHD Aug 10 16:08:50 devstack sudo[104757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:08:50 devstack sudo[104757]: pam_unix(sudo:session): session closed for user root Aug 10 16:08:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0a391571-4d4b-4fc4-aa6f-4824578c6b42 tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e00fae29-45bd-4626-b513-4617dc92c4ab_mu8mq7gydevstack@QuobyteHD" returned: 1 in 0.655s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:08:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0a391571-4d4b-4fc4-aa6f-4824578c6b42 tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e00fae29-45bd-4626-b513-4617dc92c4ab_mu8mq7gydevstack@QuobyteHD' failed. Not Retrying. {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 10 16:08:50 devstack cinder-volume[88641]: DEBUG cinder.image.image_utils [None req-0a391571-4d4b-4fc4-aa6f-4824578c6b42 tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] Temporary image e00fae29-45bd-4626-b513-4617dc92c4ab is fetched for user 26cfcc16056946c0a8751af0c7d5e7fc. {{(pid=88641) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 10 16:08:50 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f36fb1-fd5b-4186-b599-5e4db79f32ab]: (4, 'raw') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:08:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0a391571-4d4b-4fc4-aa6f-4824578c6b42 tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e00fae29-45bd-4626-b513-4617dc92c4ab_mu8mq7gydevstack@QuobyteHD {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:08:50 devstack sudo[104804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e00fae29-45bd-4626-b513-4617dc92c4ab_mu8mq7gydevstack@QuobyteHD Aug 10 16:08:50 devstack sudo[104804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:08:51 devstack sudo[104804]: pam_unix(sudo:session): session closed for user root Aug 10 16:08:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0a391571-4d4b-4fc4-aa6f-4824578c6b42 tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e00fae29-45bd-4626-b513-4617dc92c4ab_mu8mq7gydevstack@QuobyteHD" returned: 0 in 0.496s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:08:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0a391571-4d4b-4fc4-aa6f-4824578c6b42 tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e00fae29-45bd-4626-b513-4617dc92c4ab_mu8mq7gydevstack@QuobyteHD {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:08:51 devstack sudo[104829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e00fae29-45bd-4626-b513-4617dc92c4ab_mu8mq7gydevstack@QuobyteHD Aug 10 16:08:51 devstack sudo[104829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:08:51 devstack sudo[104829]: pam_unix(sudo:session): session closed for user root Aug 10 16:08:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0a391571-4d4b-4fc4-aa6f-4824578c6b42 tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e00fae29-45bd-4626-b513-4617dc92c4ab_mu8mq7gydevstack@QuobyteHD" returned: 1 in 0.376s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:08:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0a391571-4d4b-4fc4-aa6f-4824578c6b42 tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e00fae29-45bd-4626-b513-4617dc92c4ab_mu8mq7gydevstack@QuobyteHD' failed. Not Retrying. {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 10 16:08:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-0a391571-4d4b-4fc4-aa6f-4824578c6b42 tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:08:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-0a391571-4d4b-4fc4-aa6f-4824578c6b42 tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:08:51 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-0a391571-4d4b-4fc4-aa6f-4824578c6b42 tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:08:49Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=297e664c-4c1e-4d61-b72b-716fd3bb7fb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7e37808dcf240b488ec5e39e419073a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:08:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:08:49Z,use_quota=True,user_id='26cfcc16056946c0a8751af0c7d5e7fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(19f106e6-25e0-41c9-ad3b-1c7162a207da),volume_type_id=19f106e6-25e0-41c9-ad3b-1c7162a207da)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:08:51 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-0a391571-4d4b-4fc4-aa6f-4824578c6b42 tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] Creating volume 297e664c-4c1e-4d61-b72b-716fd3bb7fb8 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:08:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-0a391571-4d4b-4fc4-aa6f-4824578c6b42 tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:08:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-0a391571-4d4b-4fc4-aa6f-4824578c6b42 tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:08:51 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-0a391571-4d4b-4fc4-aa6f-4824578c6b42 tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:08:51 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-0a391571-4d4b-4fc4-aa6f-4824578c6b42 tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:08:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-0a391571-4d4b-4fc4-aa6f-4824578c6b42 tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:08:51 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-0a391571-4d4b-4fc4-aa6f-4824578c6b42 tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:08:51 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-0a391571-4d4b-4fc4-aa6f-4824578c6b42 tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:08:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0a391571-4d4b-4fc4-aa6f-4824578c6b42 tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-297e664c-4c1e-4d61-b72b-716fd3bb7fb8 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:08:51 devstack sudo[104851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-297e664c-4c1e-4d61-b72b-716fd3bb7fb8 1073741824 Aug 10 16:08:51 devstack sudo[104851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:08:52 devstack sudo[104851]: pam_unix(sudo:session): session closed for user root Aug 10 16:08:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0a391571-4d4b-4fc4-aa6f-4824578c6b42 tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-297e664c-4c1e-4d61-b72b-716fd3bb7fb8 1073741824" returned: 0 in 0.467s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:08:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0a391571-4d4b-4fc4-aa6f-4824578c6b42 tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-297e664c-4c1e-4d61-b72b-716fd3bb7fb8 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:08:52 devstack sudo[104857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-297e664c-4c1e-4d61-b72b-716fd3bb7fb8 Aug 10 16:08:52 devstack sudo[104857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:08:52 devstack sudo[104857]: pam_unix(sudo:session): session closed for user root Aug 10 16:08:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0a391571-4d4b-4fc4-aa6f-4824578c6b42 tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-297e664c-4c1e-4d61-b72b-716fd3bb7fb8" returned: 0 in 0.316s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:08:52 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-0a391571-4d4b-4fc4-aa6f-4824578c6b42 tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:08:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-0a391571-4d4b-4fc4-aa6f-4824578c6b42 tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:08:52 devstack cinder-volume[88641]: DEBUG cinder.volume.volume_utils [None req-0a391571-4d4b-4fc4-aa6f-4824578c6b42 tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] Attempting download of e00fae29-45bd-4626-b513-4617dc92c4ab ((None, [{'url': 'file:///opt/stack/data/glance/images/e00fae29-45bd-4626-b513-4617dc92c4ab', 'metadata': {}}])) to volume 297e664c-4c1e-4d61-b72b-716fd3bb7fb8. {{(pid=88641) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 10 16:08:52 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef504826-7574-4553-a4a4-ef04b5e01501]: (4, 'raw') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:08:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0a391571-4d4b-4fc4-aa6f-4824578c6b42 tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e00fae29-45bd-4626-b513-4617dc92c4ab_alf7m3pq {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:08:52 devstack sudo[104863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e00fae29-45bd-4626-b513-4617dc92c4ab_alf7m3pq Aug 10 16:08:52 devstack sudo[104863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:08:52 devstack sudo[104863]: pam_unix(sudo:session): session closed for user root Aug 10 16:08:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0a391571-4d4b-4fc4-aa6f-4824578c6b42 tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e00fae29-45bd-4626-b513-4617dc92c4ab_alf7m3pq" returned: 0 in 0.416s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:08:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0a391571-4d4b-4fc4-aa6f-4824578c6b42 tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e00fae29-45bd-4626-b513-4617dc92c4ab_alf7m3pq {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:08:53 devstack sudo[104867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e00fae29-45bd-4626-b513-4617dc92c4ab_alf7m3pq Aug 10 16:08:53 devstack sudo[104867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:08:53 devstack sudo[104867]: pam_unix(sudo:session): session closed for user root Aug 10 16:08:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0a391571-4d4b-4fc4-aa6f-4824578c6b42 tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e00fae29-45bd-4626-b513-4617dc92c4ab_alf7m3pq" returned: 1 in 0.362s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:08:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0a391571-4d4b-4fc4-aa6f-4824578c6b42 tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e00fae29-45bd-4626-b513-4617dc92c4ab_alf7m3pq' failed. Not Retrying. {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 10 16:08:53 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc824d0f-0ed9-49e1-ac55-713d1190a286]: (4, 'raw') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:08:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0a391571-4d4b-4fc4-aa6f-4824578c6b42 tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e00fae29-45bd-4626-b513-4617dc92c4ab_mu8mq7gydevstack@QuobyteHD {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:08:53 devstack sudo[104871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e00fae29-45bd-4626-b513-4617dc92c4ab_mu8mq7gydevstack@QuobyteHD Aug 10 16:08:53 devstack sudo[104871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:08:53 devstack sudo[104871]: pam_unix(sudo:session): session closed for user root Aug 10 16:08:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0a391571-4d4b-4fc4-aa6f-4824578c6b42 tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e00fae29-45bd-4626-b513-4617dc92c4ab_mu8mq7gydevstack@QuobyteHD" returned: 0 in 0.344s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:08:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0a391571-4d4b-4fc4-aa6f-4824578c6b42 tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e00fae29-45bd-4626-b513-4617dc92c4ab_mu8mq7gydevstack@QuobyteHD {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:08:53 devstack sudo[104875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e00fae29-45bd-4626-b513-4617dc92c4ab_mu8mq7gydevstack@QuobyteHD Aug 10 16:08:53 devstack sudo[104875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:08:53 devstack sudo[104875]: pam_unix(sudo:session): session closed for user root Aug 10 16:08:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0a391571-4d4b-4fc4-aa6f-4824578c6b42 tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e00fae29-45bd-4626-b513-4617dc92c4ab_mu8mq7gydevstack@QuobyteHD" returned: 1 in 0.363s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:08:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0a391571-4d4b-4fc4-aa6f-4824578c6b42 tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e00fae29-45bd-4626-b513-4617dc92c4ab_mu8mq7gydevstack@QuobyteHD' failed. Not Retrying. {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 10 16:08:53 devstack cinder-volume[88641]: DEBUG cinder.image.image_utils [None req-0a391571-4d4b-4fc4-aa6f-4824578c6b42 tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] e00fae29-45bd-4626-b513-4617dc92c4ab was raw, converting to qcow2 {{(pid=88641) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 10 16:08:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0a391571-4d4b-4fc4-aa6f-4824578c6b42 tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e00fae29-45bd-4626-b513-4617dc92c4ab_mu8mq7gydevstack@QuobyteHD /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-297e664c-4c1e-4d61-b72b-716fd3bb7fb8 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:08:54 devstack sudo[104880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e00fae29-45bd-4626-b513-4617dc92c4ab_mu8mq7gydevstack@QuobyteHD /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-297e664c-4c1e-4d61-b72b-716fd3bb7fb8 Aug 10 16:08:54 devstack sudo[104880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:08:54 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-01218b4b-ab6c-4a39-955d-2d22345cc2f4 tempest-VolumesActionsTest-864365452 None] Acquiring lock "cinder-298c2771-cbf9-47fb-ae03-174525ba5571" by "attach_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:08:54 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-01218b4b-ab6c-4a39-955d-2d22345cc2f4 tempest-VolumesActionsTest-864365452 None] Lock "cinder-298c2771-cbf9-47fb-ae03-174525ba5571" acquired by "attach_volume" :: waited 0.026s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:08:54 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-01218b4b-ab6c-4a39-955d-2d22345cc2f4 tempest-VolumesActionsTest-864365452 None] Attaching volume 298c2771-cbf9-47fb-ae03-174525ba5571 to instance fa88a35d-83a5-4a00-bfba-93ec1668157b at mountpoint /dev/vdb on host None. Aug 10 16:08:54 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-01218b4b-ab6c-4a39-955d-2d22345cc2f4 tempest-VolumesActionsTest-864365452 None] Attach volume completed successfully. Aug 10 16:08:54 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-01218b4b-ab6c-4a39-955d-2d22345cc2f4 tempest-VolumesActionsTest-864365452 None] Lock "cinder-298c2771-cbf9-47fb-ae03-174525ba5571" released by "attach_volume" :: held 0.141s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:08:54 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-95ec2918-04cf-445c-b44b-dcb30faa0d66 tempest-VolumesActionsTest-864365452 None] Acquiring lock "cinder-298c2771-cbf9-47fb-ae03-174525ba5571-detach_volume" by "detach_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:08:54 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-95ec2918-04cf-445c-b44b-dcb30faa0d66 tempest-VolumesActionsTest-864365452 None] Lock "cinder-298c2771-cbf9-47fb-ae03-174525ba5571-detach_volume" acquired by "detach_volume" :: waited 0.019s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:08:54 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-95ec2918-04cf-445c-b44b-dcb30faa0d66 tempest-VolumesActionsTest-864365452 None] Detaching volume 298c2771-cbf9-47fb-ae03-174525ba5571 from instance fa88a35d-83a5-4a00-bfba-93ec1668157b. Aug 10 16:08:54 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-95ec2918-04cf-445c-b44b-dcb30faa0d66 tempest-VolumesActionsTest-864365452 None] Detach volume completed successfully. Aug 10 16:08:54 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-95ec2918-04cf-445c-b44b-dcb30faa0d66 tempest-VolumesActionsTest-864365452 None] Lock "cinder-298c2771-cbf9-47fb-ae03-174525ba5571-detach_volume" released by "detach_volume" :: held 0.076s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:08:54 devstack sudo[104880]: pam_unix(sudo:session): session closed for user root Aug 10 16:08:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0a391571-4d4b-4fc4-aa6f-4824578c6b42 tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e00fae29-45bd-4626-b513-4617dc92c4ab_mu8mq7gydevstack@QuobyteHD /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-297e664c-4c1e-4d61-b72b-716fd3bb7fb8" returned: 0 in 0.674s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:08:54 devstack cinder-volume[88641]: DEBUG cinder.image.image_utils [None req-0a391571-4d4b-4fc4-aa6f-4824578c6b42 tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e00fae29-45bd-4626-b513-4617dc92c4ab_mu8mq7gydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-297e664c-4c1e-4d61-b72b-716fd3bb7fb8 {{(pid=88641) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 10 16:08:54 devstack cinder-volume[88641]: INFO cinder.image.image_utils [None req-0a391571-4d4b-4fc4-aa6f-4824578c6b42 tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] Converted 0.00 MB image at 0.00 MB/s Aug 10 16:08:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0a391571-4d4b-4fc4-aa6f-4824578c6b42 tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-297e664c-4c1e-4d61-b72b-716fd3bb7fb8 1G {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:08:54 devstack sudo[104885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-297e664c-4c1e-4d61-b72b-716fd3bb7fb8 1G Aug 10 16:08:54 devstack sudo[104885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:08:55 devstack sudo[104885]: pam_unix(sudo:session): session closed for user root Aug 10 16:08:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0a391571-4d4b-4fc4-aa6f-4824578c6b42 tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-297e664c-4c1e-4d61-b72b-716fd3bb7fb8 1G" returned: 0 in 0.456s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:08:55 devstack cinder-volume[88641]: DEBUG cinder.volume.volume_utils [None req-0a391571-4d4b-4fc4-aa6f-4824578c6b42 tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] Downloaded image e00fae29-45bd-4626-b513-4617dc92c4ab ((None, [{'url': 'file:///opt/stack/data/glance/images/e00fae29-45bd-4626-b513-4617dc92c4ab', 'metadata': {}}])) to volume 297e664c-4c1e-4d61-b72b-716fd3bb7fb8 successfully. {{(pid=88641) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 10 16:08:55 devstack cinder-volume[88641]: DEBUG cinder.image.image_utils [None req-0a391571-4d4b-4fc4-aa6f-4824578c6b42 tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] Temporary image e00fae29-45bd-4626-b513-4617dc92c4ab for user 26cfcc16056946c0a8751af0c7d5e7fc is deleted. {{(pid=88641) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 10 16:08:55 devstack cinder-volume[88641]: DEBUG cinder.volume.volume_utils [None req-0a391571-4d4b-4fc4-aa6f-4824578c6b42 tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] Marking volume 297e664c-4c1e-4d61-b72b-716fd3bb7fb8 as bootable. {{(pid=88641) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 10 16:08:55 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a391571-4d4b-4fc4-aa6f-4824578c6b42 tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] Copying metadata from image e00fae29-45bd-4626-b513-4617dc92c4ab to 297e664c-4c1e-4d61-b72b-716fd3bb7fb8. {{(pid=88641) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 10 16:08:55 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a391571-4d4b-4fc4-aa6f-4824578c6b42 tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] Creating volume glance metadata for volume 297e664c-4c1e-4d61-b72b-716fd3bb7fb8 backed by image e00fae29-45bd-4626-b513-4617dc92c4ab with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'e00fae29-45bd-4626-b513-4617dc92c4ab', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'aa6479bbc38d4e67718a9d778c66e0f7', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88641) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 10 16:08:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-0a391571-4d4b-4fc4-aa6f-4824578c6b42 tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8517d159-8fec-423b-b128-8ce2e814c76e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-297e664c-4c1e-4d61-b72b-716fd3bb7fb8', 'volume_size': 1, 'image_id': 'e00fae29-45bd-4626-b513-4617dc92c4ab', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e00fae29-45bd-4626-b513-4617dc92c4ab', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'aa6479bbc38d4e67718a9d778c66e0f7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f7e37808dcf240b488ec5e39e419073a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '22039558d97eb18301847998163f01342b70fb4b83fc41e3d1b0c0fa84885ab50aa31472bc98c9d67e4b6b4bb6587a6ae2691ca76466109ed492de4691800560', 'id': 'e00fae29-45bd-4626-b513-4617dc92c4ab', 'created_at': datetime.datetime(2026, 8, 10, 14, 8, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 10, 14, 8, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e00fae29-45bd-4626-b513-4617dc92c4ab/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:08:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-0a391571-4d4b-4fc4-aa6f-4824578c6b42 tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa59c767-e6ad-42e0-b7ce-4b6c33c8e8ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:08:55 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-0a391571-4d4b-4fc4-aa6f-4824578c6b42 tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] Volume volume-297e664c-4c1e-4d61-b72b-716fd3bb7fb8 (297e664c-4c1e-4d61-b72b-716fd3bb7fb8): created successfully Aug 10 16:08:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-0a391571-4d4b-4fc4-aa6f-4824578c6b42 tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa59c767-e6ad-42e0-b7ce-4b6c33c8e8ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:08:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-0a391571-4d4b-4fc4-aa6f-4824578c6b42 tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] Flow 'volume_create_manager' (4a104412-bf51-47b9-be6a-cc95ac0ffa4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:08:55 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-0a391571-4d4b-4fc4-aa6f-4824578c6b42 tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] Created volume successfully. Aug 10 16:08:55 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-3276c638-637a-47c9-868e-1330417b99ce tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] Acquiring lock "cinder-297e664c-4c1e-4d61-b72b-716fd3bb7fb8-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:08:55 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-3276c638-637a-47c9-868e-1330417b99ce tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] Lock "cinder-297e664c-4c1e-4d61-b72b-716fd3bb7fb8-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:08:55 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-3276c638-637a-47c9-868e-1330417b99ce tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] Acquiring lock "cinder-quobyte-297e664c-4c1e-4d61-b72b-716fd3bb7fb8" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:08:55 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-3276c638-637a-47c9-868e-1330417b99ce tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] Lock "cinder-quobyte-297e664c-4c1e-4d61-b72b-716fd3bb7fb8" acquired by "delete_volume" :: waited 0.024s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:08:55 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[e486781f-c564-47f0-b776-e6f326827fa4]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:08:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-3276c638-637a-47c9-868e-1330417b99ce tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-297e664c-4c1e-4d61-b72b-716fd3bb7fb8 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:08:55 devstack sudo[104949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-297e664c-4c1e-4d61-b72b-716fd3bb7fb8 Aug 10 16:08:55 devstack sudo[104949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:08:56 devstack sudo[104949]: pam_unix(sudo:session): session closed for user root Aug 10 16:08:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-3276c638-637a-47c9-868e-1330417b99ce tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-297e664c-4c1e-4d61-b72b-716fd3bb7fb8" returned: 0 in 0.562s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:08:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-3276c638-637a-47c9-868e-1330417b99ce tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-297e664c-4c1e-4d61-b72b-716fd3bb7fb8 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:08:56 devstack sudo[104959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-297e664c-4c1e-4d61-b72b-716fd3bb7fb8 Aug 10 16:08:56 devstack sudo[104959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:08:56 devstack sudo[104959]: pam_unix(sudo:session): session closed for user root Aug 10 16:08:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-3276c638-637a-47c9-868e-1330417b99ce tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-297e664c-4c1e-4d61-b72b-716fd3bb7fb8" returned: 0 in 0.331s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:08:56 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-3276c638-637a-47c9-868e-1330417b99ce tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] Lock "cinder-quobyte-297e664c-4c1e-4d61-b72b-716fd3bb7fb8" released by "delete_volume" :: held 0.967s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:08:56 devstack cinder-volume[88641]: WARNING cinder.quota [None req-3276c638-637a-47c9-868e-1330417b99ce tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Aug 10 16:08:56 devstack cinder-volume[88641]: WARNING cinder.quota [None req-3276c638-637a-47c9-868e-1330417b99ce tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Aug 10 16:08:56 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-3276c638-637a-47c9-868e-1330417b99ce tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] Created reservations ['ff189216-7fd8-4471-b3c1-aeb92c9f2c20', '1188b9f1-0e5f-40c0-8fd1-043c630ffbad', 'e79c7efb-9a12-4134-8e7d-fe808dd54f5a', 'a4937622-1d8c-49bc-aba5-f5cd318d0f19'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:08:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-3276c638-637a-47c9-868e-1330417b99ce tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:08:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-3276c638-637a-47c9-868e-1330417b99ce tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:08:56 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-3276c638-637a-47c9-868e-1330417b99ce tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:08:56 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-3276c638-637a-47c9-868e-1330417b99ce tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:08:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-3276c638-637a-47c9-868e-1330417b99ce tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:08:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-3276c638-637a-47c9-868e-1330417b99ce tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:08:56 devstack sudo[104963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:08:56 devstack sudo[104963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:08:57 devstack sudo[104963]: pam_unix(sudo:session): session closed for user root Aug 10 16:08:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-3276c638-637a-47c9-868e-1330417b99ce tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.264s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:08:57 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-3276c638-637a-47c9-868e-1330417b99ce tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:08:57 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-3276c638-637a-47c9-868e-1330417b99ce tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] Deleted volume successfully. Aug 10 16:08:57 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-3276c638-637a-47c9-868e-1330417b99ce tempest-VolumeAndVolumeTypeFromImageTest-409535144 None] Lock "cinder-297e664c-4c1e-4d61-b72b-716fd3bb7fb8-delete_volume" released by "delete_volume" :: held 1.501s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:09:01 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-db0af770-62d9-478f-8f50-80bbaf80a9f6 tempest-CinderUnicodeTest-2009046431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:09:01 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-db0af770-62d9-478f-8f50-80bbaf80a9f6 tempest-CinderUnicodeTest-2009046431 None] Flow 'volume_create_manager' (d1d422a3-c954-40d1-a710-112751190787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:09:01 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-db0af770-62d9-478f-8f50-80bbaf80a9f6 tempest-CinderUnicodeTest-2009046431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6c08bf5-d4d7-4f4f-a15e-5713ede29353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:09:02 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-db0af770-62d9-478f-8f50-80bbaf80a9f6 tempest-CinderUnicodeTest-2009046431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6c08bf5-d4d7-4f4f-a15e-5713ede29353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:09:02Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a2ceb01-ff53-4288-943e-aa733bbd075f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d42435f9ec9b49169290741d1343962e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:09:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:09:02Z,use_quota=True,user_id='5003e06db2d44cc0af0ec83fae4df6a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:09:02 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-db0af770-62d9-478f-8f50-80bbaf80a9f6 tempest-CinderUnicodeTest-2009046431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a90d4515-f636-49d8-8e1c-bac655605258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:09:02 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-db0af770-62d9-478f-8f50-80bbaf80a9f6 tempest-CinderUnicodeTest-2009046431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a90d4515-f636-49d8-8e1c-bac655605258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:09:02 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-db0af770-62d9-478f-8f50-80bbaf80a9f6 tempest-CinderUnicodeTest-2009046431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be04fa7c-3de9-4a84-843b-46089cec846c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:09:02 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-db0af770-62d9-478f-8f50-80bbaf80a9f6 tempest-CinderUnicodeTest-2009046431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be04fa7c-3de9-4a84-843b-46089cec846c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a2ceb01-ff53-4288-943e-aa733bbd075f', 'volume_name': 'volume-2a2ceb01-ff53-4288-943e-aa733bbd075f', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:09:02 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-db0af770-62d9-478f-8f50-80bbaf80a9f6 tempest-CinderUnicodeTest-2009046431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff753f2a-f1c9-4d10-895a-100d4d239c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:09:02 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-db0af770-62d9-478f-8f50-80bbaf80a9f6 tempest-CinderUnicodeTest-2009046431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff753f2a-f1c9-4d10-895a-100d4d239c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:09:02 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-db0af770-62d9-478f-8f50-80bbaf80a9f6 tempest-CinderUnicodeTest-2009046431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17fd336d-03bd-42ec-ac86-16ae96c4b077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:09:02 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-db0af770-62d9-478f-8f50-80bbaf80a9f6 tempest-CinderUnicodeTest-2009046431 None] Volume 2a2ceb01-ff53-4288-943e-aa733bbd075f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a2ceb01-ff53-4288-943e-aa733bbd075f', 'volume_size': 1} Aug 10 16:09:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-db0af770-62d9-478f-8f50-80bbaf80a9f6 tempest-CinderUnicodeTest-2009046431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:09:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-db0af770-62d9-478f-8f50-80bbaf80a9f6 tempest-CinderUnicodeTest-2009046431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:09:02 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-db0af770-62d9-478f-8f50-80bbaf80a9f6 tempest-CinderUnicodeTest-2009046431 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:09:02Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a2ceb01-ff53-4288-943e-aa733bbd075f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d42435f9ec9b49169290741d1343962e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:09:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:09:02Z,use_quota=True,user_id='5003e06db2d44cc0af0ec83fae4df6a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:09:02 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-db0af770-62d9-478f-8f50-80bbaf80a9f6 tempest-CinderUnicodeTest-2009046431 None] Creating volume 2a2ceb01-ff53-4288-943e-aa733bbd075f {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:09:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-db0af770-62d9-478f-8f50-80bbaf80a9f6 tempest-CinderUnicodeTest-2009046431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:09:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-db0af770-62d9-478f-8f50-80bbaf80a9f6 tempest-CinderUnicodeTest-2009046431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:09:02 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-db0af770-62d9-478f-8f50-80bbaf80a9f6 tempest-CinderUnicodeTest-2009046431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:09:02 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-db0af770-62d9-478f-8f50-80bbaf80a9f6 tempest-CinderUnicodeTest-2009046431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:09:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-db0af770-62d9-478f-8f50-80bbaf80a9f6 tempest-CinderUnicodeTest-2009046431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:09:02 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-db0af770-62d9-478f-8f50-80bbaf80a9f6 tempest-CinderUnicodeTest-2009046431 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:09:02 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-db0af770-62d9-478f-8f50-80bbaf80a9f6 tempest-CinderUnicodeTest-2009046431 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:09:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-db0af770-62d9-478f-8f50-80bbaf80a9f6 tempest-CinderUnicodeTest-2009046431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2a2ceb01-ff53-4288-943e-aa733bbd075f 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:09:02 devstack sudo[104986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2a2ceb01-ff53-4288-943e-aa733bbd075f 1073741824 Aug 10 16:09:02 devstack sudo[104986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:09:02 devstack sudo[104986]: pam_unix(sudo:session): session closed for user root Aug 10 16:09:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-db0af770-62d9-478f-8f50-80bbaf80a9f6 tempest-CinderUnicodeTest-2009046431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2a2ceb01-ff53-4288-943e-aa733bbd075f 1073741824" returned: 0 in 0.681s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:09:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-db0af770-62d9-478f-8f50-80bbaf80a9f6 tempest-CinderUnicodeTest-2009046431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2a2ceb01-ff53-4288-943e-aa733bbd075f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:09:02 devstack sudo[105008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2a2ceb01-ff53-4288-943e-aa733bbd075f Aug 10 16:09:02 devstack sudo[105008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:09:03 devstack sudo[105008]: pam_unix(sudo:session): session closed for user root Aug 10 16:09:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-db0af770-62d9-478f-8f50-80bbaf80a9f6 tempest-CinderUnicodeTest-2009046431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2a2ceb01-ff53-4288-943e-aa733bbd075f" returned: 0 in 0.444s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:09:03 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-db0af770-62d9-478f-8f50-80bbaf80a9f6 tempest-CinderUnicodeTest-2009046431 None] <== create_volume: return (1207ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:09:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-db0af770-62d9-478f-8f50-80bbaf80a9f6 tempest-CinderUnicodeTest-2009046431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.216s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:09:03 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-db0af770-62d9-478f-8f50-80bbaf80a9f6 tempest-CinderUnicodeTest-2009046431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17fd336d-03bd-42ec-ac86-16ae96c4b077) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a2ceb01-ff53-4288-943e-aa733bbd075f', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:09:03 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-db0af770-62d9-478f-8f50-80bbaf80a9f6 tempest-CinderUnicodeTest-2009046431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31c1358c-7cd6-4a6a-9082-8bc9894b21db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:09:03 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-db0af770-62d9-478f-8f50-80bbaf80a9f6 tempest-CinderUnicodeTest-2009046431 None] Volume volume-2a2ceb01-ff53-4288-943e-aa733bbd075f (2a2ceb01-ff53-4288-943e-aa733bbd075f): created successfully Aug 10 16:09:03 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-db0af770-62d9-478f-8f50-80bbaf80a9f6 tempest-CinderUnicodeTest-2009046431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31c1358c-7cd6-4a6a-9082-8bc9894b21db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:09:03 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-db0af770-62d9-478f-8f50-80bbaf80a9f6 tempest-CinderUnicodeTest-2009046431 None] Flow 'volume_create_manager' (d1d422a3-c954-40d1-a710-112751190787) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:09:03 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-db0af770-62d9-478f-8f50-80bbaf80a9f6 tempest-CinderUnicodeTest-2009046431 None] Created volume successfully. Aug 10 16:09:04 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-14953da1-a398-4f95-9c51-f82ea176be21 tempest-CinderUnicodeTest-2009046431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:09:04 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-14953da1-a398-4f95-9c51-f82ea176be21 tempest-CinderUnicodeTest-2009046431 None] Flow 'volume_create_manager' (cba58e14-0c88-4240-90f7-dfe6dd2b7947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:09:04 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-14953da1-a398-4f95-9c51-f82ea176be21 tempest-CinderUnicodeTest-2009046431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fef923ae-952e-4541-bb34-4ed7f5fae60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:09:04 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-14953da1-a398-4f95-9c51-f82ea176be21 tempest-CinderUnicodeTest-2009046431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fef923ae-952e-4541-bb34-4ed7f5fae60f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:09:04Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-947544828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23e76c50-0db4-406f-ae6b-c4cc7f8e93ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d42435f9ec9b49169290741d1343962e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:09:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:09:05Z,use_quota=True,user_id='5003e06db2d44cc0af0ec83fae4df6a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:09:04 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-14953da1-a398-4f95-9c51-f82ea176be21 tempest-CinderUnicodeTest-2009046431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (945489d5-e97c-4afe-8dea-5962cf31bcd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:09:04 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-14953da1-a398-4f95-9c51-f82ea176be21 tempest-CinderUnicodeTest-2009046431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (945489d5-e97c-4afe-8dea-5962cf31bcd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:09:04 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-14953da1-a398-4f95-9c51-f82ea176be21 tempest-CinderUnicodeTest-2009046431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91682b8a-0f8c-412f-9530-b534bcd328a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:09:04 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-14953da1-a398-4f95-9c51-f82ea176be21 tempest-CinderUnicodeTest-2009046431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91682b8a-0f8c-412f-9530-b534bcd328a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23e76c50-0db4-406f-ae6b-c4cc7f8e93ba', 'volume_name': 'volume-23e76c50-0db4-406f-ae6b-c4cc7f8e93ba', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:09:04 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-14953da1-a398-4f95-9c51-f82ea176be21 tempest-CinderUnicodeTest-2009046431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (769b1edf-e0b1-421a-825e-5b0fa6240554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:09:04 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-14953da1-a398-4f95-9c51-f82ea176be21 tempest-CinderUnicodeTest-2009046431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (769b1edf-e0b1-421a-825e-5b0fa6240554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:09:04 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-14953da1-a398-4f95-9c51-f82ea176be21 tempest-CinderUnicodeTest-2009046431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b375d7ef-d7f4-497d-a9b4-7d1f59a73a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:09:04 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-14953da1-a398-4f95-9c51-f82ea176be21 tempest-CinderUnicodeTest-2009046431 None] Volume 23e76c50-0db4-406f-ae6b-c4cc7f8e93ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23e76c50-0db4-406f-ae6b-c4cc7f8e93ba', 'volume_size': 1} Aug 10 16:09:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-14953da1-a398-4f95-9c51-f82ea176be21 tempest-CinderUnicodeTest-2009046431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:09:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-14953da1-a398-4f95-9c51-f82ea176be21 tempest-CinderUnicodeTest-2009046431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:09:04 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-14953da1-a398-4f95-9c51-f82ea176be21 tempest-CinderUnicodeTest-2009046431 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:09:04Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-947544828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23e76c50-0db4-406f-ae6b-c4cc7f8e93ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d42435f9ec9b49169290741d1343962e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:09:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:09:05Z,use_quota=True,user_id='5003e06db2d44cc0af0ec83fae4df6a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:09:04 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-14953da1-a398-4f95-9c51-f82ea176be21 tempest-CinderUnicodeTest-2009046431 None] Creating volume 23e76c50-0db4-406f-ae6b-c4cc7f8e93ba {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:09:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-14953da1-a398-4f95-9c51-f82ea176be21 tempest-CinderUnicodeTest-2009046431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:09:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-14953da1-a398-4f95-9c51-f82ea176be21 tempest-CinderUnicodeTest-2009046431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:09:04 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-14953da1-a398-4f95-9c51-f82ea176be21 tempest-CinderUnicodeTest-2009046431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:09:04 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-14953da1-a398-4f95-9c51-f82ea176be21 tempest-CinderUnicodeTest-2009046431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:09:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-14953da1-a398-4f95-9c51-f82ea176be21 tempest-CinderUnicodeTest-2009046431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:09:04 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-14953da1-a398-4f95-9c51-f82ea176be21 tempest-CinderUnicodeTest-2009046431 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:09:04 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-14953da1-a398-4f95-9c51-f82ea176be21 tempest-CinderUnicodeTest-2009046431 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:09:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-14953da1-a398-4f95-9c51-f82ea176be21 tempest-CinderUnicodeTest-2009046431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-23e76c50-0db4-406f-ae6b-c4cc7f8e93ba 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:09:04 devstack sudo[105078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-23e76c50-0db4-406f-ae6b-c4cc7f8e93ba 1073741824 Aug 10 16:09:04 devstack sudo[105078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:09:05 devstack sudo[105078]: pam_unix(sudo:session): session closed for user root Aug 10 16:09:05 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-14953da1-a398-4f95-9c51-f82ea176be21 tempest-CinderUnicodeTest-2009046431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-23e76c50-0db4-406f-ae6b-c4cc7f8e93ba 1073741824" returned: 0 in 0.576s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:09:05 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-14953da1-a398-4f95-9c51-f82ea176be21 tempest-CinderUnicodeTest-2009046431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-23e76c50-0db4-406f-ae6b-c4cc7f8e93ba {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:09:05 devstack sudo[105086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-23e76c50-0db4-406f-ae6b-c4cc7f8e93ba Aug 10 16:09:05 devstack sudo[105086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:09:05 devstack sudo[105086]: pam_unix(sudo:session): session closed for user root Aug 10 16:09:05 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-14953da1-a398-4f95-9c51-f82ea176be21 tempest-CinderUnicodeTest-2009046431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-23e76c50-0db4-406f-ae6b-c4cc7f8e93ba" returned: 0 in 0.314s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:09:05 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-14953da1-a398-4f95-9c51-f82ea176be21 tempest-CinderUnicodeTest-2009046431 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:09:05 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-14953da1-a398-4f95-9c51-f82ea176be21 tempest-CinderUnicodeTest-2009046431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:09:05 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-14953da1-a398-4f95-9c51-f82ea176be21 tempest-CinderUnicodeTest-2009046431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b375d7ef-d7f4-497d-a9b4-7d1f59a73a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23e76c50-0db4-406f-ae6b-c4cc7f8e93ba', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:09:05 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-14953da1-a398-4f95-9c51-f82ea176be21 tempest-CinderUnicodeTest-2009046431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75157982-a0c8-45c2-b648-14b3be0e7103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:09:05 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-14953da1-a398-4f95-9c51-f82ea176be21 tempest-CinderUnicodeTest-2009046431 None] Volume volume-23e76c50-0db4-406f-ae6b-c4cc7f8e93ba (23e76c50-0db4-406f-ae6b-c4cc7f8e93ba): created successfully Aug 10 16:09:05 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-14953da1-a398-4f95-9c51-f82ea176be21 tempest-CinderUnicodeTest-2009046431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75157982-a0c8-45c2-b648-14b3be0e7103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:09:05 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-14953da1-a398-4f95-9c51-f82ea176be21 tempest-CinderUnicodeTest-2009046431 None] Flow 'volume_create_manager' (cba58e14-0c88-4240-90f7-dfe6dd2b7947) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:09:05 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-14953da1-a398-4f95-9c51-f82ea176be21 tempest-CinderUnicodeTest-2009046431 None] Created volume successfully. Aug 10 16:09:05 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-28ce2893-ae3e-4304-b4fd-0535e4dcc13c tempest-VolumesActionsTest-864365452 None] Acquiring lock "cinder-298c2771-cbf9-47fb-ae03-174525ba5571" by "attach_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:09:05 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-28ce2893-ae3e-4304-b4fd-0535e4dcc13c tempest-VolumesActionsTest-864365452 None] Lock "cinder-298c2771-cbf9-47fb-ae03-174525ba5571" acquired by "attach_volume" :: waited 0.025s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:09:05 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-28ce2893-ae3e-4304-b4fd-0535e4dcc13c tempest-VolumesActionsTest-864365452 None] Attaching volume 298c2771-cbf9-47fb-ae03-174525ba5571 to instance 365fa176-aa69-4e9b-8981-8e5efc20a3d7 at mountpoint /dev/vdb on host None. Aug 10 16:09:05 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-28ce2893-ae3e-4304-b4fd-0535e4dcc13c tempest-VolumesActionsTest-864365452 None] Attach volume completed successfully. Aug 10 16:09:05 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-28ce2893-ae3e-4304-b4fd-0535e4dcc13c tempest-VolumesActionsTest-864365452 None] Lock "cinder-298c2771-cbf9-47fb-ae03-174525ba5571" released by "attach_volume" :: held 0.084s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:09:06 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-017ebc25-d071-4d9e-9869-4b27591b702f tempest-VolumesActionsTest-864365452 None] Acquiring lock "cinder-298c2771-cbf9-47fb-ae03-174525ba5571-detach_volume" by "detach_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:09:06 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-017ebc25-d071-4d9e-9869-4b27591b702f tempest-VolumesActionsTest-864365452 None] Lock "cinder-298c2771-cbf9-47fb-ae03-174525ba5571-detach_volume" acquired by "detach_volume" :: waited 0.017s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:09:06 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-017ebc25-d071-4d9e-9869-4b27591b702f tempest-VolumesActionsTest-864365452 None] Detaching volume 298c2771-cbf9-47fb-ae03-174525ba5571 from instance 365fa176-aa69-4e9b-8981-8e5efc20a3d7. Aug 10 16:09:06 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-017ebc25-d071-4d9e-9869-4b27591b702f tempest-VolumesActionsTest-864365452 None] Detach volume completed successfully. Aug 10 16:09:06 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-017ebc25-d071-4d9e-9869-4b27591b702f tempest-VolumesActionsTest-864365452 None] Lock "cinder-298c2771-cbf9-47fb-ae03-174525ba5571-detach_volume" released by "detach_volume" :: held 0.068s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:09:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-13e4308c-2f0a-4d27-8078-b605430be0a7 tempest-CinderUnicodeTest-2009046431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:09:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-13e4308c-2f0a-4d27-8078-b605430be0a7 tempest-CinderUnicodeTest-2009046431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:09:07 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-13e4308c-2f0a-4d27-8078-b605430be0a7 tempest-CinderUnicodeTest-2009046431 None] Creating offline snapshot 7a0b3900-ed2e-4a48-b071-2342a410657f of volume 23e76c50-0db4-406f-ae6b-c4cc7f8e93ba {{(pid=88641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 16:09:07 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[3402175e-3fa2-40be-9baf-086b2aadaa41]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:09:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-13e4308c-2f0a-4d27-8078-b605430be0a7 tempest-CinderUnicodeTest-2009046431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-23e76c50-0db4-406f-ae6b-c4cc7f8e93ba {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:09:07 devstack sudo[105118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-23e76c50-0db4-406f-ae6b-c4cc7f8e93ba Aug 10 16:09:07 devstack sudo[105118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:09:07 devstack sudo[105118]: pam_unix(sudo:session): session closed for user root Aug 10 16:09:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-13e4308c-2f0a-4d27-8078-b605430be0a7 tempest-CinderUnicodeTest-2009046431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-23e76c50-0db4-406f-ae6b-c4cc7f8e93ba" returned: 0 in 0.430s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:09:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-13e4308c-2f0a-4d27-8078-b605430be0a7 tempest-CinderUnicodeTest-2009046431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-23e76c50-0db4-406f-ae6b-c4cc7f8e93ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-23e76c50-0db4-406f-ae6b-c4cc7f8e93ba.7a0b3900-ed2e-4a48-b071-2342a410657f 1G {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:09:07 devstack sudo[105125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-23e76c50-0db4-406f-ae6b-c4cc7f8e93ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-23e76c50-0db4-406f-ae6b-c4cc7f8e93ba.7a0b3900-ed2e-4a48-b071-2342a410657f 1G Aug 10 16:09:07 devstack sudo[105125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:09:08 devstack sudo[105125]: pam_unix(sudo:session): session closed for user root Aug 10 16:09:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-13e4308c-2f0a-4d27-8078-b605430be0a7 tempest-CinderUnicodeTest-2009046431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-23e76c50-0db4-406f-ae6b-c4cc7f8e93ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-23e76c50-0db4-406f-ae6b-c4cc7f8e93ba.7a0b3900-ed2e-4a48-b071-2342a410657f 1G" returned: 0 in 0.561s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:09:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-13e4308c-2f0a-4d27-8078-b605430be0a7 tempest-CinderUnicodeTest-2009046431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23e76c50-0db4-406f-ae6b-c4cc7f8e93ba -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-23e76c50-0db4-406f-ae6b-c4cc7f8e93ba.7a0b3900-ed2e-4a48-b071-2342a410657f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:09:08 devstack sudo[105132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23e76c50-0db4-406f-ae6b-c4cc7f8e93ba -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-23e76c50-0db4-406f-ae6b-c4cc7f8e93ba.7a0b3900-ed2e-4a48-b071-2342a410657f Aug 10 16:09:08 devstack sudo[105132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:09:08 devstack sudo[105132]: pam_unix(sudo:session): session closed for user root Aug 10 16:09:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-13e4308c-2f0a-4d27-8078-b605430be0a7 tempest-CinderUnicodeTest-2009046431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23e76c50-0db4-406f-ae6b-c4cc7f8e93ba -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-23e76c50-0db4-406f-ae6b-c4cc7f8e93ba.7a0b3900-ed2e-4a48-b071-2342a410657f" returned: 0 in 0.295s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:09:08 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-13e4308c-2f0a-4d27-8078-b605430be0a7 tempest-CinderUnicodeTest-2009046431 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-23e76c50-0db4-406f-ae6b-c4cc7f8e93ba.7a0b3900-ed2e-4a48-b071-2342a410657f is being set with open permissions: ugo+rw Aug 10 16:09:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-13e4308c-2f0a-4d27-8078-b605430be0a7 tempest-CinderUnicodeTest-2009046431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-23e76c50-0db4-406f-ae6b-c4cc7f8e93ba.7a0b3900-ed2e-4a48-b071-2342a410657f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:09:08 devstack sudo[105137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-23e76c50-0db4-406f-ae6b-c4cc7f8e93ba.7a0b3900-ed2e-4a48-b071-2342a410657f Aug 10 16:09:08 devstack sudo[105137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:09:08 devstack sudo[105137]: pam_unix(sudo:session): session closed for user root Aug 10 16:09:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-13e4308c-2f0a-4d27-8078-b605430be0a7 tempest-CinderUnicodeTest-2009046431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-23e76c50-0db4-406f-ae6b-c4cc7f8e93ba.7a0b3900-ed2e-4a48-b071-2342a410657f" returned: 0 in 0.245s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:09:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-13e4308c-2f0a-4d27-8078-b605430be0a7 tempest-CinderUnicodeTest-2009046431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-23e76c50-0db4-406f-ae6b-c4cc7f8e93ba.info {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:09:08 devstack sudo[105140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-23e76c50-0db4-406f-ae6b-c4cc7f8e93ba.info Aug 10 16:09:08 devstack sudo[105140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:09:09 devstack sudo[105140]: pam_unix(sudo:session): session closed for user root Aug 10 16:09:09 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-13e4308c-2f0a-4d27-8078-b605430be0a7 tempest-CinderUnicodeTest-2009046431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-23e76c50-0db4-406f-ae6b-c4cc7f8e93ba.info" returned: 0 in 0.255s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:09:09 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-13e4308c-2f0a-4d27-8078-b605430be0a7 tempest-CinderUnicodeTest-2009046431 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-23e76c50-0db4-406f-ae6b-c4cc7f8e93ba.info is being set with open permissions: ugo+rw Aug 10 16:09:09 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-13e4308c-2f0a-4d27-8078-b605430be0a7 tempest-CinderUnicodeTest-2009046431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-23e76c50-0db4-406f-ae6b-c4cc7f8e93ba.info {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:09:09 devstack sudo[105143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-23e76c50-0db4-406f-ae6b-c4cc7f8e93ba.info Aug 10 16:09:09 devstack sudo[105143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:09:09 devstack sudo[105143]: pam_unix(sudo:session): session closed for user root Aug 10 16:09:09 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-13e4308c-2f0a-4d27-8078-b605430be0a7 tempest-CinderUnicodeTest-2009046431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-23e76c50-0db4-406f-ae6b-c4cc7f8e93ba.info" returned: 0 in 0.259s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:09:09 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-13e4308c-2f0a-4d27-8078-b605430be0a7 tempest-CinderUnicodeTest-2009046431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.140s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:09:09 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-13e4308c-2f0a-4d27-8078-b605430be0a7 tempest-CinderUnicodeTest-2009046431 None] Create snapshot completed successfully Aug 10 16:09:10 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-bac4f40c-5ab6-4ece-ae5f-bccea5790ed0 tempest-CinderUnicodeTest-2009046431 None] Acquiring lock "cinder-7a0b3900-ed2e-4a48-b071-2342a410657f-delete_snapshot" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:09:10 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-9b44d4de-db00-4a4f-874f-959bc1d01974 tempest-VolumesActionsTest-864365452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:09:10 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-9b44d4de-db00-4a4f-874f-959bc1d01974 tempest-VolumesActionsTest-864365452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:09:10 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-bac4f40c-5ab6-4ece-ae5f-bccea5790ed0 tempest-CinderUnicodeTest-2009046431 None] Lock "cinder-7a0b3900-ed2e-4a48-b071-2342a410657f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:09:10 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-bac4f40c-5ab6-4ece-ae5f-bccea5790ed0 tempest-CinderUnicodeTest-2009046431 None] Acquiring lock "cinder-quobyte-23e76c50-0db4-406f-ae6b-c4cc7f8e93ba" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:09:10 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cbd9f3f-d04c-4cb1-a142-d8296858c3fe]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:09:10 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9b44d4de-db00-4a4f-874f-959bc1d01974 tempest-VolumesActionsTest-864365452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-298c2771-cbf9-47fb-ae03-174525ba5571 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:09:10 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-bac4f40c-5ab6-4ece-ae5f-bccea5790ed0 tempest-CinderUnicodeTest-2009046431 None] Lock "cinder-quobyte-23e76c50-0db4-406f-ae6b-c4cc7f8e93ba" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:09:10 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-bac4f40c-5ab6-4ece-ae5f-bccea5790ed0 tempest-CinderUnicodeTest-2009046431 None] Acquiring lock "cinder-quobyte-7a0b3900-ed2e-4a48-b071-2342a410657f" by "_delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:09:10 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-bac4f40c-5ab6-4ece-ae5f-bccea5790ed0 tempest-CinderUnicodeTest-2009046431 None] Lock "cinder-quobyte-7a0b3900-ed2e-4a48-b071-2342a410657f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:09:10 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-bac4f40c-5ab6-4ece-ae5f-bccea5790ed0 tempest-CinderUnicodeTest-2009046431 None] Deleting offline snapshot 7a0b3900-ed2e-4a48-b071-2342a410657f of volume 23e76c50-0db4-406f-ae6b-c4cc7f8e93ba {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 16:09:10 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-bac4f40c-5ab6-4ece-ae5f-bccea5790ed0 tempest-CinderUnicodeTest-2009046431 None] snapshot_file for this snap is: volume-23e76c50-0db4-406f-ae6b-c4cc7f8e93ba.7a0b3900-ed2e-4a48-b071-2342a410657f {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 16:09:10 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[df7adf4c-df86-4429-94b9-4de431686f4f]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:09:10 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bac4f40c-5ab6-4ece-ae5f-bccea5790ed0 tempest-CinderUnicodeTest-2009046431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-23e76c50-0db4-406f-ae6b-c4cc7f8e93ba.7a0b3900-ed2e-4a48-b071-2342a410657f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:09:10 devstack sudo[105146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-298c2771-cbf9-47fb-ae03-174525ba5571 Aug 10 16:09:10 devstack sudo[105146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:09:10 devstack sudo[105147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-23e76c50-0db4-406f-ae6b-c4cc7f8e93ba.7a0b3900-ed2e-4a48-b071-2342a410657f Aug 10 16:09:10 devstack sudo[105147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:09:10 devstack sudo[105146]: pam_unix(sudo:session): session closed for user root Aug 10 16:09:10 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9b44d4de-db00-4a4f-874f-959bc1d01974 tempest-VolumesActionsTest-864365452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-298c2771-cbf9-47fb-ae03-174525ba5571" returned: 0 in 0.375s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:09:10 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[241001a7-f3aa-4dae-bd6a-d39c90e05bf3]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:09:10 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9b44d4de-db00-4a4f-874f-959bc1d01974 tempest-VolumesActionsTest-864365452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-298c2771-cbf9-47fb-ae03-174525ba5571 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:09:10 devstack sudo[105147]: pam_unix(sudo:session): session closed for user root Aug 10 16:09:10 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bac4f40c-5ab6-4ece-ae5f-bccea5790ed0 tempest-CinderUnicodeTest-2009046431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-23e76c50-0db4-406f-ae6b-c4cc7f8e93ba.7a0b3900-ed2e-4a48-b071-2342a410657f" returned: 0 in 0.368s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:09:10 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-bac4f40c-5ab6-4ece-ae5f-bccea5790ed0 tempest-CinderUnicodeTest-2009046431 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23e76c50-0db4-406f-ae6b-c4cc7f8e93ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 16:09:10 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b3ccae-058d-48a6-bf4f-197c3b1d7b3f]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:09:10 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bac4f40c-5ab6-4ece-ae5f-bccea5790ed0 tempest-CinderUnicodeTest-2009046431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-23e76c50-0db4-406f-ae6b-c4cc7f8e93ba {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:09:10 devstack sudo[105157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-298c2771-cbf9-47fb-ae03-174525ba5571 Aug 10 16:09:10 devstack sudo[105157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:09:11 devstack sudo[105158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-23e76c50-0db4-406f-ae6b-c4cc7f8e93ba Aug 10 16:09:11 devstack sudo[105158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:09:11 devstack sudo[105157]: pam_unix(sudo:session): session closed for user root Aug 10 16:09:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9b44d4de-db00-4a4f-874f-959bc1d01974 tempest-VolumesActionsTest-864365452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-298c2771-cbf9-47fb-ae03-174525ba5571" returned: 0 in 0.362s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:09:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9b44d4de-db00-4a4f-874f-959bc1d01974 tempest-VolumesActionsTest-864365452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-298c2771-cbf9-47fb-ae03-174525ba5571 /opt/stack/data/cinder/conversion/298c2771-cbf9-47fb-ae03-174525ba5571.temp_image.844cac4e-a3c1-4b3e-b045-76076bdb0c8bm3qg42wz.img {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:09:11 devstack sudo[105166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-298c2771-cbf9-47fb-ae03-174525ba5571 /opt/stack/data/cinder/conversion/298c2771-cbf9-47fb-ae03-174525ba5571.temp_image.844cac4e-a3c1-4b3e-b045-76076bdb0c8bm3qg42wz.img Aug 10 16:09:11 devstack sudo[105166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:09:11 devstack sudo[105158]: pam_unix(sudo:session): session closed for user root Aug 10 16:09:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bac4f40c-5ab6-4ece-ae5f-bccea5790ed0 tempest-CinderUnicodeTest-2009046431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-23e76c50-0db4-406f-ae6b-c4cc7f8e93ba" returned: 0 in 0.354s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:09:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bac4f40c-5ab6-4ece-ae5f-bccea5790ed0 tempest-CinderUnicodeTest-2009046431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-23e76c50-0db4-406f-ae6b-c4cc7f8e93ba.7a0b3900-ed2e-4a48-b071-2342a410657f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:09:11 devstack sudo[105169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-23e76c50-0db4-406f-ae6b-c4cc7f8e93ba.7a0b3900-ed2e-4a48-b071-2342a410657f Aug 10 16:09:11 devstack sudo[105169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:09:11 devstack sudo[105169]: pam_unix(sudo:session): session closed for user root Aug 10 16:09:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bac4f40c-5ab6-4ece-ae5f-bccea5790ed0 tempest-CinderUnicodeTest-2009046431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-23e76c50-0db4-406f-ae6b-c4cc7f8e93ba.7a0b3900-ed2e-4a48-b071-2342a410657f" returned: 0 in 0.532s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:09:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bac4f40c-5ab6-4ece-ae5f-bccea5790ed0 tempest-CinderUnicodeTest-2009046431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-23e76c50-0db4-406f-ae6b-c4cc7f8e93ba.7a0b3900-ed2e-4a48-b071-2342a410657f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:09:11 devstack sudo[105184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-23e76c50-0db4-406f-ae6b-c4cc7f8e93ba.7a0b3900-ed2e-4a48-b071-2342a410657f Aug 10 16:09:11 devstack sudo[105184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:09:12 devstack sudo[105184]: pam_unix(sudo:session): session closed for user root Aug 10 16:09:12 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bac4f40c-5ab6-4ece-ae5f-bccea5790ed0 tempest-CinderUnicodeTest-2009046431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-23e76c50-0db4-406f-ae6b-c4cc7f8e93ba.7a0b3900-ed2e-4a48-b071-2342a410657f" returned: 0 in 0.566s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:09:12 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-bac4f40c-5ab6-4ece-ae5f-bccea5790ed0 tempest-CinderUnicodeTest-2009046431 None] Lock "cinder-quobyte-7a0b3900-ed2e-4a48-b071-2342a410657f" released by "_delete_snapshot" :: held 1.965s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:09:12 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-bac4f40c-5ab6-4ece-ae5f-bccea5790ed0 tempest-CinderUnicodeTest-2009046431 None] Lock "cinder-quobyte-23e76c50-0db4-406f-ae6b-c4cc7f8e93ba" released by "delete_snapshot" :: held 1.989s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:09:12 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-bac4f40c-5ab6-4ece-ae5f-bccea5790ed0 tempest-CinderUnicodeTest-2009046431 None] Created reservations ['5c2d0719-839e-46a1-a1f0-2e56e1e89c64', '213f8f5b-8241-4952-937a-cef561cfc749', '6351944d-8aa6-4d7f-9347-1243cdeb9d98', 'ad19ba2c-df18-479b-8a8a-7e8e864c8b7f'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:09:12 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-bac4f40c-5ab6-4ece-ae5f-bccea5790ed0 tempest-CinderUnicodeTest-2009046431 None] Delete snapshot completed successfully. Aug 10 16:09:12 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-bac4f40c-5ab6-4ece-ae5f-bccea5790ed0 tempest-CinderUnicodeTest-2009046431 None] Lock "cinder-7a0b3900-ed2e-4a48-b071-2342a410657f-delete_snapshot" released by "delete_snapshot" :: held 2.355s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:09:13 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-faa20403-c2db-4d56-988c-531618055e00 tempest-CinderUnicodeTest-2009046431 None] Acquiring lock "cinder-23e76c50-0db4-406f-ae6b-c4cc7f8e93ba-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:09:13 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-faa20403-c2db-4d56-988c-531618055e00 tempest-CinderUnicodeTest-2009046431 None] Lock "cinder-23e76c50-0db4-406f-ae6b-c4cc7f8e93ba-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:09:13 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-faa20403-c2db-4d56-988c-531618055e00 tempest-CinderUnicodeTest-2009046431 None] Acquiring lock "cinder-quobyte-23e76c50-0db4-406f-ae6b-c4cc7f8e93ba" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:09:13 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-faa20403-c2db-4d56-988c-531618055e00 tempest-CinderUnicodeTest-2009046431 None] Lock "cinder-quobyte-23e76c50-0db4-406f-ae6b-c4cc7f8e93ba" acquired by "delete_volume" :: waited 0.027s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:09:14 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b48e6d-9c5e-46b0-9c90-d09dc7839172]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:09:14 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-faa20403-c2db-4d56-988c-531618055e00 tempest-CinderUnicodeTest-2009046431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-23e76c50-0db4-406f-ae6b-c4cc7f8e93ba {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:09:14 devstack sudo[105189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-23e76c50-0db4-406f-ae6b-c4cc7f8e93ba Aug 10 16:09:14 devstack sudo[105189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:09:14 devstack sudo[105189]: pam_unix(sudo:session): session closed for user root Aug 10 16:09:14 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-faa20403-c2db-4d56-988c-531618055e00 tempest-CinderUnicodeTest-2009046431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-23e76c50-0db4-406f-ae6b-c4cc7f8e93ba" returned: 0 in 0.814s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:09:14 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-faa20403-c2db-4d56-988c-531618055e00 tempest-CinderUnicodeTest-2009046431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-23e76c50-0db4-406f-ae6b-c4cc7f8e93ba {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:09:14 devstack sudo[105194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-23e76c50-0db4-406f-ae6b-c4cc7f8e93ba Aug 10 16:09:14 devstack sudo[105194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:09:15 devstack sudo[105194]: pam_unix(sudo:session): session closed for user root Aug 10 16:09:15 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-faa20403-c2db-4d56-988c-531618055e00 tempest-CinderUnicodeTest-2009046431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-23e76c50-0db4-406f-ae6b-c4cc7f8e93ba" returned: 0 in 0.545s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:09:15 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-faa20403-c2db-4d56-988c-531618055e00 tempest-CinderUnicodeTest-2009046431 None] Lock "cinder-quobyte-23e76c50-0db4-406f-ae6b-c4cc7f8e93ba" released by "delete_volume" :: held 1.484s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:09:15 devstack sudo[105166]: pam_unix(sudo:session): session closed for user root Aug 10 16:09:15 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9b44d4de-db00-4a4f-874f-959bc1d01974 tempest-VolumesActionsTest-864365452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-298c2771-cbf9-47fb-ae03-174525ba5571 /opt/stack/data/cinder/conversion/298c2771-cbf9-47fb-ae03-174525ba5571.temp_image.844cac4e-a3c1-4b3e-b045-76076bdb0c8bm3qg42wz.img" returned: 0 in 4.263s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:09:15 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d77e169-4805-4153-a35b-f12d5c04e8a4]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:09:15 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9b44d4de-db00-4a4f-874f-959bc1d01974 tempest-VolumesActionsTest-864365452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-298c2771-cbf9-47fb-ae03-174525ba5571 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:09:15 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-faa20403-c2db-4d56-988c-531618055e00 tempest-CinderUnicodeTest-2009046431 None] Created reservations ['194b55ae-89e0-4be7-ab71-8f49fe6c052b', '5b8ac05f-57fd-4224-8192-c0e5bbe23aa3', '120529fe-93b6-4b17-80d9-3c8d7f8e84f7', '7067c818-e22d-4f10-85f1-b6309ae3a690'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:09:15 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-faa20403-c2db-4d56-988c-531618055e00 tempest-CinderUnicodeTest-2009046431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:09:15 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-faa20403-c2db-4d56-988c-531618055e00 tempest-CinderUnicodeTest-2009046431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:09:15 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-faa20403-c2db-4d56-988c-531618055e00 tempest-CinderUnicodeTest-2009046431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:09:15 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-faa20403-c2db-4d56-988c-531618055e00 tempest-CinderUnicodeTest-2009046431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:09:15 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-faa20403-c2db-4d56-988c-531618055e00 tempest-CinderUnicodeTest-2009046431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:09:15 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-faa20403-c2db-4d56-988c-531618055e00 tempest-CinderUnicodeTest-2009046431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:09:15 devstack sudo[105197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-298c2771-cbf9-47fb-ae03-174525ba5571 Aug 10 16:09:15 devstack sudo[105197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:09:15 devstack sudo[105198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:09:15 devstack sudo[105198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:09:15 devstack sudo[105198]: pam_unix(sudo:session): session closed for user root Aug 10 16:09:15 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-faa20403-c2db-4d56-988c-531618055e00 tempest-CinderUnicodeTest-2009046431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.249s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:09:15 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-faa20403-c2db-4d56-988c-531618055e00 tempest-CinderUnicodeTest-2009046431 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:09:15 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-faa20403-c2db-4d56-988c-531618055e00 tempest-CinderUnicodeTest-2009046431 None] Deleted volume successfully. Aug 10 16:09:15 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-faa20403-c2db-4d56-988c-531618055e00 tempest-CinderUnicodeTest-2009046431 None] Lock "cinder-23e76c50-0db4-406f-ae6b-c4cc7f8e93ba-delete_volume" released by "delete_volume" :: held 2.016s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:09:16 devstack sudo[105197]: pam_unix(sudo:session): session closed for user root Aug 10 16:09:16 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9b44d4de-db00-4a4f-874f-959bc1d01974 tempest-VolumesActionsTest-864365452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-298c2771-cbf9-47fb-ae03-174525ba5571" returned: 0 in 0.556s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:09:16 devstack cinder-volume[88641]: DEBUG cinder.image.image_utils [None req-9b44d4de-db00-4a4f-874f-959bc1d01974 tempest-VolumesActionsTest-864365452 None] Image conversion details: src /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-298c2771-cbf9-47fb-ae03-174525ba5571, size 1024.00 MB, duration 4.26 sec, destination /opt/stack/data/cinder/conversion/298c2771-cbf9-47fb-ae03-174525ba5571.temp_image.844cac4e-a3c1-4b3e-b045-76076bdb0c8bm3qg42wz.img {{(pid=88641) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 10 16:09:16 devstack cinder-volume[88641]: INFO cinder.image.image_utils [None req-9b44d4de-db00-4a4f-874f-959bc1d01974 tempest-VolumesActionsTest-864365452 None] Converted 1024.00 MB image at 240.14 MB/s Aug 10 16:09:16 devstack cinder-volume[88641]: DEBUG cinder.image.image_utils [None req-9b44d4de-db00-4a4f-874f-959bc1d01974 tempest-VolumesActionsTest-864365452 None] 844cac4e-a3c1-4b3e-b045-76076bdb0c8b was raw, no need to convert to raw {{(pid=88641) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Aug 10 16:09:16 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-769df7ae-19b5-4367-95a1-df7d85599e8f tempest-CinderUnicodeTest-2009046431 None] Acquiring lock "cinder-2a2ceb01-ff53-4288-943e-aa733bbd075f-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:09:16 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-769df7ae-19b5-4367-95a1-df7d85599e8f tempest-CinderUnicodeTest-2009046431 None] Lock "cinder-2a2ceb01-ff53-4288-943e-aa733bbd075f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:09:16 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-769df7ae-19b5-4367-95a1-df7d85599e8f tempest-CinderUnicodeTest-2009046431 None] Acquiring lock "cinder-quobyte-2a2ceb01-ff53-4288-943e-aa733bbd075f" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:09:16 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-769df7ae-19b5-4367-95a1-df7d85599e8f tempest-CinderUnicodeTest-2009046431 None] Lock "cinder-quobyte-2a2ceb01-ff53-4288-943e-aa733bbd075f" acquired by "delete_volume" :: waited 0.016s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:09:16 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[8739d10a-b143-4f32-8e15-cd69f7608433]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:09:16 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-769df7ae-19b5-4367-95a1-df7d85599e8f tempest-CinderUnicodeTest-2009046431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2a2ceb01-ff53-4288-943e-aa733bbd075f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:09:16 devstack sudo[105205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2a2ceb01-ff53-4288-943e-aa733bbd075f Aug 10 16:09:16 devstack sudo[105205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:09:16 devstack sudo[105205]: pam_unix(sudo:session): session closed for user root Aug 10 16:09:16 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-769df7ae-19b5-4367-95a1-df7d85599e8f tempest-CinderUnicodeTest-2009046431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2a2ceb01-ff53-4288-943e-aa733bbd075f" returned: 0 in 0.393s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:09:16 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-769df7ae-19b5-4367-95a1-df7d85599e8f tempest-CinderUnicodeTest-2009046431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2a2ceb01-ff53-4288-943e-aa733bbd075f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:09:16 devstack sudo[105210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2a2ceb01-ff53-4288-943e-aa733bbd075f Aug 10 16:09:16 devstack sudo[105210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:09:17 devstack sudo[105210]: pam_unix(sudo:session): session closed for user root Aug 10 16:09:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-769df7ae-19b5-4367-95a1-df7d85599e8f tempest-CinderUnicodeTest-2009046431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2a2ceb01-ff53-4288-943e-aa733bbd075f" returned: 0 in 0.245s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:09:17 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-769df7ae-19b5-4367-95a1-df7d85599e8f tempest-CinderUnicodeTest-2009046431 None] Lock "cinder-quobyte-2a2ceb01-ff53-4288-943e-aa733bbd075f" released by "delete_volume" :: held 0.684s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:09:17 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-769df7ae-19b5-4367-95a1-df7d85599e8f tempest-CinderUnicodeTest-2009046431 None] Created reservations ['32969968-97ad-484b-8e03-d9942df604e4', 'b6657fe1-aa6d-4827-b6b0-1affada53533', '5e7d80cf-7a0e-49ec-b96e-56e15946ac73', '2d36492d-cdf3-4f4e-bdb3-e0428c5994e9'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:09:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-769df7ae-19b5-4367-95a1-df7d85599e8f tempest-CinderUnicodeTest-2009046431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:09:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-769df7ae-19b5-4367-95a1-df7d85599e8f tempest-CinderUnicodeTest-2009046431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:09:17 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-769df7ae-19b5-4367-95a1-df7d85599e8f tempest-CinderUnicodeTest-2009046431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:09:17 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-769df7ae-19b5-4367-95a1-df7d85599e8f tempest-CinderUnicodeTest-2009046431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:09:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-769df7ae-19b5-4367-95a1-df7d85599e8f tempest-CinderUnicodeTest-2009046431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:09:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-769df7ae-19b5-4367-95a1-df7d85599e8f tempest-CinderUnicodeTest-2009046431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:09:17 devstack sudo[105213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:09:17 devstack sudo[105213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:09:17 devstack sudo[105213]: pam_unix(sudo:session): session closed for user root Aug 10 16:09:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-769df7ae-19b5-4367-95a1-df7d85599e8f tempest-CinderUnicodeTest-2009046431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.281s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:09:17 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-769df7ae-19b5-4367-95a1-df7d85599e8f tempest-CinderUnicodeTest-2009046431 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:09:17 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-769df7ae-19b5-4367-95a1-df7d85599e8f tempest-CinderUnicodeTest-2009046431 None] Deleted volume successfully. Aug 10 16:09:17 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-769df7ae-19b5-4367-95a1-df7d85599e8f tempest-CinderUnicodeTest-2009046431 None] Lock "cinder-2a2ceb01-ff53-4288-943e-aa733bbd075f-delete_volume" released by "delete_volume" :: held 1.193s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:09:21 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f84cc17-e4c9-46cf-8748-5a35b6f0b141 tempest-ProjectReaderTests-1706277331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:09:21 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-0f84cc17-e4c9-46cf-8748-5a35b6f0b141 tempest-ProjectReaderTests-1706277331 None] Flow 'volume_create_manager' (69bf4e6f-b77b-434c-8f43-7d90d6475e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:09:21 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-0f84cc17-e4c9-46cf-8748-5a35b6f0b141 tempest-ProjectReaderTests-1706277331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a2a4f0a-1767-4869-9773-db14e4b74b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:09:21 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-0f84cc17-e4c9-46cf-8748-5a35b6f0b141 tempest-ProjectReaderTests-1706277331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a2a4f0a-1767-4869-9773-db14e4b74b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:09:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1417886269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=488871e9-1487-4e06-a2cd-93a6ccf39f3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aba2a08bae74d8fa047776832962156',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:09:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:09:22Z,use_quota=True,user_id='39abba6abe4c4342bf679b5402018913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:09:21 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-0f84cc17-e4c9-46cf-8748-5a35b6f0b141 tempest-ProjectReaderTests-1706277331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c102cea8-16ec-47de-81f8-a7217f471f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:09:21 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-0f84cc17-e4c9-46cf-8748-5a35b6f0b141 tempest-ProjectReaderTests-1706277331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c102cea8-16ec-47de-81f8-a7217f471f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:09:21 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-0f84cc17-e4c9-46cf-8748-5a35b6f0b141 tempest-ProjectReaderTests-1706277331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9ebbb4e-bede-413d-a102-c0491442c13d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:09:21 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-0f84cc17-e4c9-46cf-8748-5a35b6f0b141 tempest-ProjectReaderTests-1706277331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9ebbb4e-bede-413d-a102-c0491442c13d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '488871e9-1487-4e06-a2cd-93a6ccf39f3b', 'volume_name': 'volume-488871e9-1487-4e06-a2cd-93a6ccf39f3b', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:09:21 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-0f84cc17-e4c9-46cf-8748-5a35b6f0b141 tempest-ProjectReaderTests-1706277331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c1c4c65-4892-4ec6-827b-23aca9e0e452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:09:21 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-0f84cc17-e4c9-46cf-8748-5a35b6f0b141 tempest-ProjectReaderTests-1706277331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c1c4c65-4892-4ec6-827b-23aca9e0e452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:09:21 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-0f84cc17-e4c9-46cf-8748-5a35b6f0b141 tempest-ProjectReaderTests-1706277331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (668b59f8-b460-4068-8505-396c9031c849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:09:21 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-0f84cc17-e4c9-46cf-8748-5a35b6f0b141 tempest-ProjectReaderTests-1706277331 None] Volume 488871e9-1487-4e06-a2cd-93a6ccf39f3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-488871e9-1487-4e06-a2cd-93a6ccf39f3b', 'volume_size': 1} Aug 10 16:09:21 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-0f84cc17-e4c9-46cf-8748-5a35b6f0b141 tempest-ProjectReaderTests-1706277331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:09:34 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-9b44d4de-db00-4a4f-874f-959bc1d01974 tempest-VolumesActionsTest-864365452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 24.496s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:09:34 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9b44d4de-db00-4a4f-874f-959bc1d01974 tempest-VolumesActionsTest-864365452 None] Uploaded volume to glance image-id: 844cac4e-a3c1-4b3e-b045-76076bdb0c8b. {{(pid=88641) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 10 16:09:34 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-0f84cc17-e4c9-46cf-8748-5a35b6f0b141 tempest-ProjectReaderTests-1706277331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.235s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:09:34 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-0f84cc17-e4c9-46cf-8748-5a35b6f0b141 tempest-ProjectReaderTests-1706277331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:09:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1417886269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=488871e9-1487-4e06-a2cd-93a6ccf39f3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aba2a08bae74d8fa047776832962156',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:09:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:09:22Z,use_quota=True,user_id='39abba6abe4c4342bf679b5402018913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:09:34 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-0f84cc17-e4c9-46cf-8748-5a35b6f0b141 tempest-ProjectReaderTests-1706277331 None] Creating volume 488871e9-1487-4e06-a2cd-93a6ccf39f3b {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:09:34 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-0f84cc17-e4c9-46cf-8748-5a35b6f0b141 tempest-ProjectReaderTests-1706277331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:09:34 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-0f84cc17-e4c9-46cf-8748-5a35b6f0b141 tempest-ProjectReaderTests-1706277331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:09:34 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-0f84cc17-e4c9-46cf-8748-5a35b6f0b141 tempest-ProjectReaderTests-1706277331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:09:34 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-0f84cc17-e4c9-46cf-8748-5a35b6f0b141 tempest-ProjectReaderTests-1706277331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:09:34 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-0f84cc17-e4c9-46cf-8748-5a35b6f0b141 tempest-ProjectReaderTests-1706277331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:09:34 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-0f84cc17-e4c9-46cf-8748-5a35b6f0b141 tempest-ProjectReaderTests-1706277331 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:09:34 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-0f84cc17-e4c9-46cf-8748-5a35b6f0b141 tempest-ProjectReaderTests-1706277331 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:09:34 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0f84cc17-e4c9-46cf-8748-5a35b6f0b141 tempest-ProjectReaderTests-1706277331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-488871e9-1487-4e06-a2cd-93a6ccf39f3b 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:09:34 devstack sudo[105224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-488871e9-1487-4e06-a2cd-93a6ccf39f3b 1073741824 Aug 10 16:09:34 devstack sudo[105224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:09:34 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-9b44d4de-db00-4a4f-874f-959bc1d01974 tempest-VolumesActionsTest-864365452 None] Copy volume to image completed successfully. Aug 10 16:09:35 devstack sudo[105224]: pam_unix(sudo:session): session closed for user root Aug 10 16:09:35 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0f84cc17-e4c9-46cf-8748-5a35b6f0b141 tempest-ProjectReaderTests-1706277331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-488871e9-1487-4e06-a2cd-93a6ccf39f3b 1073741824" returned: 0 in 0.438s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:09:35 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0f84cc17-e4c9-46cf-8748-5a35b6f0b141 tempest-ProjectReaderTests-1706277331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-488871e9-1487-4e06-a2cd-93a6ccf39f3b {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:09:35 devstack sudo[105229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-488871e9-1487-4e06-a2cd-93a6ccf39f3b Aug 10 16:09:35 devstack sudo[105229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:09:35 devstack sudo[105229]: pam_unix(sudo:session): session closed for user root Aug 10 16:09:35 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0f84cc17-e4c9-46cf-8748-5a35b6f0b141 tempest-ProjectReaderTests-1706277331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-488871e9-1487-4e06-a2cd-93a6ccf39f3b" returned: 0 in 0.263s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:09:35 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-0f84cc17-e4c9-46cf-8748-5a35b6f0b141 tempest-ProjectReaderTests-1706277331 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:09:35 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-0f84cc17-e4c9-46cf-8748-5a35b6f0b141 tempest-ProjectReaderTests-1706277331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:09:35 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-0f84cc17-e4c9-46cf-8748-5a35b6f0b141 tempest-ProjectReaderTests-1706277331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (668b59f8-b460-4068-8505-396c9031c849) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-488871e9-1487-4e06-a2cd-93a6ccf39f3b', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:09:35 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-0f84cc17-e4c9-46cf-8748-5a35b6f0b141 tempest-ProjectReaderTests-1706277331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f0dfd17-4420-400e-8a4b-f943211ce267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:09:35 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-0f84cc17-e4c9-46cf-8748-5a35b6f0b141 tempest-ProjectReaderTests-1706277331 None] Volume volume-488871e9-1487-4e06-a2cd-93a6ccf39f3b (488871e9-1487-4e06-a2cd-93a6ccf39f3b): created successfully Aug 10 16:09:35 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-0f84cc17-e4c9-46cf-8748-5a35b6f0b141 tempest-ProjectReaderTests-1706277331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f0dfd17-4420-400e-8a4b-f943211ce267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:09:35 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-0f84cc17-e4c9-46cf-8748-5a35b6f0b141 tempest-ProjectReaderTests-1706277331 None] Flow 'volume_create_manager' (69bf4e6f-b77b-434c-8f43-7d90d6475e6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:09:35 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-0f84cc17-e4c9-46cf-8748-5a35b6f0b141 tempest-ProjectReaderTests-1706277331 None] Created volume successfully. Aug 10 16:09:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bef6777f-5dec-4d8d-9974-52fc95979bb2 tempest-VolumesActionsTest-864365452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:09:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bef6777f-5dec-4d8d-9974-52fc95979bb2 tempest-VolumesActionsTest-864365452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:09:36 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[477fec23-2e2b-464c-80e4-bc2a0b5b13c6]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:09:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bef6777f-5dec-4d8d-9974-52fc95979bb2 tempest-VolumesActionsTest-864365452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-298c2771-cbf9-47fb-ae03-174525ba5571 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:09:36 devstack sudo[105232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-298c2771-cbf9-47fb-ae03-174525ba5571 Aug 10 16:09:36 devstack sudo[105232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:09:36 devstack cinder-volume[88641]: DEBUG oslo_service.periodic_task [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88641) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 16:09:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:09:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:09:36 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:09:36 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:09:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:09:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:09:36 devstack sudo[105234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:09:36 devstack sudo[105234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:09:36 devstack sudo[105232]: pam_unix(sudo:session): session closed for user root Aug 10 16:09:36 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-f85ebcbb-2e65-4986-9bd0-c1af8e17f803 tempest-ProjectReaderTests-1706277331 None] Acquiring lock "cinder-488871e9-1487-4e06-a2cd-93a6ccf39f3b-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:09:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bef6777f-5dec-4d8d-9974-52fc95979bb2 tempest-VolumesActionsTest-864365452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-298c2771-cbf9-47fb-ae03-174525ba5571" returned: 0 in 0.398s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:09:36 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-f85ebcbb-2e65-4986-9bd0-c1af8e17f803 tempest-ProjectReaderTests-1706277331 None] Lock "cinder-488871e9-1487-4e06-a2cd-93a6ccf39f3b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:09:36 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0bbaa0b-b4fb-48e0-a427-914c6acb6602]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:09:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bef6777f-5dec-4d8d-9974-52fc95979bb2 tempest-VolumesActionsTest-864365452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-298c2771-cbf9-47fb-ae03-174525ba5571 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:09:36 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-f85ebcbb-2e65-4986-9bd0-c1af8e17f803 tempest-ProjectReaderTests-1706277331 None] Acquiring lock "cinder-quobyte-488871e9-1487-4e06-a2cd-93a6ccf39f3b" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:09:36 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-f85ebcbb-2e65-4986-9bd0-c1af8e17f803 tempest-ProjectReaderTests-1706277331 None] Lock "cinder-quobyte-488871e9-1487-4e06-a2cd-93a6ccf39f3b" acquired by "delete_volume" :: waited 0.016s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:09:36 devstack sudo[105234]: pam_unix(sudo:session): session closed for user root Aug 10 16:09:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.287s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:09:36 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:09:36 devstack cinder-volume[88641]: DEBUG oslo_service.periodic_task [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Running periodic task VolumeManager._thread_info {{(pid=88641) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 16:09:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] thread count: 28 {{(pid=88641) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 10 16:09:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] thread info: [<_MainThread(MainThread, started 127361545748608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88641) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 10 16:09:36 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[de515f3f-d58c-4a47-bfc6-1588ae4e3381]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:09:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-f85ebcbb-2e65-4986-9bd0-c1af8e17f803 tempest-ProjectReaderTests-1706277331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-488871e9-1487-4e06-a2cd-93a6ccf39f3b {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:09:36 devstack sudo[105239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-298c2771-cbf9-47fb-ae03-174525ba5571 Aug 10 16:09:36 devstack sudo[105239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:09:36 devstack sudo[105241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-488871e9-1487-4e06-a2cd-93a6ccf39f3b Aug 10 16:09:36 devstack sudo[105241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:09:37 devstack sudo[105239]: pam_unix(sudo:session): session closed for user root Aug 10 16:09:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bef6777f-5dec-4d8d-9974-52fc95979bb2 tempest-VolumesActionsTest-864365452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-298c2771-cbf9-47fb-ae03-174525ba5571" returned: 0 in 0.405s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:09:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bef6777f-5dec-4d8d-9974-52fc95979bb2 tempest-VolumesActionsTest-864365452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-298c2771-cbf9-47fb-ae03-174525ba5571 /opt/stack/data/cinder/conversion/298c2771-cbf9-47fb-ae03-174525ba5571.temp_image.a078833a-8199-49f4-8abc-85bb5ea7ed090_3vlfyg.img {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:09:37 devstack sudo[105247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-298c2771-cbf9-47fb-ae03-174525ba5571 /opt/stack/data/cinder/conversion/298c2771-cbf9-47fb-ae03-174525ba5571.temp_image.a078833a-8199-49f4-8abc-85bb5ea7ed090_3vlfyg.img Aug 10 16:09:37 devstack sudo[105247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:09:37 devstack sudo[105241]: pam_unix(sudo:session): session closed for user root Aug 10 16:09:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-f85ebcbb-2e65-4986-9bd0-c1af8e17f803 tempest-ProjectReaderTests-1706277331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-488871e9-1487-4e06-a2cd-93a6ccf39f3b" returned: 0 in 0.372s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:09:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-f85ebcbb-2e65-4986-9bd0-c1af8e17f803 tempest-ProjectReaderTests-1706277331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-488871e9-1487-4e06-a2cd-93a6ccf39f3b {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:09:37 devstack sudo[105252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-488871e9-1487-4e06-a2cd-93a6ccf39f3b Aug 10 16:09:37 devstack sudo[105252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:09:37 devstack sudo[105252]: pam_unix(sudo:session): session closed for user root Aug 10 16:09:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-f85ebcbb-2e65-4986-9bd0-c1af8e17f803 tempest-ProjectReaderTests-1706277331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-488871e9-1487-4e06-a2cd-93a6ccf39f3b" returned: 0 in 0.277s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:09:37 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-f85ebcbb-2e65-4986-9bd0-c1af8e17f803 tempest-ProjectReaderTests-1706277331 None] Lock "cinder-quobyte-488871e9-1487-4e06-a2cd-93a6ccf39f3b" released by "delete_volume" :: held 0.736s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:09:37 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-f85ebcbb-2e65-4986-9bd0-c1af8e17f803 tempest-ProjectReaderTests-1706277331 None] Created reservations ['f9a9038b-1e82-434a-ac2c-54da82cb27dd', 'b7f55fcf-870b-4a98-8416-f3cb6831a791', '5fe93914-5437-4c2f-b4be-e7c78bc2c125', '92de040a-f1f0-4825-b672-f84a5e94d6de'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:09:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-f85ebcbb-2e65-4986-9bd0-c1af8e17f803 tempest-ProjectReaderTests-1706277331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:09:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-f85ebcbb-2e65-4986-9bd0-c1af8e17f803 tempest-ProjectReaderTests-1706277331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:09:37 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-f85ebcbb-2e65-4986-9bd0-c1af8e17f803 tempest-ProjectReaderTests-1706277331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:09:37 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-f85ebcbb-2e65-4986-9bd0-c1af8e17f803 tempest-ProjectReaderTests-1706277331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:09:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-f85ebcbb-2e65-4986-9bd0-c1af8e17f803 tempest-ProjectReaderTests-1706277331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:09:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-f85ebcbb-2e65-4986-9bd0-c1af8e17f803 tempest-ProjectReaderTests-1706277331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:09:37 devstack sudo[105265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:09:37 devstack sudo[105265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:09:38 devstack sudo[105265]: pam_unix(sudo:session): session closed for user root Aug 10 16:09:38 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-f85ebcbb-2e65-4986-9bd0-c1af8e17f803 tempest-ProjectReaderTests-1706277331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.552s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:09:38 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-f85ebcbb-2e65-4986-9bd0-c1af8e17f803 tempest-ProjectReaderTests-1706277331 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:09:38 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-f85ebcbb-2e65-4986-9bd0-c1af8e17f803 tempest-ProjectReaderTests-1706277331 None] Deleted volume successfully. Aug 10 16:09:38 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-f85ebcbb-2e65-4986-9bd0-c1af8e17f803 tempest-ProjectReaderTests-1706277331 None] Lock "cinder-488871e9-1487-4e06-a2cd-93a6ccf39f3b-delete_volume" released by "delete_volume" :: held 1.726s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:09:38 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f26b30a-398c-41fb-b053-c63d6ff1957b tempest-ProjectReaderTests-1706277331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:09:38 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-4f26b30a-398c-41fb-b053-c63d6ff1957b tempest-ProjectReaderTests-1706277331 None] Flow 'volume_create_manager' (8e631ada-e4c9-46fc-8fec-cbb09f604f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:09:38 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-4f26b30a-398c-41fb-b053-c63d6ff1957b tempest-ProjectReaderTests-1706277331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f1d7b0e-493a-4732-96f2-757125745a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:09:38 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-4f26b30a-398c-41fb-b053-c63d6ff1957b tempest-ProjectReaderTests-1706277331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f1d7b0e-493a-4732-96f2-757125745a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:09:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-932822508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c238e44-7e2c-4ee0-ad5e-7e1242d47b21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aba2a08bae74d8fa047776832962156',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:09:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:09:39Z,use_quota=True,user_id='39abba6abe4c4342bf679b5402018913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:09:38 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-4f26b30a-398c-41fb-b053-c63d6ff1957b tempest-ProjectReaderTests-1706277331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d9ff218-fd9d-465f-a065-5e94ca9c2b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:09:38 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-4f26b30a-398c-41fb-b053-c63d6ff1957b tempest-ProjectReaderTests-1706277331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d9ff218-fd9d-465f-a065-5e94ca9c2b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:09:38 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-4f26b30a-398c-41fb-b053-c63d6ff1957b tempest-ProjectReaderTests-1706277331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11de0cab-9a77-4b18-8324-46f7f75ed87d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:09:38 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-4f26b30a-398c-41fb-b053-c63d6ff1957b tempest-ProjectReaderTests-1706277331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11de0cab-9a77-4b18-8324-46f7f75ed87d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c238e44-7e2c-4ee0-ad5e-7e1242d47b21', 'volume_name': 'volume-8c238e44-7e2c-4ee0-ad5e-7e1242d47b21', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:09:38 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-4f26b30a-398c-41fb-b053-c63d6ff1957b tempest-ProjectReaderTests-1706277331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef614be7-44e7-4faa-898a-63b778a8aa7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:09:38 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-4f26b30a-398c-41fb-b053-c63d6ff1957b tempest-ProjectReaderTests-1706277331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef614be7-44e7-4faa-898a-63b778a8aa7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:09:39 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-4f26b30a-398c-41fb-b053-c63d6ff1957b tempest-ProjectReaderTests-1706277331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a26bf6a-69bd-4baf-8c32-bf46cc2cdbf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:09:39 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-4f26b30a-398c-41fb-b053-c63d6ff1957b tempest-ProjectReaderTests-1706277331 None] Volume 8c238e44-7e2c-4ee0-ad5e-7e1242d47b21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c238e44-7e2c-4ee0-ad5e-7e1242d47b21', 'volume_size': 1} Aug 10 16:09:39 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-4f26b30a-398c-41fb-b053-c63d6ff1957b tempest-ProjectReaderTests-1706277331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:09:41 devstack sudo[105247]: pam_unix(sudo:session): session closed for user root Aug 10 16:09:41 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bef6777f-5dec-4d8d-9974-52fc95979bb2 tempest-VolumesActionsTest-864365452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-298c2771-cbf9-47fb-ae03-174525ba5571 /opt/stack/data/cinder/conversion/298c2771-cbf9-47fb-ae03-174525ba5571.temp_image.a078833a-8199-49f4-8abc-85bb5ea7ed090_3vlfyg.img" returned: 0 in 4.211s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:09:41 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[86debb5d-bdf1-421a-8683-9083c3c285e8]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:09:41 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bef6777f-5dec-4d8d-9974-52fc95979bb2 tempest-VolumesActionsTest-864365452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-298c2771-cbf9-47fb-ae03-174525ba5571 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:09:41 devstack sudo[105269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-298c2771-cbf9-47fb-ae03-174525ba5571 Aug 10 16:09:41 devstack sudo[105269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:09:41 devstack sudo[105269]: pam_unix(sudo:session): session closed for user root Aug 10 16:09:41 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bef6777f-5dec-4d8d-9974-52fc95979bb2 tempest-VolumesActionsTest-864365452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-298c2771-cbf9-47fb-ae03-174525ba5571" returned: 0 in 0.525s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:09:41 devstack cinder-volume[88641]: DEBUG cinder.image.image_utils [None req-bef6777f-5dec-4d8d-9974-52fc95979bb2 tempest-VolumesActionsTest-864365452 None] Image conversion details: src /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-298c2771-cbf9-47fb-ae03-174525ba5571, size 1024.00 MB, duration 4.21 sec, destination /opt/stack/data/cinder/conversion/298c2771-cbf9-47fb-ae03-174525ba5571.temp_image.a078833a-8199-49f4-8abc-85bb5ea7ed090_3vlfyg.img {{(pid=88641) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 10 16:09:41 devstack cinder-volume[88641]: INFO cinder.image.image_utils [None req-bef6777f-5dec-4d8d-9974-52fc95979bb2 tempest-VolumesActionsTest-864365452 None] Converted 1024.00 MB image at 243.12 MB/s Aug 10 16:09:41 devstack cinder-volume[88641]: DEBUG dbcounter [-] [88641] Writing DB stats cinder:SELECT=57,cinder:INSERT=22,cinder:UPDATE=65,cinder:DELETE=5 {{(pid=88641) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 16:09:41 devstack cinder-volume[88641]: DEBUG dbcounter [-] [88641] Writing DB stats cinder:UPDATE=61,cinder:SELECT=69,cinder:INSERT=18,cinder:DELETE=5 {{(pid=88641) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 16:09:41 devstack cinder-volume[88641]: DEBUG cinder.image.image_utils [None req-bef6777f-5dec-4d8d-9974-52fc95979bb2 tempest-VolumesActionsTest-864365452 None] a078833a-8199-49f4-8abc-85bb5ea7ed09 was raw, converting to qcow2 {{(pid=88641) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Aug 10 16:09:41 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[f50d8e0f-0402-4bb8-97cb-c70abf9f1f0d]: (4, 'raw') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:09:41 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bef6777f-5dec-4d8d-9974-52fc95979bb2 tempest-VolumesActionsTest-864365452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/298c2771-cbf9-47fb-ae03-174525ba5571.temp_image.a078833a-8199-49f4-8abc-85bb5ea7ed090_3vlfyg.img {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:09:41 devstack sudo[105274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/298c2771-cbf9-47fb-ae03-174525ba5571.temp_image.a078833a-8199-49f4-8abc-85bb5ea7ed090_3vlfyg.img Aug 10 16:09:41 devstack sudo[105274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:09:42 devstack sudo[105274]: pam_unix(sudo:session): session closed for user root Aug 10 16:09:42 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bef6777f-5dec-4d8d-9974-52fc95979bb2 tempest-VolumesActionsTest-864365452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/298c2771-cbf9-47fb-ae03-174525ba5571.temp_image.a078833a-8199-49f4-8abc-85bb5ea7ed090_3vlfyg.img" returned: 0 in 0.318s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:09:42 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bef6777f-5dec-4d8d-9974-52fc95979bb2 tempest-VolumesActionsTest-864365452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/298c2771-cbf9-47fb-ae03-174525ba5571.temp_image.a078833a-8199-49f4-8abc-85bb5ea7ed090_3vlfyg.img {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:09:42 devstack sudo[105278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/298c2771-cbf9-47fb-ae03-174525ba5571.temp_image.a078833a-8199-49f4-8abc-85bb5ea7ed090_3vlfyg.img Aug 10 16:09:42 devstack sudo[105278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:09:42 devstack sudo[105278]: pam_unix(sudo:session): session closed for user root Aug 10 16:09:42 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bef6777f-5dec-4d8d-9974-52fc95979bb2 tempest-VolumesActionsTest-864365452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/298c2771-cbf9-47fb-ae03-174525ba5571.temp_image.a078833a-8199-49f4-8abc-85bb5ea7ed090_3vlfyg.img" returned: 1 in 0.313s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:09:42 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bef6777f-5dec-4d8d-9974-52fc95979bb2 tempest-VolumesActionsTest-864365452 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/298c2771-cbf9-47fb-ae03-174525ba5571.temp_image.a078833a-8199-49f4-8abc-85bb5ea7ed090_3vlfyg.img' failed. Not Retrying. {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 10 16:09:42 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bef6777f-5dec-4d8d-9974-52fc95979bb2 tempest-VolumesActionsTest-864365452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/298c2771-cbf9-47fb-ae03-174525ba5571.temp_image.a078833a-8199-49f4-8abc-85bb5ea7ed090_3vlfyg.img /opt/stack/data/cinder/conversion/vol_upload_12gzvqc8 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:09:42 devstack sudo[105284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/298c2771-cbf9-47fb-ae03-174525ba5571.temp_image.a078833a-8199-49f4-8abc-85bb5ea7ed090_3vlfyg.img /opt/stack/data/cinder/conversion/vol_upload_12gzvqc8 Aug 10 16:09:42 devstack sudo[105284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:09:42 devstack sudo[105284]: pam_unix(sudo:session): session closed for user root Aug 10 16:09:42 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bef6777f-5dec-4d8d-9974-52fc95979bb2 tempest-VolumesActionsTest-864365452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/298c2771-cbf9-47fb-ae03-174525ba5571.temp_image.a078833a-8199-49f4-8abc-85bb5ea7ed090_3vlfyg.img /opt/stack/data/cinder/conversion/vol_upload_12gzvqc8" returned: 0 in 0.256s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:09:42 devstack cinder-volume[88641]: DEBUG cinder.image.image_utils [None req-bef6777f-5dec-4d8d-9974-52fc95979bb2 tempest-VolumesActionsTest-864365452 None] Image conversion details: src /opt/stack/data/cinder/conversion/298c2771-cbf9-47fb-ae03-174525ba5571.temp_image.a078833a-8199-49f4-8abc-85bb5ea7ed090_3vlfyg.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_12gzvqc8 {{(pid=88641) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 10 16:09:42 devstack cinder-volume[88641]: INFO cinder.image.image_utils [None req-bef6777f-5dec-4d8d-9974-52fc95979bb2 tempest-VolumesActionsTest-864365452 None] Converted 1024.00 MB image at 1024.00 MB/s Aug 10 16:09:42 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[575a3d2f-9e28-4969-a01e-3237c23eff5f]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:09:42 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bef6777f-5dec-4d8d-9974-52fc95979bb2 tempest-VolumesActionsTest-864365452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_12gzvqc8 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:09:42 devstack sudo[105290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_12gzvqc8 Aug 10 16:09:42 devstack sudo[105290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:09:43 devstack sudo[105290]: pam_unix(sudo:session): session closed for user root Aug 10 16:09:43 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bef6777f-5dec-4d8d-9974-52fc95979bb2 tempest-VolumesActionsTest-864365452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_12gzvqc8" returned: 0 in 0.330s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:09:44 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bef6777f-5dec-4d8d-9974-52fc95979bb2 tempest-VolumesActionsTest-864365452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 8.189s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:09:44 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bef6777f-5dec-4d8d-9974-52fc95979bb2 tempest-VolumesActionsTest-864365452 None] Uploaded volume to glance image-id: a078833a-8199-49f4-8abc-85bb5ea7ed09. {{(pid=88641) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 10 16:09:44 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-4f26b30a-398c-41fb-b053-c63d6ff1957b tempest-ProjectReaderTests-1706277331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.402s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:09:44 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-4f26b30a-398c-41fb-b053-c63d6ff1957b tempest-ProjectReaderTests-1706277331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:09:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-932822508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c238e44-7e2c-4ee0-ad5e-7e1242d47b21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aba2a08bae74d8fa047776832962156',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:09:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:09:39Z,use_quota=True,user_id='39abba6abe4c4342bf679b5402018913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:09:44 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-4f26b30a-398c-41fb-b053-c63d6ff1957b tempest-ProjectReaderTests-1706277331 None] Creating volume 8c238e44-7e2c-4ee0-ad5e-7e1242d47b21 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:09:44 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-4f26b30a-398c-41fb-b053-c63d6ff1957b tempest-ProjectReaderTests-1706277331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:09:44 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-4f26b30a-398c-41fb-b053-c63d6ff1957b tempest-ProjectReaderTests-1706277331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:09:44 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-4f26b30a-398c-41fb-b053-c63d6ff1957b tempest-ProjectReaderTests-1706277331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:09:44 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-4f26b30a-398c-41fb-b053-c63d6ff1957b tempest-ProjectReaderTests-1706277331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:09:44 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-4f26b30a-398c-41fb-b053-c63d6ff1957b tempest-ProjectReaderTests-1706277331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:09:44 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-4f26b30a-398c-41fb-b053-c63d6ff1957b tempest-ProjectReaderTests-1706277331 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:09:44 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-4f26b30a-398c-41fb-b053-c63d6ff1957b tempest-ProjectReaderTests-1706277331 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:09:44 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4f26b30a-398c-41fb-b053-c63d6ff1957b tempest-ProjectReaderTests-1706277331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-8c238e44-7e2c-4ee0-ad5e-7e1242d47b21 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:09:44 devstack sudo[105295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-8c238e44-7e2c-4ee0-ad5e-7e1242d47b21 1073741824 Aug 10 16:09:44 devstack sudo[105295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:09:44 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-bef6777f-5dec-4d8d-9974-52fc95979bb2 tempest-VolumesActionsTest-864365452 None] Copy volume to image completed successfully. Aug 10 16:09:44 devstack sudo[105295]: pam_unix(sudo:session): session closed for user root Aug 10 16:09:44 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4f26b30a-398c-41fb-b053-c63d6ff1957b tempest-ProjectReaderTests-1706277331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-8c238e44-7e2c-4ee0-ad5e-7e1242d47b21 1073741824" returned: 0 in 0.477s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:09:44 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4f26b30a-398c-41fb-b053-c63d6ff1957b tempest-ProjectReaderTests-1706277331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-8c238e44-7e2c-4ee0-ad5e-7e1242d47b21 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:09:44 devstack sudo[105301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-8c238e44-7e2c-4ee0-ad5e-7e1242d47b21 Aug 10 16:09:44 devstack sudo[105301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:09:45 devstack sudo[105301]: pam_unix(sudo:session): session closed for user root Aug 10 16:09:45 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4f26b30a-398c-41fb-b053-c63d6ff1957b tempest-ProjectReaderTests-1706277331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-8c238e44-7e2c-4ee0-ad5e-7e1242d47b21" returned: 0 in 0.255s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:09:45 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-4f26b30a-398c-41fb-b053-c63d6ff1957b tempest-ProjectReaderTests-1706277331 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:09:45 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-4f26b30a-398c-41fb-b053-c63d6ff1957b tempest-ProjectReaderTests-1706277331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:09:45 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-4f26b30a-398c-41fb-b053-c63d6ff1957b tempest-ProjectReaderTests-1706277331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a26bf6a-69bd-4baf-8c32-bf46cc2cdbf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c238e44-7e2c-4ee0-ad5e-7e1242d47b21', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:09:45 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-4f26b30a-398c-41fb-b053-c63d6ff1957b tempest-ProjectReaderTests-1706277331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a5acafa-ac3f-49ed-8868-ae10232c1a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:09:45 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-4f26b30a-398c-41fb-b053-c63d6ff1957b tempest-ProjectReaderTests-1706277331 None] Volume volume-8c238e44-7e2c-4ee0-ad5e-7e1242d47b21 (8c238e44-7e2c-4ee0-ad5e-7e1242d47b21): created successfully Aug 10 16:09:45 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-4f26b30a-398c-41fb-b053-c63d6ff1957b tempest-ProjectReaderTests-1706277331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a5acafa-ac3f-49ed-8868-ae10232c1a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:09:45 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-4f26b30a-398c-41fb-b053-c63d6ff1957b tempest-ProjectReaderTests-1706277331 None] Flow 'volume_create_manager' (8e631ada-e4c9-46fc-8fec-cbb09f604f34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:09:45 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-4f26b30a-398c-41fb-b053-c63d6ff1957b tempest-ProjectReaderTests-1706277331 None] Created volume successfully. Aug 10 16:09:45 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-b0a5cea3-6681-40a0-8c1c-b358443bf30a tempest-VolumesActionsTest-864365452 None] Acquiring lock "cinder-298c2771-cbf9-47fb-ae03-174525ba5571-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:09:45 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-b0a5cea3-6681-40a0-8c1c-b358443bf30a tempest-VolumesActionsTest-864365452 None] Lock "cinder-298c2771-cbf9-47fb-ae03-174525ba5571-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:09:45 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-b0a5cea3-6681-40a0-8c1c-b358443bf30a tempest-VolumesActionsTest-864365452 None] Acquiring lock "cinder-quobyte-298c2771-cbf9-47fb-ae03-174525ba5571" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:09:45 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-b0a5cea3-6681-40a0-8c1c-b358443bf30a tempest-VolumesActionsTest-864365452 None] Lock "cinder-quobyte-298c2771-cbf9-47fb-ae03-174525ba5571" acquired by "delete_volume" :: waited 0.014s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:09:45 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d41d93-f72f-4a00-ac7c-bdcc2d79de4b]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:09:45 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b0a5cea3-6681-40a0-8c1c-b358443bf30a tempest-VolumesActionsTest-864365452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-298c2771-cbf9-47fb-ae03-174525ba5571 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:09:45 devstack sudo[105304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-298c2771-cbf9-47fb-ae03-174525ba5571 Aug 10 16:09:45 devstack sudo[105304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:09:45 devstack sudo[105304]: pam_unix(sudo:session): session closed for user root Aug 10 16:09:45 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b0a5cea3-6681-40a0-8c1c-b358443bf30a tempest-VolumesActionsTest-864365452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-298c2771-cbf9-47fb-ae03-174525ba5571" returned: 0 in 0.350s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:09:45 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b0a5cea3-6681-40a0-8c1c-b358443bf30a tempest-VolumesActionsTest-864365452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-298c2771-cbf9-47fb-ae03-174525ba5571 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:09:45 devstack sudo[105309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-298c2771-cbf9-47fb-ae03-174525ba5571 Aug 10 16:09:45 devstack sudo[105309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:09:46 devstack sudo[105309]: pam_unix(sudo:session): session closed for user root Aug 10 16:09:46 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b0a5cea3-6681-40a0-8c1c-b358443bf30a tempest-VolumesActionsTest-864365452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-298c2771-cbf9-47fb-ae03-174525ba5571" returned: 0 in 0.234s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:09:46 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-b0a5cea3-6681-40a0-8c1c-b358443bf30a tempest-VolumesActionsTest-864365452 None] Lock "cinder-quobyte-298c2771-cbf9-47fb-ae03-174525ba5571" released by "delete_volume" :: held 0.618s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:09:46 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-b0a5cea3-6681-40a0-8c1c-b358443bf30a tempest-VolumesActionsTest-864365452 None] Created reservations ['bf4256d1-2112-47a9-ae32-052b32750469', '168a190c-f810-40be-a013-f587c6358694', '95105a84-8cb0-4d11-9730-012ecbab3a5a', 'c5c0ace7-72e1-4821-b2b3-a633a6d6dbab'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:09:46 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-b0a5cea3-6681-40a0-8c1c-b358443bf30a tempest-VolumesActionsTest-864365452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:09:46 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-b0a5cea3-6681-40a0-8c1c-b358443bf30a tempest-VolumesActionsTest-864365452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:09:46 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-b0a5cea3-6681-40a0-8c1c-b358443bf30a tempest-VolumesActionsTest-864365452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:09:46 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-b0a5cea3-6681-40a0-8c1c-b358443bf30a tempest-VolumesActionsTest-864365452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:09:46 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-b0a5cea3-6681-40a0-8c1c-b358443bf30a tempest-VolumesActionsTest-864365452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:09:46 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b0a5cea3-6681-40a0-8c1c-b358443bf30a tempest-VolumesActionsTest-864365452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:09:46 devstack sudo[105312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:09:46 devstack sudo[105312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:09:46 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-bc0e5169-7532-482b-990b-b54b6df27fa3 tempest-ProjectReaderTests-1706277331 None] Acquiring lock "cinder-8c238e44-7e2c-4ee0-ad5e-7e1242d47b21-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:09:46 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-bc0e5169-7532-482b-990b-b54b6df27fa3 tempest-ProjectReaderTests-1706277331 None] Lock "cinder-8c238e44-7e2c-4ee0-ad5e-7e1242d47b21-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:09:46 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-bc0e5169-7532-482b-990b-b54b6df27fa3 tempest-ProjectReaderTests-1706277331 None] Acquiring lock "cinder-quobyte-8c238e44-7e2c-4ee0-ad5e-7e1242d47b21" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:09:46 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-bc0e5169-7532-482b-990b-b54b6df27fa3 tempest-ProjectReaderTests-1706277331 None] Lock "cinder-quobyte-8c238e44-7e2c-4ee0-ad5e-7e1242d47b21" acquired by "delete_volume" :: waited 0.016s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:09:46 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[c97f3534-f1ef-48cf-8f24-477c62319b5d]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:09:46 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bc0e5169-7532-482b-990b-b54b6df27fa3 tempest-ProjectReaderTests-1706277331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-8c238e44-7e2c-4ee0-ad5e-7e1242d47b21 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:09:46 devstack sudo[105312]: pam_unix(sudo:session): session closed for user root Aug 10 16:09:46 devstack sudo[105314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-8c238e44-7e2c-4ee0-ad5e-7e1242d47b21 Aug 10 16:09:46 devstack sudo[105314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:09:46 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b0a5cea3-6681-40a0-8c1c-b358443bf30a tempest-VolumesActionsTest-864365452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.303s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:09:46 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-b0a5cea3-6681-40a0-8c1c-b358443bf30a tempest-VolumesActionsTest-864365452 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:09:46 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-b0a5cea3-6681-40a0-8c1c-b358443bf30a tempest-VolumesActionsTest-864365452 None] Deleted volume successfully. Aug 10 16:09:46 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-b0a5cea3-6681-40a0-8c1c-b358443bf30a tempest-VolumesActionsTest-864365452 None] Lock "cinder-298c2771-cbf9-47fb-ae03-174525ba5571-delete_volume" released by "delete_volume" :: held 1.144s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:09:46 devstack sudo[105314]: pam_unix(sudo:session): session closed for user root Aug 10 16:09:46 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bc0e5169-7532-482b-990b-b54b6df27fa3 tempest-ProjectReaderTests-1706277331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-8c238e44-7e2c-4ee0-ad5e-7e1242d47b21" returned: 0 in 0.382s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:09:46 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bc0e5169-7532-482b-990b-b54b6df27fa3 tempest-ProjectReaderTests-1706277331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-8c238e44-7e2c-4ee0-ad5e-7e1242d47b21 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:09:46 devstack sudo[105320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-8c238e44-7e2c-4ee0-ad5e-7e1242d47b21 Aug 10 16:09:46 devstack sudo[105320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:09:47 devstack sudo[105320]: pam_unix(sudo:session): session closed for user root Aug 10 16:09:47 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bc0e5169-7532-482b-990b-b54b6df27fa3 tempest-ProjectReaderTests-1706277331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-8c238e44-7e2c-4ee0-ad5e-7e1242d47b21" returned: 0 in 0.257s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:09:47 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-bc0e5169-7532-482b-990b-b54b6df27fa3 tempest-ProjectReaderTests-1706277331 None] Lock "cinder-quobyte-8c238e44-7e2c-4ee0-ad5e-7e1242d47b21" released by "delete_volume" :: held 0.687s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:09:47 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-bc0e5169-7532-482b-990b-b54b6df27fa3 tempest-ProjectReaderTests-1706277331 None] Created reservations ['bdd39502-1df4-401c-8926-7563313c2fde', '1e28c576-e052-44b3-95d8-0e6593958785', 'd008d337-0cef-4edc-9091-8075bc4c9536', '7c5c174b-b117-4fb6-88c2-ad6c29b979c0'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:09:47 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bc0e5169-7532-482b-990b-b54b6df27fa3 tempest-ProjectReaderTests-1706277331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:09:47 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bc0e5169-7532-482b-990b-b54b6df27fa3 tempest-ProjectReaderTests-1706277331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:09:47 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-bc0e5169-7532-482b-990b-b54b6df27fa3 tempest-ProjectReaderTests-1706277331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:09:47 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-bc0e5169-7532-482b-990b-b54b6df27fa3 tempest-ProjectReaderTests-1706277331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:09:47 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bc0e5169-7532-482b-990b-b54b6df27fa3 tempest-ProjectReaderTests-1706277331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:09:47 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bc0e5169-7532-482b-990b-b54b6df27fa3 tempest-ProjectReaderTests-1706277331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:09:47 devstack sudo[105323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:09:47 devstack sudo[105323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:09:47 devstack sudo[105323]: pam_unix(sudo:session): session closed for user root Aug 10 16:09:47 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bc0e5169-7532-482b-990b-b54b6df27fa3 tempest-ProjectReaderTests-1706277331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.266s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:09:47 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-bc0e5169-7532-482b-990b-b54b6df27fa3 tempest-ProjectReaderTests-1706277331 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:09:47 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-bc0e5169-7532-482b-990b-b54b6df27fa3 tempest-ProjectReaderTests-1706277331 None] Deleted volume successfully. Aug 10 16:09:47 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-bc0e5169-7532-482b-990b-b54b6df27fa3 tempest-ProjectReaderTests-1706277331 None] Lock "cinder-8c238e44-7e2c-4ee0-ad5e-7e1242d47b21-delete_volume" released by "delete_volume" :: held 1.200s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:09:51 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-d86b3513-5043-4adc-8dad-91b78798191f tempest-ProjectReaderTests-600290529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:09:51 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d86b3513-5043-4adc-8dad-91b78798191f tempest-ProjectReaderTests-600290529 None] Flow 'volume_create_manager' (a8a9d638-7de6-4256-bd64-15876bd5e6f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:09:51 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d86b3513-5043-4adc-8dad-91b78798191f tempest-ProjectReaderTests-600290529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6217fd22-95de-4479-922c-8277776b747e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:09:51 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d86b3513-5043-4adc-8dad-91b78798191f tempest-ProjectReaderTests-600290529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6217fd22-95de-4479-922c-8277776b747e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:09:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-829384830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5750672f-2984-4db2-8411-e5523272094e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53857507237a4d6ba384dae68f55dabc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:09:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:09:52Z,use_quota=True,user_id='8245b9a6dde84cada1ac610cb362d2d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:09:51 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d86b3513-5043-4adc-8dad-91b78798191f tempest-ProjectReaderTests-600290529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48a7e71b-138a-4f11-806a-d3a7788d358c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:09:51 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d86b3513-5043-4adc-8dad-91b78798191f tempest-ProjectReaderTests-600290529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48a7e71b-138a-4f11-806a-d3a7788d358c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:09:51 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d86b3513-5043-4adc-8dad-91b78798191f tempest-ProjectReaderTests-600290529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8954d0ce-d3c0-474b-8f9a-99014544bce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:09:51 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d86b3513-5043-4adc-8dad-91b78798191f tempest-ProjectReaderTests-600290529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8954d0ce-d3c0-474b-8f9a-99014544bce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5750672f-2984-4db2-8411-e5523272094e', 'volume_name': 'volume-5750672f-2984-4db2-8411-e5523272094e', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:09:51 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d86b3513-5043-4adc-8dad-91b78798191f tempest-ProjectReaderTests-600290529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6aaa3a2a-a644-40a6-8317-92088144b74d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:09:51 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d86b3513-5043-4adc-8dad-91b78798191f tempest-ProjectReaderTests-600290529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6aaa3a2a-a644-40a6-8317-92088144b74d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:09:51 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d86b3513-5043-4adc-8dad-91b78798191f tempest-ProjectReaderTests-600290529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdeb0fdd-e264-4a8d-9bdc-2f7dc98c65e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:09:51 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-d86b3513-5043-4adc-8dad-91b78798191f tempest-ProjectReaderTests-600290529 None] Volume 5750672f-2984-4db2-8411-e5523272094e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5750672f-2984-4db2-8411-e5523272094e', 'volume_size': 1} Aug 10 16:09:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-d86b3513-5043-4adc-8dad-91b78798191f tempest-ProjectReaderTests-600290529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:09:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-d86b3513-5043-4adc-8dad-91b78798191f tempest-ProjectReaderTests-600290529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:09:51 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-d86b3513-5043-4adc-8dad-91b78798191f tempest-ProjectReaderTests-600290529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:09:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-829384830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5750672f-2984-4db2-8411-e5523272094e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53857507237a4d6ba384dae68f55dabc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:09:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:09:52Z,use_quota=True,user_id='8245b9a6dde84cada1ac610cb362d2d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:09:51 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-d86b3513-5043-4adc-8dad-91b78798191f tempest-ProjectReaderTests-600290529 None] Creating volume 5750672f-2984-4db2-8411-e5523272094e {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:09:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-d86b3513-5043-4adc-8dad-91b78798191f tempest-ProjectReaderTests-600290529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:09:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-d86b3513-5043-4adc-8dad-91b78798191f tempest-ProjectReaderTests-600290529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:09:51 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-d86b3513-5043-4adc-8dad-91b78798191f tempest-ProjectReaderTests-600290529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:09:51 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-d86b3513-5043-4adc-8dad-91b78798191f tempest-ProjectReaderTests-600290529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:09:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-d86b3513-5043-4adc-8dad-91b78798191f tempest-ProjectReaderTests-600290529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:09:51 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-d86b3513-5043-4adc-8dad-91b78798191f tempest-ProjectReaderTests-600290529 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:09:51 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-d86b3513-5043-4adc-8dad-91b78798191f tempest-ProjectReaderTests-600290529 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:09:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d86b3513-5043-4adc-8dad-91b78798191f tempest-ProjectReaderTests-600290529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-5750672f-2984-4db2-8411-e5523272094e 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:09:51 devstack sudo[105329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-5750672f-2984-4db2-8411-e5523272094e 1073741824 Aug 10 16:09:51 devstack sudo[105329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:09:52 devstack sudo[105329]: pam_unix(sudo:session): session closed for user root Aug 10 16:09:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d86b3513-5043-4adc-8dad-91b78798191f tempest-ProjectReaderTests-600290529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-5750672f-2984-4db2-8411-e5523272094e 1073741824" returned: 0 in 0.461s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:09:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d86b3513-5043-4adc-8dad-91b78798191f tempest-ProjectReaderTests-600290529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-5750672f-2984-4db2-8411-e5523272094e {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:09:52 devstack sudo[105335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-5750672f-2984-4db2-8411-e5523272094e Aug 10 16:09:52 devstack sudo[105335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:09:52 devstack sudo[105335]: pam_unix(sudo:session): session closed for user root Aug 10 16:09:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d86b3513-5043-4adc-8dad-91b78798191f tempest-ProjectReaderTests-600290529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-5750672f-2984-4db2-8411-e5523272094e" returned: 0 in 0.281s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:09:52 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-d86b3513-5043-4adc-8dad-91b78798191f tempest-ProjectReaderTests-600290529 None] <== create_volume: return (785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:09:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-d86b3513-5043-4adc-8dad-91b78798191f tempest-ProjectReaderTests-600290529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:09:52 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d86b3513-5043-4adc-8dad-91b78798191f tempest-ProjectReaderTests-600290529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdeb0fdd-e264-4a8d-9bdc-2f7dc98c65e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5750672f-2984-4db2-8411-e5523272094e', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:09:52 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d86b3513-5043-4adc-8dad-91b78798191f tempest-ProjectReaderTests-600290529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a57b632-a9e6-42d5-914c-c927048bc190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:09:52 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-d86b3513-5043-4adc-8dad-91b78798191f tempest-ProjectReaderTests-600290529 None] Volume volume-5750672f-2984-4db2-8411-e5523272094e (5750672f-2984-4db2-8411-e5523272094e): created successfully Aug 10 16:09:52 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d86b3513-5043-4adc-8dad-91b78798191f tempest-ProjectReaderTests-600290529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a57b632-a9e6-42d5-914c-c927048bc190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:09:52 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-d86b3513-5043-4adc-8dad-91b78798191f tempest-ProjectReaderTests-600290529 None] Flow 'volume_create_manager' (a8a9d638-7de6-4256-bd64-15876bd5e6f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:09:52 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-d86b3513-5043-4adc-8dad-91b78798191f tempest-ProjectReaderTests-600290529 None] Created volume successfully. Aug 10 16:09:53 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-e4ddace4-4c79-4465-9bfb-d0ecea0ce399 tempest-ProjectReaderTests-600290529 None] Acquiring lock "cinder-5750672f-2984-4db2-8411-e5523272094e-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:09:53 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-e4ddace4-4c79-4465-9bfb-d0ecea0ce399 tempest-ProjectReaderTests-600290529 None] Lock "cinder-5750672f-2984-4db2-8411-e5523272094e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:09:53 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-e4ddace4-4c79-4465-9bfb-d0ecea0ce399 tempest-ProjectReaderTests-600290529 None] Acquiring lock "cinder-quobyte-5750672f-2984-4db2-8411-e5523272094e" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:09:53 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-e4ddace4-4c79-4465-9bfb-d0ecea0ce399 tempest-ProjectReaderTests-600290529 None] Lock "cinder-quobyte-5750672f-2984-4db2-8411-e5523272094e" acquired by "delete_volume" :: waited 0.021s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:09:54 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[283b3806-0b75-4244-9c09-f79ac630c750]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:09:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e4ddace4-4c79-4465-9bfb-d0ecea0ce399 tempest-ProjectReaderTests-600290529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-5750672f-2984-4db2-8411-e5523272094e {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:09:54 devstack sudo[105339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-5750672f-2984-4db2-8411-e5523272094e Aug 10 16:09:54 devstack sudo[105339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:09:54 devstack sudo[105339]: pam_unix(sudo:session): session closed for user root Aug 10 16:09:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e4ddace4-4c79-4465-9bfb-d0ecea0ce399 tempest-ProjectReaderTests-600290529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-5750672f-2984-4db2-8411-e5523272094e" returned: 0 in 0.394s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:09:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e4ddace4-4c79-4465-9bfb-d0ecea0ce399 tempest-ProjectReaderTests-600290529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-5750672f-2984-4db2-8411-e5523272094e {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:09:54 devstack sudo[105344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-5750672f-2984-4db2-8411-e5523272094e Aug 10 16:09:54 devstack sudo[105344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:09:54 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-179d9699-975c-42ad-be13-406ab2df60e4 tempest-VolumesExtendTest-1532672814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:09:54 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-179d9699-975c-42ad-be13-406ab2df60e4 tempest-VolumesExtendTest-1532672814 None] Flow 'volume_create_manager' (1eadfe17-06cc-4d08-97d8-a401a8ce7d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:09:54 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-179d9699-975c-42ad-be13-406ab2df60e4 tempest-VolumesExtendTest-1532672814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67c5df5a-a05a-436c-83da-4a4559a4b3cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:09:54 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-179d9699-975c-42ad-be13-406ab2df60e4 tempest-VolumesExtendTest-1532672814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67c5df5a-a05a-436c-83da-4a4559a4b3cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:09:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-455652460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4035dca5-aac8-4bdc-b18e-8f8ccd2141ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f80d4f98d04541e5baf967a588875585',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:09:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:09:54Z,use_quota=True,user_id='ec28e9285dfe47b58d86b0b076199e04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:09:54 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-179d9699-975c-42ad-be13-406ab2df60e4 tempest-VolumesExtendTest-1532672814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a791a6f-4403-4a37-855e-ca6f91902f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:09:54 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-179d9699-975c-42ad-be13-406ab2df60e4 tempest-VolumesExtendTest-1532672814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a791a6f-4403-4a37-855e-ca6f91902f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:09:54 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-179d9699-975c-42ad-be13-406ab2df60e4 tempest-VolumesExtendTest-1532672814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cc91284-69bf-4800-9d51-3a3eca9f9ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:09:54 devstack cinder-volume[88641]: DEBUG cinder.image.glance [None req-179d9699-975c-42ad-be13-406ab2df60e4 tempest-VolumesExtendTest-1532672814 None] Creating Keystone auth plugin from conf {{(pid=88641) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 10 16:09:54 devstack sudo[105344]: pam_unix(sudo:session): session closed for user root Aug 10 16:09:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e4ddace4-4c79-4465-9bfb-d0ecea0ce399 tempest-ProjectReaderTests-600290529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-5750672f-2984-4db2-8411-e5523272094e" returned: 0 in 0.257s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:09:54 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-e4ddace4-4c79-4465-9bfb-d0ecea0ce399 tempest-ProjectReaderTests-600290529 None] Lock "cinder-quobyte-5750672f-2984-4db2-8411-e5523272094e" released by "delete_volume" :: held 0.695s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:09:54 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-179d9699-975c-42ad-be13-406ab2df60e4 tempest-VolumesExtendTest-1532672814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cc91284-69bf-4800-9d51-3a3eca9f9ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4035dca5-aac8-4bdc-b18e-8f8ccd2141ec', 'volume_name': 'volume-4035dca5-aac8-4bdc-b18e-8f8ccd2141ec', 'volume_size': 1, 'image_id': '94d8702e-9652-4319-94ff-fc0294ea1b4b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/94d8702e-9652-4319-94ff-fc0294ea1b4b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9e18d747214f4822be3dc7f3bd0a3775', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '94d8702e-9652-4319-94ff-fc0294ea1b4b', 'created_at': datetime.datetime(2026, 8, 10, 13, 48, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 10, 13, 48, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/94d8702e-9652-4319-94ff-fc0294ea1b4b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:09:54 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-179d9699-975c-42ad-be13-406ab2df60e4 tempest-VolumesExtendTest-1532672814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa684142-488f-4ccf-aff1-fc041bd2c4cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:09:54 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-179d9699-975c-42ad-be13-406ab2df60e4 tempest-VolumesExtendTest-1532672814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa684142-488f-4ccf-aff1-fc041bd2c4cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:09:54 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-179d9699-975c-42ad-be13-406ab2df60e4 tempest-VolumesExtendTest-1532672814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfa2f7a0-87c3-4a42-8a48-3c247cc7d5a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:09:54 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-179d9699-975c-42ad-be13-406ab2df60e4 tempest-VolumesExtendTest-1532672814 None] Volume 4035dca5-aac8-4bdc-b18e-8f8ccd2141ec: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4035dca5-aac8-4bdc-b18e-8f8ccd2141ec', 'volume_size': 1, 'image_id': '94d8702e-9652-4319-94ff-fc0294ea1b4b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/94d8702e-9652-4319-94ff-fc0294ea1b4b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9e18d747214f4822be3dc7f3bd0a3775', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '94d8702e-9652-4319-94ff-fc0294ea1b4b', 'created_at': datetime.datetime(2026, 8, 10, 13, 48, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 10, 13, 48, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/94d8702e-9652-4319-94ff-fc0294ea1b4b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 10 16:09:54 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-179d9699-975c-42ad-be13-406ab2df60e4 tempest-VolumesExtendTest-1532672814 None] Trying to clone 4035dca5-aac8-4bdc-b18e-8f8ccd2141ec from image 94d8702e-9652-4319-94ff-fc0294ea1b4b at location (None, [{'url': 'file:///opt/stack/data/glance/images/94d8702e-9652-4319-94ff-fc0294ea1b4b', 'metadata': {}}]). {{(pid=88641) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 10 16:09:54 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-e4ddace4-4c79-4465-9bfb-d0ecea0ce399 tempest-ProjectReaderTests-600290529 None] Created reservations ['41bee805-30d5-4077-8b56-aa3436263509', 'cfdef9ea-e867-4ff2-9355-4e547c939223', '5bd70bc0-39be-4f46-bfa8-180362754eeb', '61bd870f-eae6-4a4e-8a33-0801accf9cdf'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:09:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-e4ddace4-4c79-4465-9bfb-d0ecea0ce399 tempest-ProjectReaderTests-600290529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:09:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-e4ddace4-4c79-4465-9bfb-d0ecea0ce399 tempest-ProjectReaderTests-600290529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:09:54 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-e4ddace4-4c79-4465-9bfb-d0ecea0ce399 tempest-ProjectReaderTests-600290529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:09:54 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-e4ddace4-4c79-4465-9bfb-d0ecea0ce399 tempest-ProjectReaderTests-600290529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:09:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-e4ddace4-4c79-4465-9bfb-d0ecea0ce399 tempest-ProjectReaderTests-600290529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:09:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e4ddace4-4c79-4465-9bfb-d0ecea0ce399 tempest-ProjectReaderTests-600290529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:09:54 devstack sudo[105347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:09:54 devstack sudo[105347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:09:55 devstack cinder-volume[88641]: DEBUG cinder.image.image_utils [None req-179d9699-975c-42ad-be13-406ab2df60e4 tempest-VolumesExtendTest-1532672814 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_94d8702e-9652-4319-94ff-fc0294ea1b4b_0rcccu4vdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88641) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 10 16:09:55 devstack cinder-volume[88641]: INFO cinder.image.image_utils [None req-179d9699-975c-42ad-be13-406ab2df60e4 tempest-VolumesExtendTest-1532672814 None] Image download 20.69 MB at 20.69 MB/s Aug 10 16:09:55 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee71c76-d520-4097-9870-fac7401abc74]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:09:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-179d9699-975c-42ad-be13-406ab2df60e4 tempest-VolumesExtendTest-1532672814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94d8702e-9652-4319-94ff-fc0294ea1b4b_0rcccu4vdevstack@QuobyteHD {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:09:55 devstack sudo[105347]: pam_unix(sudo:session): session closed for user root Aug 10 16:09:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e4ddace4-4c79-4465-9bfb-d0ecea0ce399 tempest-ProjectReaderTests-600290529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.326s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:09:55 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-e4ddace4-4c79-4465-9bfb-d0ecea0ce399 tempest-ProjectReaderTests-600290529 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:09:55 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-e4ddace4-4c79-4465-9bfb-d0ecea0ce399 tempest-ProjectReaderTests-600290529 None] Deleted volume successfully. Aug 10 16:09:55 devstack sudo[105350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94d8702e-9652-4319-94ff-fc0294ea1b4b_0rcccu4vdevstack@QuobyteHD Aug 10 16:09:55 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-e4ddace4-4c79-4465-9bfb-d0ecea0ce399 tempest-ProjectReaderTests-600290529 None] Lock "cinder-5750672f-2984-4db2-8411-e5523272094e-delete_volume" released by "delete_volume" :: held 1.347s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:09:55 devstack sudo[105350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:09:55 devstack sudo[105350]: pam_unix(sudo:session): session closed for user root Aug 10 16:09:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-179d9699-975c-42ad-be13-406ab2df60e4 tempest-VolumesExtendTest-1532672814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94d8702e-9652-4319-94ff-fc0294ea1b4b_0rcccu4vdevstack@QuobyteHD" returned: 0 in 0.374s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:09:55 devstack cinder-volume[88641]: DEBUG cinder.image.image_utils [None req-179d9699-975c-42ad-be13-406ab2df60e4 tempest-VolumesExtendTest-1532672814 None] Temporary image 94d8702e-9652-4319-94ff-fc0294ea1b4b is fetched for user ec28e9285dfe47b58d86b0b076199e04. {{(pid=88641) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 10 16:09:55 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a339e43-8fab-4011-a07f-41ea1e6e8477 tempest-ProjectReaderTests-600290529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:09:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-6a339e43-8fab-4011-a07f-41ea1e6e8477 tempest-ProjectReaderTests-600290529 None] Flow 'volume_create_manager' (7400a956-fb4a-4b08-acbb-4ea360fb5cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:09:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-6a339e43-8fab-4011-a07f-41ea1e6e8477 tempest-ProjectReaderTests-600290529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d723289-d940-4d9e-91d0-320a7ce7e38d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:09:55 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[02bc8821-5a05-474f-b165-92d41f69f987]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:09:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-179d9699-975c-42ad-be13-406ab2df60e4 tempest-VolumesExtendTest-1532672814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94d8702e-9652-4319-94ff-fc0294ea1b4b_0rcccu4vdevstack@QuobyteHD {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:09:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-6a339e43-8fab-4011-a07f-41ea1e6e8477 tempest-ProjectReaderTests-600290529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d723289-d940-4d9e-91d0-320a7ce7e38d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:09:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-961179612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=463c4e3d-5182-43ef-a5ab-010c0a578966,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53857507237a4d6ba384dae68f55dabc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:09:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:09:56Z,use_quota=True,user_id='8245b9a6dde84cada1ac610cb362d2d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:09:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-6a339e43-8fab-4011-a07f-41ea1e6e8477 tempest-ProjectReaderTests-600290529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (199bee74-6fc8-4711-92f9-7cc38307d4eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:09:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-6a339e43-8fab-4011-a07f-41ea1e6e8477 tempest-ProjectReaderTests-600290529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (199bee74-6fc8-4711-92f9-7cc38307d4eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:09:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-6a339e43-8fab-4011-a07f-41ea1e6e8477 tempest-ProjectReaderTests-600290529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9affc3f5-c65e-434c-a379-3a992c063e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:09:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-6a339e43-8fab-4011-a07f-41ea1e6e8477 tempest-ProjectReaderTests-600290529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9affc3f5-c65e-434c-a379-3a992c063e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '463c4e3d-5182-43ef-a5ab-010c0a578966', 'volume_name': 'volume-463c4e3d-5182-43ef-a5ab-010c0a578966', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:09:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-6a339e43-8fab-4011-a07f-41ea1e6e8477 tempest-ProjectReaderTests-600290529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d26b3e7-bbb7-4657-8f5f-87713743b27d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:09:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-6a339e43-8fab-4011-a07f-41ea1e6e8477 tempest-ProjectReaderTests-600290529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d26b3e7-bbb7-4657-8f5f-87713743b27d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:09:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-6a339e43-8fab-4011-a07f-41ea1e6e8477 tempest-ProjectReaderTests-600290529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (529eef32-9dd1-4a8d-840d-1f2718d2e7d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:09:55 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-6a339e43-8fab-4011-a07f-41ea1e6e8477 tempest-ProjectReaderTests-600290529 None] Volume 463c4e3d-5182-43ef-a5ab-010c0a578966: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-463c4e3d-5182-43ef-a5ab-010c0a578966', 'volume_size': 1} Aug 10 16:09:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-6a339e43-8fab-4011-a07f-41ea1e6e8477 tempest-ProjectReaderTests-600290529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:09:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-6a339e43-8fab-4011-a07f-41ea1e6e8477 tempest-ProjectReaderTests-600290529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:09:55 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-6a339e43-8fab-4011-a07f-41ea1e6e8477 tempest-ProjectReaderTests-600290529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:09:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-961179612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=463c4e3d-5182-43ef-a5ab-010c0a578966,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53857507237a4d6ba384dae68f55dabc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:09:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:09:56Z,use_quota=True,user_id='8245b9a6dde84cada1ac610cb362d2d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:09:55 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-6a339e43-8fab-4011-a07f-41ea1e6e8477 tempest-ProjectReaderTests-600290529 None] Creating volume 463c4e3d-5182-43ef-a5ab-010c0a578966 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:09:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-6a339e43-8fab-4011-a07f-41ea1e6e8477 tempest-ProjectReaderTests-600290529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:09:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-6a339e43-8fab-4011-a07f-41ea1e6e8477 tempest-ProjectReaderTests-600290529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:09:55 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-6a339e43-8fab-4011-a07f-41ea1e6e8477 tempest-ProjectReaderTests-600290529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:09:55 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-6a339e43-8fab-4011-a07f-41ea1e6e8477 tempest-ProjectReaderTests-600290529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:09:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-6a339e43-8fab-4011-a07f-41ea1e6e8477 tempest-ProjectReaderTests-600290529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:09:55 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-6a339e43-8fab-4011-a07f-41ea1e6e8477 tempest-ProjectReaderTests-600290529 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:09:55 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-6a339e43-8fab-4011-a07f-41ea1e6e8477 tempest-ProjectReaderTests-600290529 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:09:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6a339e43-8fab-4011-a07f-41ea1e6e8477 tempest-ProjectReaderTests-600290529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-463c4e3d-5182-43ef-a5ab-010c0a578966 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:09:55 devstack sudo[105357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-463c4e3d-5182-43ef-a5ab-010c0a578966 1073741824 Aug 10 16:09:55 devstack sudo[105357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:09:55 devstack sudo[105356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94d8702e-9652-4319-94ff-fc0294ea1b4b_0rcccu4vdevstack@QuobyteHD Aug 10 16:09:55 devstack sudo[105356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:09:55 devstack sudo[105356]: pam_unix(sudo:session): session closed for user root Aug 10 16:09:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-179d9699-975c-42ad-be13-406ab2df60e4 tempest-VolumesExtendTest-1532672814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94d8702e-9652-4319-94ff-fc0294ea1b4b_0rcccu4vdevstack@QuobyteHD" returned: 0 in 0.348s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:09:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-179d9699-975c-42ad-be13-406ab2df60e4 tempest-VolumesExtendTest-1532672814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:09:56 devstack sudo[105357]: pam_unix(sudo:session): session closed for user root Aug 10 16:09:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6a339e43-8fab-4011-a07f-41ea1e6e8477 tempest-ProjectReaderTests-600290529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-463c4e3d-5182-43ef-a5ab-010c0a578966 1073741824" returned: 0 in 0.442s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:09:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6a339e43-8fab-4011-a07f-41ea1e6e8477 tempest-ProjectReaderTests-600290529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-463c4e3d-5182-43ef-a5ab-010c0a578966 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:09:56 devstack sudo[105374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-463c4e3d-5182-43ef-a5ab-010c0a578966 Aug 10 16:09:56 devstack sudo[105374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:09:56 devstack sudo[105374]: pam_unix(sudo:session): session closed for user root Aug 10 16:09:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6a339e43-8fab-4011-a07f-41ea1e6e8477 tempest-ProjectReaderTests-600290529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-463c4e3d-5182-43ef-a5ab-010c0a578966" returned: 0 in 0.272s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:09:56 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-6a339e43-8fab-4011-a07f-41ea1e6e8477 tempest-ProjectReaderTests-600290529 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:09:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-6a339e43-8fab-4011-a07f-41ea1e6e8477 tempest-ProjectReaderTests-600290529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:09:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-179d9699-975c-42ad-be13-406ab2df60e4 tempest-VolumesExtendTest-1532672814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.478s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:09:56 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-179d9699-975c-42ad-be13-406ab2df60e4 tempest-VolumesExtendTest-1532672814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:09:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-455652460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4035dca5-aac8-4bdc-b18e-8f8ccd2141ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f80d4f98d04541e5baf967a588875585',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:09:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:09:54Z,use_quota=True,user_id='ec28e9285dfe47b58d86b0b076199e04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:09:56 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-179d9699-975c-42ad-be13-406ab2df60e4 tempest-VolumesExtendTest-1532672814 None] Creating volume 4035dca5-aac8-4bdc-b18e-8f8ccd2141ec {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:09:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-179d9699-975c-42ad-be13-406ab2df60e4 tempest-VolumesExtendTest-1532672814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:09:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-179d9699-975c-42ad-be13-406ab2df60e4 tempest-VolumesExtendTest-1532672814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:09:56 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-179d9699-975c-42ad-be13-406ab2df60e4 tempest-VolumesExtendTest-1532672814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:09:56 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-179d9699-975c-42ad-be13-406ab2df60e4 tempest-VolumesExtendTest-1532672814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:09:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-179d9699-975c-42ad-be13-406ab2df60e4 tempest-VolumesExtendTest-1532672814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:09:56 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-179d9699-975c-42ad-be13-406ab2df60e4 tempest-VolumesExtendTest-1532672814 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:09:56 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-179d9699-975c-42ad-be13-406ab2df60e4 tempest-VolumesExtendTest-1532672814 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:09:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-179d9699-975c-42ad-be13-406ab2df60e4 tempest-VolumesExtendTest-1532672814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4035dca5-aac8-4bdc-b18e-8f8ccd2141ec 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:09:56 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-6a339e43-8fab-4011-a07f-41ea1e6e8477 tempest-ProjectReaderTests-600290529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (529eef32-9dd1-4a8d-840d-1f2718d2e7d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-463c4e3d-5182-43ef-a5ab-010c0a578966', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:09:56 devstack sudo[105405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4035dca5-aac8-4bdc-b18e-8f8ccd2141ec 1073741824 Aug 10 16:09:56 devstack sudo[105405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:09:56 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-6a339e43-8fab-4011-a07f-41ea1e6e8477 tempest-ProjectReaderTests-600290529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (403ae58b-40eb-4c88-86d3-c885edb4b15f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:09:56 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-6a339e43-8fab-4011-a07f-41ea1e6e8477 tempest-ProjectReaderTests-600290529 None] Volume volume-463c4e3d-5182-43ef-a5ab-010c0a578966 (463c4e3d-5182-43ef-a5ab-010c0a578966): created successfully Aug 10 16:09:56 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-6a339e43-8fab-4011-a07f-41ea1e6e8477 tempest-ProjectReaderTests-600290529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (403ae58b-40eb-4c88-86d3-c885edb4b15f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:09:56 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-6a339e43-8fab-4011-a07f-41ea1e6e8477 tempest-ProjectReaderTests-600290529 None] Flow 'volume_create_manager' (7400a956-fb4a-4b08-acbb-4ea360fb5cbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:09:56 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-6a339e43-8fab-4011-a07f-41ea1e6e8477 tempest-ProjectReaderTests-600290529 None] Created volume successfully. Aug 10 16:09:56 devstack sudo[105405]: pam_unix(sudo:session): session closed for user root Aug 10 16:09:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-179d9699-975c-42ad-be13-406ab2df60e4 tempest-VolumesExtendTest-1532672814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4035dca5-aac8-4bdc-b18e-8f8ccd2141ec 1073741824" returned: 0 in 0.493s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:09:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-179d9699-975c-42ad-be13-406ab2df60e4 tempest-VolumesExtendTest-1532672814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4035dca5-aac8-4bdc-b18e-8f8ccd2141ec {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:09:57 devstack sudo[105410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4035dca5-aac8-4bdc-b18e-8f8ccd2141ec Aug 10 16:09:57 devstack sudo[105410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:09:57 devstack sudo[105410]: pam_unix(sudo:session): session closed for user root Aug 10 16:09:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-179d9699-975c-42ad-be13-406ab2df60e4 tempest-VolumesExtendTest-1532672814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4035dca5-aac8-4bdc-b18e-8f8ccd2141ec" returned: 0 in 0.267s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:09:57 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-179d9699-975c-42ad-be13-406ab2df60e4 tempest-VolumesExtendTest-1532672814 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:09:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-179d9699-975c-42ad-be13-406ab2df60e4 tempest-VolumesExtendTest-1532672814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:09:57 devstack cinder-volume[88641]: DEBUG cinder.volume.volume_utils [None req-179d9699-975c-42ad-be13-406ab2df60e4 tempest-VolumesExtendTest-1532672814 None] Attempting download of 94d8702e-9652-4319-94ff-fc0294ea1b4b ((None, [{'url': 'file:///opt/stack/data/glance/images/94d8702e-9652-4319-94ff-fc0294ea1b4b', 'metadata': {}}])) to volume 4035dca5-aac8-4bdc-b18e-8f8ccd2141ec. {{(pid=88641) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 10 16:09:57 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[a29f2ff8-c345-4ca5-bced-fdb4fe0001ea]: (4, 'raw') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:09:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-179d9699-975c-42ad-be13-406ab2df60e4 tempest-VolumesExtendTest-1532672814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_94d8702e-9652-4319-94ff-fc0294ea1b4b_9jpl7k0c {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:09:57 devstack sudo[105413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_94d8702e-9652-4319-94ff-fc0294ea1b4b_9jpl7k0c Aug 10 16:09:57 devstack sudo[105413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:09:57 devstack sudo[105413]: pam_unix(sudo:session): session closed for user root Aug 10 16:09:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-179d9699-975c-42ad-be13-406ab2df60e4 tempest-VolumesExtendTest-1532672814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_94d8702e-9652-4319-94ff-fc0294ea1b4b_9jpl7k0c" returned: 0 in 0.351s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:09:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-179d9699-975c-42ad-be13-406ab2df60e4 tempest-VolumesExtendTest-1532672814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_94d8702e-9652-4319-94ff-fc0294ea1b4b_9jpl7k0c {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:09:57 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-2e7eb58f-45c1-4448-98f0-168cd3c27551 tempest-ProjectReaderTests-600290529 None] Acquiring lock "cinder-463c4e3d-5182-43ef-a5ab-010c0a578966-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:09:57 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-2e7eb58f-45c1-4448-98f0-168cd3c27551 tempest-ProjectReaderTests-600290529 None] Lock "cinder-463c4e3d-5182-43ef-a5ab-010c0a578966-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:09:57 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-2e7eb58f-45c1-4448-98f0-168cd3c27551 tempest-ProjectReaderTests-600290529 None] Acquiring lock "cinder-quobyte-463c4e3d-5182-43ef-a5ab-010c0a578966" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:09:57 devstack sudo[105417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_94d8702e-9652-4319-94ff-fc0294ea1b4b_9jpl7k0c Aug 10 16:09:57 devstack sudo[105417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:09:57 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-2e7eb58f-45c1-4448-98f0-168cd3c27551 tempest-ProjectReaderTests-600290529 None] Lock "cinder-quobyte-463c4e3d-5182-43ef-a5ab-010c0a578966" acquired by "delete_volume" :: waited 0.019s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:09:57 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[c552a0fd-e957-416a-970a-904592e1efac]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:09:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-2e7eb58f-45c1-4448-98f0-168cd3c27551 tempest-ProjectReaderTests-600290529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-463c4e3d-5182-43ef-a5ab-010c0a578966 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:09:57 devstack sudo[105419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-463c4e3d-5182-43ef-a5ab-010c0a578966 Aug 10 16:09:57 devstack sudo[105419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:09:58 devstack sudo[105417]: pam_unix(sudo:session): session closed for user root Aug 10 16:09:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-179d9699-975c-42ad-be13-406ab2df60e4 tempest-VolumesExtendTest-1532672814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_94d8702e-9652-4319-94ff-fc0294ea1b4b_9jpl7k0c" returned: 1 in 0.375s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:09:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-179d9699-975c-42ad-be13-406ab2df60e4 tempest-VolumesExtendTest-1532672814 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_94d8702e-9652-4319-94ff-fc0294ea1b4b_9jpl7k0c' failed. Not Retrying. {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 10 16:09:58 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[7756ddbe-1563-460b-962e-5ba0b5f54806]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:09:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-179d9699-975c-42ad-be13-406ab2df60e4 tempest-VolumesExtendTest-1532672814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94d8702e-9652-4319-94ff-fc0294ea1b4b_0rcccu4vdevstack@QuobyteHD {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:09:58 devstack sudo[105423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94d8702e-9652-4319-94ff-fc0294ea1b4b_0rcccu4vdevstack@QuobyteHD Aug 10 16:09:58 devstack sudo[105423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:09:58 devstack sudo[105419]: pam_unix(sudo:session): session closed for user root Aug 10 16:09:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-2e7eb58f-45c1-4448-98f0-168cd3c27551 tempest-ProjectReaderTests-600290529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-463c4e3d-5182-43ef-a5ab-010c0a578966" returned: 0 in 0.380s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:09:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-2e7eb58f-45c1-4448-98f0-168cd3c27551 tempest-ProjectReaderTests-600290529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-463c4e3d-5182-43ef-a5ab-010c0a578966 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:09:58 devstack sudo[105428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-463c4e3d-5182-43ef-a5ab-010c0a578966 Aug 10 16:09:58 devstack sudo[105428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:09:58 devstack sudo[105423]: pam_unix(sudo:session): session closed for user root Aug 10 16:09:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-179d9699-975c-42ad-be13-406ab2df60e4 tempest-VolumesExtendTest-1532672814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_94d8702e-9652-4319-94ff-fc0294ea1b4b_0rcccu4vdevstack@QuobyteHD" returned: 0 in 0.338s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:09:58 devstack cinder-volume[88641]: DEBUG cinder.image.image_utils [None req-179d9699-975c-42ad-be13-406ab2df60e4 tempest-VolumesExtendTest-1532672814 None] 94d8702e-9652-4319-94ff-fc0294ea1b4b was qcow2, converting to qcow2 {{(pid=88641) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 10 16:09:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-179d9699-975c-42ad-be13-406ab2df60e4 tempest-VolumesExtendTest-1532672814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_94d8702e-9652-4319-94ff-fc0294ea1b4b_0rcccu4vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4035dca5-aac8-4bdc-b18e-8f8ccd2141ec {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:09:58 devstack sudo[105433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_94d8702e-9652-4319-94ff-fc0294ea1b4b_0rcccu4vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4035dca5-aac8-4bdc-b18e-8f8ccd2141ec Aug 10 16:09:58 devstack sudo[105433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:09:58 devstack sudo[105428]: pam_unix(sudo:session): session closed for user root Aug 10 16:09:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-2e7eb58f-45c1-4448-98f0-168cd3c27551 tempest-ProjectReaderTests-600290529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-463c4e3d-5182-43ef-a5ab-010c0a578966" returned: 0 in 0.262s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:09:58 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-2e7eb58f-45c1-4448-98f0-168cd3c27551 tempest-ProjectReaderTests-600290529 None] Lock "cinder-quobyte-463c4e3d-5182-43ef-a5ab-010c0a578966" released by "delete_volume" :: held 0.704s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:09:58 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-2e7eb58f-45c1-4448-98f0-168cd3c27551 tempest-ProjectReaderTests-600290529 None] Created reservations ['210da001-a88c-4354-a853-272c2a38db70', '5bf1e5df-3d03-46fa-92ac-c68cfbfbd1ef', '9483de6c-ec82-4b76-bfb4-c6380684a516', '9b841353-2278-4218-98a0-da979eb5d20e'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:09:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-2e7eb58f-45c1-4448-98f0-168cd3c27551 tempest-ProjectReaderTests-600290529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:09:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-2e7eb58f-45c1-4448-98f0-168cd3c27551 tempest-ProjectReaderTests-600290529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:09:58 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-2e7eb58f-45c1-4448-98f0-168cd3c27551 tempest-ProjectReaderTests-600290529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:09:58 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-2e7eb58f-45c1-4448-98f0-168cd3c27551 tempest-ProjectReaderTests-600290529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:09:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-2e7eb58f-45c1-4448-98f0-168cd3c27551 tempest-ProjectReaderTests-600290529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:09:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-2e7eb58f-45c1-4448-98f0-168cd3c27551 tempest-ProjectReaderTests-600290529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:09:58 devstack sudo[105439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:09:58 devstack sudo[105439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:09:58 devstack sudo[105439]: pam_unix(sudo:session): session closed for user root Aug 10 16:09:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-2e7eb58f-45c1-4448-98f0-168cd3c27551 tempest-ProjectReaderTests-600290529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.284s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:09:58 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-2e7eb58f-45c1-4448-98f0-168cd3c27551 tempest-ProjectReaderTests-600290529 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:09:58 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-2e7eb58f-45c1-4448-98f0-168cd3c27551 tempest-ProjectReaderTests-600290529 None] Deleted volume successfully. Aug 10 16:09:58 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-2e7eb58f-45c1-4448-98f0-168cd3c27551 tempest-ProjectReaderTests-600290529 None] Lock "cinder-463c4e3d-5182-43ef-a5ab-010c0a578966-delete_volume" released by "delete_volume" :: held 1.222s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:09:59 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-f23e3d5d-a5c2-4c10-b861-9c7d7e81e3b7 tempest-ProjectReaderTests-600290529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:09:59 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-f23e3d5d-a5c2-4c10-b861-9c7d7e81e3b7 tempest-ProjectReaderTests-600290529 None] Flow 'volume_create_manager' (5ae0b3d4-dbce-497c-a11a-989b92083b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:09:59 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-f23e3d5d-a5c2-4c10-b861-9c7d7e81e3b7 tempest-ProjectReaderTests-600290529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82ad0cb0-d6f0-41c3-afb7-72ff206fc508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:09:59 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-f23e3d5d-a5c2-4c10-b861-9c7d7e81e3b7 tempest-ProjectReaderTests-600290529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82ad0cb0-d6f0-41c3-afb7-72ff206fc508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:09:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1562471493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f26e9139-fb28-48cc-9bdd-97794f42462e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53857507237a4d6ba384dae68f55dabc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:09:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:09:59Z,use_quota=True,user_id='8245b9a6dde84cada1ac610cb362d2d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:09:59 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-f23e3d5d-a5c2-4c10-b861-9c7d7e81e3b7 tempest-ProjectReaderTests-600290529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45e8be6f-290b-4369-8531-0145a4de625c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:09:59 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-f23e3d5d-a5c2-4c10-b861-9c7d7e81e3b7 tempest-ProjectReaderTests-600290529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45e8be6f-290b-4369-8531-0145a4de625c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:09:59 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-f23e3d5d-a5c2-4c10-b861-9c7d7e81e3b7 tempest-ProjectReaderTests-600290529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b3c7e90-37b5-4024-a811-98d791f6e050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:09:59 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-f23e3d5d-a5c2-4c10-b861-9c7d7e81e3b7 tempest-ProjectReaderTests-600290529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b3c7e90-37b5-4024-a811-98d791f6e050) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f26e9139-fb28-48cc-9bdd-97794f42462e', 'volume_name': 'volume-f26e9139-fb28-48cc-9bdd-97794f42462e', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:09:59 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-f23e3d5d-a5c2-4c10-b861-9c7d7e81e3b7 tempest-ProjectReaderTests-600290529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fddb782e-beab-44ef-b5ac-610901766273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:09:59 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-f23e3d5d-a5c2-4c10-b861-9c7d7e81e3b7 tempest-ProjectReaderTests-600290529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fddb782e-beab-44ef-b5ac-610901766273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:09:59 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-f23e3d5d-a5c2-4c10-b861-9c7d7e81e3b7 tempest-ProjectReaderTests-600290529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e44eb5bf-b726-40d0-8340-6eb4d4a49b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:09:59 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-f23e3d5d-a5c2-4c10-b861-9c7d7e81e3b7 tempest-ProjectReaderTests-600290529 None] Volume f26e9139-fb28-48cc-9bdd-97794f42462e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f26e9139-fb28-48cc-9bdd-97794f42462e', 'volume_size': 1} Aug 10 16:09:59 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-f23e3d5d-a5c2-4c10-b861-9c7d7e81e3b7 tempest-ProjectReaderTests-600290529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:09:59 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-f23e3d5d-a5c2-4c10-b861-9c7d7e81e3b7 tempest-ProjectReaderTests-600290529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:09:59 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-f23e3d5d-a5c2-4c10-b861-9c7d7e81e3b7 tempest-ProjectReaderTests-600290529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:09:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1562471493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f26e9139-fb28-48cc-9bdd-97794f42462e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53857507237a4d6ba384dae68f55dabc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:09:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:09:59Z,use_quota=True,user_id='8245b9a6dde84cada1ac610cb362d2d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:09:59 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-f23e3d5d-a5c2-4c10-b861-9c7d7e81e3b7 tempest-ProjectReaderTests-600290529 None] Creating volume f26e9139-fb28-48cc-9bdd-97794f42462e {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:09:59 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-f23e3d5d-a5c2-4c10-b861-9c7d7e81e3b7 tempest-ProjectReaderTests-600290529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:09:59 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-f23e3d5d-a5c2-4c10-b861-9c7d7e81e3b7 tempest-ProjectReaderTests-600290529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:09:59 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-f23e3d5d-a5c2-4c10-b861-9c7d7e81e3b7 tempest-ProjectReaderTests-600290529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:09:59 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-f23e3d5d-a5c2-4c10-b861-9c7d7e81e3b7 tempest-ProjectReaderTests-600290529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:09:59 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-f23e3d5d-a5c2-4c10-b861-9c7d7e81e3b7 tempest-ProjectReaderTests-600290529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:09:59 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-f23e3d5d-a5c2-4c10-b861-9c7d7e81e3b7 tempest-ProjectReaderTests-600290529 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:09:59 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-f23e3d5d-a5c2-4c10-b861-9c7d7e81e3b7 tempest-ProjectReaderTests-600290529 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:09:59 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-f23e3d5d-a5c2-4c10-b861-9c7d7e81e3b7 tempest-ProjectReaderTests-600290529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f26e9139-fb28-48cc-9bdd-97794f42462e 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:09:59 devstack sudo[105445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f26e9139-fb28-48cc-9bdd-97794f42462e 1073741824 Aug 10 16:09:59 devstack sudo[105445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:10:00 devstack sudo[105445]: pam_unix(sudo:session): session closed for user root Aug 10 16:10:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-f23e3d5d-a5c2-4c10-b861-9c7d7e81e3b7 tempest-ProjectReaderTests-600290529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f26e9139-fb28-48cc-9bdd-97794f42462e 1073741824" returned: 0 in 0.515s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:10:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-f23e3d5d-a5c2-4c10-b861-9c7d7e81e3b7 tempest-ProjectReaderTests-600290529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f26e9139-fb28-48cc-9bdd-97794f42462e {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:10:00 devstack sudo[105451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f26e9139-fb28-48cc-9bdd-97794f42462e Aug 10 16:10:00 devstack sudo[105451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:10:00 devstack sudo[105433]: pam_unix(sudo:session): session closed for user root Aug 10 16:10:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-179d9699-975c-42ad-be13-406ab2df60e4 tempest-VolumesExtendTest-1532672814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_94d8702e-9652-4319-94ff-fc0294ea1b4b_0rcccu4vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4035dca5-aac8-4bdc-b18e-8f8ccd2141ec" returned: 0 in 1.819s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:10:00 devstack cinder-volume[88641]: DEBUG cinder.image.image_utils [None req-179d9699-975c-42ad-be13-406ab2df60e4 tempest-VolumesExtendTest-1532672814 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_94d8702e-9652-4319-94ff-fc0294ea1b4b_0rcccu4vdevstack@QuobyteHD, size 112.00 MB, duration 1.82 sec, destination /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4035dca5-aac8-4bdc-b18e-8f8ccd2141ec {{(pid=88641) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 10 16:10:00 devstack cinder-volume[88641]: INFO cinder.image.image_utils [None req-179d9699-975c-42ad-be13-406ab2df60e4 tempest-VolumesExtendTest-1532672814 None] Converted 112.00 MB image at 61.53 MB/s Aug 10 16:10:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-179d9699-975c-42ad-be13-406ab2df60e4 tempest-VolumesExtendTest-1532672814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4035dca5-aac8-4bdc-b18e-8f8ccd2141ec 1G {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:10:00 devstack sudo[105453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4035dca5-aac8-4bdc-b18e-8f8ccd2141ec 1G Aug 10 16:10:00 devstack sudo[105453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:10:00 devstack sudo[105451]: pam_unix(sudo:session): session closed for user root Aug 10 16:10:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-f23e3d5d-a5c2-4c10-b861-9c7d7e81e3b7 tempest-ProjectReaderTests-600290529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f26e9139-fb28-48cc-9bdd-97794f42462e" returned: 0 in 0.273s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:10:00 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-f23e3d5d-a5c2-4c10-b861-9c7d7e81e3b7 tempest-ProjectReaderTests-600290529 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:10:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-f23e3d5d-a5c2-4c10-b861-9c7d7e81e3b7 tempest-ProjectReaderTests-600290529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:10:00 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-f23e3d5d-a5c2-4c10-b861-9c7d7e81e3b7 tempest-ProjectReaderTests-600290529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e44eb5bf-b726-40d0-8340-6eb4d4a49b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f26e9139-fb28-48cc-9bdd-97794f42462e', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:10:00 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-f23e3d5d-a5c2-4c10-b861-9c7d7e81e3b7 tempest-ProjectReaderTests-600290529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10738a05-c78d-4fb2-8d1b-6e06431ce23c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:10:00 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-f23e3d5d-a5c2-4c10-b861-9c7d7e81e3b7 tempest-ProjectReaderTests-600290529 None] Volume volume-f26e9139-fb28-48cc-9bdd-97794f42462e (f26e9139-fb28-48cc-9bdd-97794f42462e): created successfully Aug 10 16:10:00 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-f23e3d5d-a5c2-4c10-b861-9c7d7e81e3b7 tempest-ProjectReaderTests-600290529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10738a05-c78d-4fb2-8d1b-6e06431ce23c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:10:00 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-f23e3d5d-a5c2-4c10-b861-9c7d7e81e3b7 tempest-ProjectReaderTests-600290529 None] Flow 'volume_create_manager' (5ae0b3d4-dbce-497c-a11a-989b92083b0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:10:00 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-f23e3d5d-a5c2-4c10-b861-9c7d7e81e3b7 tempest-ProjectReaderTests-600290529 None] Created volume successfully. Aug 10 16:10:00 devstack sudo[105453]: pam_unix(sudo:session): session closed for user root Aug 10 16:10:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-179d9699-975c-42ad-be13-406ab2df60e4 tempest-VolumesExtendTest-1532672814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4035dca5-aac8-4bdc-b18e-8f8ccd2141ec 1G" returned: 0 in 0.318s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:10:00 devstack cinder-volume[88641]: DEBUG cinder.volume.volume_utils [None req-179d9699-975c-42ad-be13-406ab2df60e4 tempest-VolumesExtendTest-1532672814 None] Downloaded image 94d8702e-9652-4319-94ff-fc0294ea1b4b ((None, [{'url': 'file:///opt/stack/data/glance/images/94d8702e-9652-4319-94ff-fc0294ea1b4b', 'metadata': {}}])) to volume 4035dca5-aac8-4bdc-b18e-8f8ccd2141ec successfully. {{(pid=88641) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 10 16:10:00 devstack cinder-volume[88641]: DEBUG cinder.image.image_utils [None req-179d9699-975c-42ad-be13-406ab2df60e4 tempest-VolumesExtendTest-1532672814 None] Temporary image 94d8702e-9652-4319-94ff-fc0294ea1b4b for user ec28e9285dfe47b58d86b0b076199e04 is deleted. {{(pid=88641) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 10 16:10:00 devstack cinder-volume[88641]: DEBUG cinder.volume.volume_utils [None req-179d9699-975c-42ad-be13-406ab2df60e4 tempest-VolumesExtendTest-1532672814 None] Marking volume 4035dca5-aac8-4bdc-b18e-8f8ccd2141ec as bootable. {{(pid=88641) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 10 16:10:00 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-179d9699-975c-42ad-be13-406ab2df60e4 tempest-VolumesExtendTest-1532672814 None] Copying metadata from image 94d8702e-9652-4319-94ff-fc0294ea1b4b to 4035dca5-aac8-4bdc-b18e-8f8ccd2141ec. {{(pid=88641) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 10 16:10:00 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-179d9699-975c-42ad-be13-406ab2df60e4 tempest-VolumesExtendTest-1532672814 None] Creating volume glance metadata for volume 4035dca5-aac8-4bdc-b18e-8f8ccd2141ec backed by image 94d8702e-9652-4319-94ff-fc0294ea1b4b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '94d8702e-9652-4319-94ff-fc0294ea1b4b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88641) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 10 16:10:00 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-179d9699-975c-42ad-be13-406ab2df60e4 tempest-VolumesExtendTest-1532672814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfa2f7a0-87c3-4a42-8a48-3c247cc7d5a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4035dca5-aac8-4bdc-b18e-8f8ccd2141ec', 'volume_size': 1, 'image_id': '94d8702e-9652-4319-94ff-fc0294ea1b4b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/94d8702e-9652-4319-94ff-fc0294ea1b4b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9e18d747214f4822be3dc7f3bd0a3775', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '94d8702e-9652-4319-94ff-fc0294ea1b4b', 'created_at': datetime.datetime(2026, 8, 10, 13, 48, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 10, 13, 48, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/94d8702e-9652-4319-94ff-fc0294ea1b4b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:10:00 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-179d9699-975c-42ad-be13-406ab2df60e4 tempest-VolumesExtendTest-1532672814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f991035-295b-4571-9068-ce9bc849e471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:10:00 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-179d9699-975c-42ad-be13-406ab2df60e4 tempest-VolumesExtendTest-1532672814 None] Volume volume-4035dca5-aac8-4bdc-b18e-8f8ccd2141ec (4035dca5-aac8-4bdc-b18e-8f8ccd2141ec): created successfully Aug 10 16:10:00 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-179d9699-975c-42ad-be13-406ab2df60e4 tempest-VolumesExtendTest-1532672814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f991035-295b-4571-9068-ce9bc849e471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:10:00 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-179d9699-975c-42ad-be13-406ab2df60e4 tempest-VolumesExtendTest-1532672814 None] Flow 'volume_create_manager' (1eadfe17-06cc-4d08-97d8-a401a8ce7d20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:10:00 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-179d9699-975c-42ad-be13-406ab2df60e4 tempest-VolumesExtendTest-1532672814 None] Created volume successfully. Aug 10 16:10:01 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-6e17cfd6-0959-4cd6-957d-29555ef70fef tempest-ProjectReaderTests-600290529 None] Acquiring lock "cinder-f26e9139-fb28-48cc-9bdd-97794f42462e-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:10:01 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-6e17cfd6-0959-4cd6-957d-29555ef70fef tempest-ProjectReaderTests-600290529 None] Lock "cinder-f26e9139-fb28-48cc-9bdd-97794f42462e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:10:01 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-6e17cfd6-0959-4cd6-957d-29555ef70fef tempest-ProjectReaderTests-600290529 None] Acquiring lock "cinder-quobyte-f26e9139-fb28-48cc-9bdd-97794f42462e" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:10:01 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-6e17cfd6-0959-4cd6-957d-29555ef70fef tempest-ProjectReaderTests-600290529 None] Lock "cinder-quobyte-f26e9139-fb28-48cc-9bdd-97794f42462e" acquired by "delete_volume" :: waited 0.021s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:10:01 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4cb1138-336f-4bc9-b4ee-9894c9f7a608]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:10:01 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6e17cfd6-0959-4cd6-957d-29555ef70fef tempest-ProjectReaderTests-600290529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f26e9139-fb28-48cc-9bdd-97794f42462e {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:10:01 devstack sudo[105459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f26e9139-fb28-48cc-9bdd-97794f42462e Aug 10 16:10:01 devstack sudo[105459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:10:01 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-68819ee5-349f-4602-aa29-1944cad0df01 tempest-VolumesExtendTest-1532672814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:10:01 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-68819ee5-349f-4602-aa29-1944cad0df01 tempest-VolumesExtendTest-1532672814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:10:01 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cfd598d-617e-40fd-927b-ac8bdd2d0d4a]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:10:01 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-68819ee5-349f-4602-aa29-1944cad0df01 tempest-VolumesExtendTest-1532672814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4035dca5-aac8-4bdc-b18e-8f8ccd2141ec {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:10:02 devstack sudo[105461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4035dca5-aac8-4bdc-b18e-8f8ccd2141ec Aug 10 16:10:02 devstack sudo[105461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:10:02 devstack sudo[105459]: pam_unix(sudo:session): session closed for user root Aug 10 16:10:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6e17cfd6-0959-4cd6-957d-29555ef70fef tempest-ProjectReaderTests-600290529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f26e9139-fb28-48cc-9bdd-97794f42462e" returned: 0 in 0.427s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:10:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6e17cfd6-0959-4cd6-957d-29555ef70fef tempest-ProjectReaderTests-600290529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f26e9139-fb28-48cc-9bdd-97794f42462e {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:10:02 devstack sudo[105466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f26e9139-fb28-48cc-9bdd-97794f42462e Aug 10 16:10:02 devstack sudo[105466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:10:02 devstack sudo[105461]: pam_unix(sudo:session): session closed for user root Aug 10 16:10:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-68819ee5-349f-4602-aa29-1944cad0df01 tempest-VolumesExtendTest-1532672814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4035dca5-aac8-4bdc-b18e-8f8ccd2141ec" returned: 0 in 0.380s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:10:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-68819ee5-349f-4602-aa29-1944cad0df01 tempest-VolumesExtendTest-1532672814 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4035dca5-aac8-4bdc-b18e-8f8ccd2141ec 2G {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:10:02 devstack sudo[105466]: pam_unix(sudo:session): session closed for user root Aug 10 16:10:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6e17cfd6-0959-4cd6-957d-29555ef70fef tempest-ProjectReaderTests-600290529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f26e9139-fb28-48cc-9bdd-97794f42462e" returned: 0 in 0.255s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:10:02 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-6e17cfd6-0959-4cd6-957d-29555ef70fef tempest-ProjectReaderTests-600290529 None] Lock "cinder-quobyte-f26e9139-fb28-48cc-9bdd-97794f42462e" released by "delete_volume" :: held 0.731s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:10:02 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-6e17cfd6-0959-4cd6-957d-29555ef70fef tempest-ProjectReaderTests-600290529 None] Created reservations ['3f11a71d-1173-4247-ad6b-907644bdf1f1', 'a76ee6e8-5d8e-4a75-9711-cfae06c93fa1', '1e243ea6-4dea-4590-afdb-dbddebda1164', '5057b854-1629-4260-b4fd-59bf2083d725'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:10:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-68819ee5-349f-4602-aa29-1944cad0df01 tempest-VolumesExtendTest-1532672814 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4035dca5-aac8-4bdc-b18e-8f8ccd2141ec 2G" returned: 0 in 0.120s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:10:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-68819ee5-349f-4602-aa29-1944cad0df01 tempest-VolumesExtendTest-1532672814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.528s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:10:02 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-68819ee5-349f-4602-aa29-1944cad0df01 tempest-VolumesExtendTest-1532672814 None] Extend volume completed successfully. Aug 10 16:10:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-6e17cfd6-0959-4cd6-957d-29555ef70fef tempest-ProjectReaderTests-600290529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:10:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-6e17cfd6-0959-4cd6-957d-29555ef70fef tempest-ProjectReaderTests-600290529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:10:02 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-6e17cfd6-0959-4cd6-957d-29555ef70fef tempest-ProjectReaderTests-600290529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:10:02 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-6e17cfd6-0959-4cd6-957d-29555ef70fef tempest-ProjectReaderTests-600290529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:10:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-6e17cfd6-0959-4cd6-957d-29555ef70fef tempest-ProjectReaderTests-600290529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:10:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6e17cfd6-0959-4cd6-957d-29555ef70fef tempest-ProjectReaderTests-600290529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:10:02 devstack sudo[105477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:10:02 devstack sudo[105477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:10:02 devstack sudo[105477]: pam_unix(sudo:session): session closed for user root Aug 10 16:10:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6e17cfd6-0959-4cd6-957d-29555ef70fef tempest-ProjectReaderTests-600290529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.246s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:10:02 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-6e17cfd6-0959-4cd6-957d-29555ef70fef tempest-ProjectReaderTests-600290529 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:10:02 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-6e17cfd6-0959-4cd6-957d-29555ef70fef tempest-ProjectReaderTests-600290529 None] Deleted volume successfully. Aug 10 16:10:02 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-6e17cfd6-0959-4cd6-957d-29555ef70fef tempest-ProjectReaderTests-600290529 None] Lock "cinder-f26e9139-fb28-48cc-9bdd-97794f42462e-delete_volume" released by "delete_volume" :: held 1.223s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:10:03 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5f40db4-bd22-4e70-bc97-b10e0806fc3d tempest-ProjectReaderTests-600290529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:10:03 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-a5f40db4-bd22-4e70-bc97-b10e0806fc3d tempest-ProjectReaderTests-600290529 None] Flow 'volume_create_manager' (4d60a12c-205e-40cd-ac8b-484916b1a5a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:10:03 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-a5f40db4-bd22-4e70-bc97-b10e0806fc3d tempest-ProjectReaderTests-600290529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e24706c3-20ba-45c9-b60a-6bf8968d92d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:10:03 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-e366a930-1b8e-43bd-a959-6f348218a603 tempest-VolumesExtendTest-1532672814 None] Acquiring lock "cinder-4035dca5-aac8-4bdc-b18e-8f8ccd2141ec-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:10:03 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-a5f40db4-bd22-4e70-bc97-b10e0806fc3d tempest-ProjectReaderTests-600290529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e24706c3-20ba-45c9-b60a-6bf8968d92d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:10:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1022263216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c8a8e41-818e-494e-9c75-5ffd2d392681,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53857507237a4d6ba384dae68f55dabc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:10:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:10:03Z,use_quota=True,user_id='8245b9a6dde84cada1ac610cb362d2d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:10:03 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-a5f40db4-bd22-4e70-bc97-b10e0806fc3d tempest-ProjectReaderTests-600290529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b14c16cc-61ae-4b78-a8d9-a98057866b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:10:03 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-a5f40db4-bd22-4e70-bc97-b10e0806fc3d tempest-ProjectReaderTests-600290529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b14c16cc-61ae-4b78-a8d9-a98057866b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:10:03 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-a5f40db4-bd22-4e70-bc97-b10e0806fc3d tempest-ProjectReaderTests-600290529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc3efca4-bbb7-40bd-8dbd-bb95c531ddee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:10:03 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-a5f40db4-bd22-4e70-bc97-b10e0806fc3d tempest-ProjectReaderTests-600290529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc3efca4-bbb7-40bd-8dbd-bb95c531ddee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c8a8e41-818e-494e-9c75-5ffd2d392681', 'volume_name': 'volume-7c8a8e41-818e-494e-9c75-5ffd2d392681', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:10:03 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-a5f40db4-bd22-4e70-bc97-b10e0806fc3d tempest-ProjectReaderTests-600290529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (878e922d-9702-4b50-a4c4-db7def602a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:10:03 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-a5f40db4-bd22-4e70-bc97-b10e0806fc3d tempest-ProjectReaderTests-600290529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (878e922d-9702-4b50-a4c4-db7def602a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:10:03 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-a5f40db4-bd22-4e70-bc97-b10e0806fc3d tempest-ProjectReaderTests-600290529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a767307-1b27-4911-9e51-5bb1c16360cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:10:03 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-a5f40db4-bd22-4e70-bc97-b10e0806fc3d tempest-ProjectReaderTests-600290529 None] Volume 7c8a8e41-818e-494e-9c75-5ffd2d392681: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c8a8e41-818e-494e-9c75-5ffd2d392681', 'volume_size': 1} Aug 10 16:10:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-a5f40db4-bd22-4e70-bc97-b10e0806fc3d tempest-ProjectReaderTests-600290529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:10:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-a5f40db4-bd22-4e70-bc97-b10e0806fc3d tempest-ProjectReaderTests-600290529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:10:03 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-a5f40db4-bd22-4e70-bc97-b10e0806fc3d tempest-ProjectReaderTests-600290529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:10:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1022263216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c8a8e41-818e-494e-9c75-5ffd2d392681,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53857507237a4d6ba384dae68f55dabc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:10:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:10:03Z,use_quota=True,user_id='8245b9a6dde84cada1ac610cb362d2d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:10:03 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-a5f40db4-bd22-4e70-bc97-b10e0806fc3d tempest-ProjectReaderTests-600290529 None] Creating volume 7c8a8e41-818e-494e-9c75-5ffd2d392681 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:10:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-a5f40db4-bd22-4e70-bc97-b10e0806fc3d tempest-ProjectReaderTests-600290529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:10:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-a5f40db4-bd22-4e70-bc97-b10e0806fc3d tempest-ProjectReaderTests-600290529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:10:03 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-a5f40db4-bd22-4e70-bc97-b10e0806fc3d tempest-ProjectReaderTests-600290529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:10:03 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-a5f40db4-bd22-4e70-bc97-b10e0806fc3d tempest-ProjectReaderTests-600290529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:10:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-a5f40db4-bd22-4e70-bc97-b10e0806fc3d tempest-ProjectReaderTests-600290529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:10:03 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-a5f40db4-bd22-4e70-bc97-b10e0806fc3d tempest-ProjectReaderTests-600290529 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:10:03 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-a5f40db4-bd22-4e70-bc97-b10e0806fc3d tempest-ProjectReaderTests-600290529 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:10:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a5f40db4-bd22-4e70-bc97-b10e0806fc3d tempest-ProjectReaderTests-600290529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-7c8a8e41-818e-494e-9c75-5ffd2d392681 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:10:03 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-e366a930-1b8e-43bd-a959-6f348218a603 tempest-VolumesExtendTest-1532672814 None] Lock "cinder-4035dca5-aac8-4bdc-b18e-8f8ccd2141ec-delete_volume" acquired by "delete_volume" :: waited 0.089s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:10:03 devstack sudo[105480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-7c8a8e41-818e-494e-9c75-5ffd2d392681 1073741824 Aug 10 16:10:03 devstack sudo[105480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:10:03 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-e366a930-1b8e-43bd-a959-6f348218a603 tempest-VolumesExtendTest-1532672814 None] Acquiring lock "cinder-quobyte-4035dca5-aac8-4bdc-b18e-8f8ccd2141ec" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:10:03 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-e366a930-1b8e-43bd-a959-6f348218a603 tempest-VolumesExtendTest-1532672814 None] Lock "cinder-quobyte-4035dca5-aac8-4bdc-b18e-8f8ccd2141ec" acquired by "delete_volume" :: waited 0.014s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:10:03 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[289e0e37-1eff-4f7f-bb91-3809f1abe1b8]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:10:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e366a930-1b8e-43bd-a959-6f348218a603 tempest-VolumesExtendTest-1532672814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4035dca5-aac8-4bdc-b18e-8f8ccd2141ec {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:10:03 devstack sudo[105482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4035dca5-aac8-4bdc-b18e-8f8ccd2141ec Aug 10 16:10:03 devstack sudo[105482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:10:03 devstack sudo[105482]: pam_unix(sudo:session): session closed for user root Aug 10 16:10:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e366a930-1b8e-43bd-a959-6f348218a603 tempest-VolumesExtendTest-1532672814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4035dca5-aac8-4bdc-b18e-8f8ccd2141ec" returned: 0 in 0.386s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:10:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e366a930-1b8e-43bd-a959-6f348218a603 tempest-VolumesExtendTest-1532672814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4035dca5-aac8-4bdc-b18e-8f8ccd2141ec {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:10:03 devstack sudo[105480]: pam_unix(sudo:session): session closed for user root Aug 10 16:10:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a5f40db4-bd22-4e70-bc97-b10e0806fc3d tempest-ProjectReaderTests-600290529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-7c8a8e41-818e-494e-9c75-5ffd2d392681 1073741824" returned: 0 in 0.502s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:10:03 devstack sudo[105490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4035dca5-aac8-4bdc-b18e-8f8ccd2141ec Aug 10 16:10:03 devstack sudo[105490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:10:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a5f40db4-bd22-4e70-bc97-b10e0806fc3d tempest-ProjectReaderTests-600290529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-7c8a8e41-818e-494e-9c75-5ffd2d392681 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:10:03 devstack sudo[105492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-7c8a8e41-818e-494e-9c75-5ffd2d392681 Aug 10 16:10:03 devstack sudo[105492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:10:04 devstack sudo[105490]: pam_unix(sudo:session): session closed for user root Aug 10 16:10:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e366a930-1b8e-43bd-a959-6f348218a603 tempest-VolumesExtendTest-1532672814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-4035dca5-aac8-4bdc-b18e-8f8ccd2141ec" returned: 0 in 0.271s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:10:04 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-e366a930-1b8e-43bd-a959-6f348218a603 tempest-VolumesExtendTest-1532672814 None] Lock "cinder-quobyte-4035dca5-aac8-4bdc-b18e-8f8ccd2141ec" released by "delete_volume" :: held 0.700s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:10:04 devstack sudo[105492]: pam_unix(sudo:session): session closed for user root Aug 10 16:10:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a5f40db4-bd22-4e70-bc97-b10e0806fc3d tempest-ProjectReaderTests-600290529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-7c8a8e41-818e-494e-9c75-5ffd2d392681" returned: 0 in 0.304s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:10:04 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-a5f40db4-bd22-4e70-bc97-b10e0806fc3d tempest-ProjectReaderTests-600290529 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:10:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-a5f40db4-bd22-4e70-bc97-b10e0806fc3d tempest-ProjectReaderTests-600290529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:10:04 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-e366a930-1b8e-43bd-a959-6f348218a603 tempest-VolumesExtendTest-1532672814 None] Created reservations ['31deca10-d830-441d-8063-307dbd3e563e', '89bcb747-49ce-4ddf-98a1-8d8bc005495b', '73e4f8b0-126c-42ab-a7a0-46437c8e3592', '13371bc3-7efd-4ff1-a987-25c8fc3d7c36'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:10:04 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-a5f40db4-bd22-4e70-bc97-b10e0806fc3d tempest-ProjectReaderTests-600290529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a767307-1b27-4911-9e51-5bb1c16360cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c8a8e41-818e-494e-9c75-5ffd2d392681', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:10:04 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-a5f40db4-bd22-4e70-bc97-b10e0806fc3d tempest-ProjectReaderTests-600290529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08923ad9-c4a1-4dc3-b8f0-df6babe7bda4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:10:04 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-a5f40db4-bd22-4e70-bc97-b10e0806fc3d tempest-ProjectReaderTests-600290529 None] Volume volume-7c8a8e41-818e-494e-9c75-5ffd2d392681 (7c8a8e41-818e-494e-9c75-5ffd2d392681): created successfully Aug 10 16:10:04 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-a5f40db4-bd22-4e70-bc97-b10e0806fc3d tempest-ProjectReaderTests-600290529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08923ad9-c4a1-4dc3-b8f0-df6babe7bda4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:10:04 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-a5f40db4-bd22-4e70-bc97-b10e0806fc3d tempest-ProjectReaderTests-600290529 None] Flow 'volume_create_manager' (4d60a12c-205e-40cd-ac8b-484916b1a5a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:10:04 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-a5f40db4-bd22-4e70-bc97-b10e0806fc3d tempest-ProjectReaderTests-600290529 None] Created volume successfully. Aug 10 16:10:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-e366a930-1b8e-43bd-a959-6f348218a603 tempest-VolumesExtendTest-1532672814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:10:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-e366a930-1b8e-43bd-a959-6f348218a603 tempest-VolumesExtendTest-1532672814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:10:04 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-e366a930-1b8e-43bd-a959-6f348218a603 tempest-VolumesExtendTest-1532672814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:10:04 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-e366a930-1b8e-43bd-a959-6f348218a603 tempest-VolumesExtendTest-1532672814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:10:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-e366a930-1b8e-43bd-a959-6f348218a603 tempest-VolumesExtendTest-1532672814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:10:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e366a930-1b8e-43bd-a959-6f348218a603 tempest-VolumesExtendTest-1532672814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:10:04 devstack sudo[105496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:10:04 devstack sudo[105496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:10:04 devstack sudo[105496]: pam_unix(sudo:session): session closed for user root Aug 10 16:10:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e366a930-1b8e-43bd-a959-6f348218a603 tempest-VolumesExtendTest-1532672814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.288s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:10:04 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-e366a930-1b8e-43bd-a959-6f348218a603 tempest-VolumesExtendTest-1532672814 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:10:04 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-e366a930-1b8e-43bd-a959-6f348218a603 tempest-VolumesExtendTest-1532672814 None] Deleted volume successfully. Aug 10 16:10:04 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-e366a930-1b8e-43bd-a959-6f348218a603 tempest-VolumesExtendTest-1532672814 None] Lock "cinder-4035dca5-aac8-4bdc-b18e-8f8ccd2141ec-delete_volume" released by "delete_volume" :: held 1.246s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:10:04 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ad2092f-1567-4e69-9693-224974c8193d tempest-VolumesExtendTest-1532672814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:10:04 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-3ad2092f-1567-4e69-9693-224974c8193d tempest-VolumesExtendTest-1532672814 None] Flow 'volume_create_manager' (3b19a6cb-6308-466a-b8db-cfbdeb7ad74b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:10:04 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-3ad2092f-1567-4e69-9693-224974c8193d tempest-VolumesExtendTest-1532672814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd874902-400b-4af0-af69-38d2cc1b7833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:10:04 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-3ad2092f-1567-4e69-9693-224974c8193d tempest-VolumesExtendTest-1532672814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd874902-400b-4af0-af69-38d2cc1b7833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:10:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1185220476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f96fb8a9-87a1-4f6b-aa98-23acb8e93e68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f80d4f98d04541e5baf967a588875585',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:10:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:10:05Z,use_quota=True,user_id='ec28e9285dfe47b58d86b0b076199e04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:10:04 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-3ad2092f-1567-4e69-9693-224974c8193d tempest-VolumesExtendTest-1532672814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5682a870-e273-415b-b912-fb73c2990f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:10:04 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-3ad2092f-1567-4e69-9693-224974c8193d tempest-VolumesExtendTest-1532672814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5682a870-e273-415b-b912-fb73c2990f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:10:04 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-3ad2092f-1567-4e69-9693-224974c8193d tempest-VolumesExtendTest-1532672814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00c86702-0089-4a44-aea1-467e995a3452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:10:04 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-3ad2092f-1567-4e69-9693-224974c8193d tempest-VolumesExtendTest-1532672814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00c86702-0089-4a44-aea1-467e995a3452) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f96fb8a9-87a1-4f6b-aa98-23acb8e93e68', 'volume_name': 'volume-f96fb8a9-87a1-4f6b-aa98-23acb8e93e68', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:10:04 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-3ad2092f-1567-4e69-9693-224974c8193d tempest-VolumesExtendTest-1532672814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed9ce0a9-5a14-4855-8234-f15f6f615526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:10:04 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-3ad2092f-1567-4e69-9693-224974c8193d tempest-VolumesExtendTest-1532672814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed9ce0a9-5a14-4855-8234-f15f6f615526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:10:04 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-3ad2092f-1567-4e69-9693-224974c8193d tempest-VolumesExtendTest-1532672814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cb62511-1478-497a-80c9-f84ea61b3151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:10:04 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-3ad2092f-1567-4e69-9693-224974c8193d tempest-VolumesExtendTest-1532672814 None] Volume f96fb8a9-87a1-4f6b-aa98-23acb8e93e68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f96fb8a9-87a1-4f6b-aa98-23acb8e93e68', 'volume_size': 1} Aug 10 16:10:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-3ad2092f-1567-4e69-9693-224974c8193d tempest-VolumesExtendTest-1532672814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:10:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-3ad2092f-1567-4e69-9693-224974c8193d tempest-VolumesExtendTest-1532672814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:10:04 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-3ad2092f-1567-4e69-9693-224974c8193d tempest-VolumesExtendTest-1532672814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:10:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1185220476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f96fb8a9-87a1-4f6b-aa98-23acb8e93e68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f80d4f98d04541e5baf967a588875585',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:10:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:10:05Z,use_quota=True,user_id='ec28e9285dfe47b58d86b0b076199e04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:10:04 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-3ad2092f-1567-4e69-9693-224974c8193d tempest-VolumesExtendTest-1532672814 None] Creating volume f96fb8a9-87a1-4f6b-aa98-23acb8e93e68 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:10:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-3ad2092f-1567-4e69-9693-224974c8193d tempest-VolumesExtendTest-1532672814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:10:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-3ad2092f-1567-4e69-9693-224974c8193d tempest-VolumesExtendTest-1532672814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:10:04 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-3ad2092f-1567-4e69-9693-224974c8193d tempest-VolumesExtendTest-1532672814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:10:04 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-3ad2092f-1567-4e69-9693-224974c8193d tempest-VolumesExtendTest-1532672814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:10:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-3ad2092f-1567-4e69-9693-224974c8193d tempest-VolumesExtendTest-1532672814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:10:04 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-3ad2092f-1567-4e69-9693-224974c8193d tempest-VolumesExtendTest-1532672814 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:10:04 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-3ad2092f-1567-4e69-9693-224974c8193d tempest-VolumesExtendTest-1532672814 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:10:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-3ad2092f-1567-4e69-9693-224974c8193d tempest-VolumesExtendTest-1532672814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f96fb8a9-87a1-4f6b-aa98-23acb8e93e68 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:10:04 devstack sudo[105499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f96fb8a9-87a1-4f6b-aa98-23acb8e93e68 1073741824 Aug 10 16:10:04 devstack sudo[105499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:10:05 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-68a06df7-4552-4efa-ac8c-84da81712cd7 tempest-ProjectReaderTests-600290529 None] Acquiring lock "cinder-7c8a8e41-818e-494e-9c75-5ffd2d392681-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:10:05 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-68a06df7-4552-4efa-ac8c-84da81712cd7 tempest-ProjectReaderTests-600290529 None] Lock "cinder-7c8a8e41-818e-494e-9c75-5ffd2d392681-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:10:05 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-68a06df7-4552-4efa-ac8c-84da81712cd7 tempest-ProjectReaderTests-600290529 None] Acquiring lock "cinder-quobyte-7c8a8e41-818e-494e-9c75-5ffd2d392681" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:10:05 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-68a06df7-4552-4efa-ac8c-84da81712cd7 tempest-ProjectReaderTests-600290529 None] Lock "cinder-quobyte-7c8a8e41-818e-494e-9c75-5ffd2d392681" acquired by "delete_volume" :: waited 0.017s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:10:05 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d395a9-56b1-4007-a07d-ed9510f5cca6]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:10:05 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-68a06df7-4552-4efa-ac8c-84da81712cd7 tempest-ProjectReaderTests-600290529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-7c8a8e41-818e-494e-9c75-5ffd2d392681 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:10:05 devstack sudo[105499]: pam_unix(sudo:session): session closed for user root Aug 10 16:10:05 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-3ad2092f-1567-4e69-9693-224974c8193d tempest-VolumesExtendTest-1532672814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f96fb8a9-87a1-4f6b-aa98-23acb8e93e68 1073741824" returned: 0 in 0.530s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:10:05 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-3ad2092f-1567-4e69-9693-224974c8193d tempest-VolumesExtendTest-1532672814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f96fb8a9-87a1-4f6b-aa98-23acb8e93e68 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:10:05 devstack sudo[105506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f96fb8a9-87a1-4f6b-aa98-23acb8e93e68 Aug 10 16:10:05 devstack sudo[105506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:10:05 devstack sudo[105505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-7c8a8e41-818e-494e-9c75-5ffd2d392681 Aug 10 16:10:05 devstack sudo[105505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:10:05 devstack sudo[105506]: pam_unix(sudo:session): session closed for user root Aug 10 16:10:05 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-3ad2092f-1567-4e69-9693-224974c8193d tempest-VolumesExtendTest-1532672814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f96fb8a9-87a1-4f6b-aa98-23acb8e93e68" returned: 0 in 0.290s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:10:05 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-3ad2092f-1567-4e69-9693-224974c8193d tempest-VolumesExtendTest-1532672814 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:10:05 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-3ad2092f-1567-4e69-9693-224974c8193d tempest-VolumesExtendTest-1532672814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:10:05 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-3ad2092f-1567-4e69-9693-224974c8193d tempest-VolumesExtendTest-1532672814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cb62511-1478-497a-80c9-f84ea61b3151) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f96fb8a9-87a1-4f6b-aa98-23acb8e93e68', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:10:05 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-3ad2092f-1567-4e69-9693-224974c8193d tempest-VolumesExtendTest-1532672814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (955226f6-784d-4a68-a044-c113510a7363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:10:05 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-3ad2092f-1567-4e69-9693-224974c8193d tempest-VolumesExtendTest-1532672814 None] Volume volume-f96fb8a9-87a1-4f6b-aa98-23acb8e93e68 (f96fb8a9-87a1-4f6b-aa98-23acb8e93e68): created successfully Aug 10 16:10:05 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-3ad2092f-1567-4e69-9693-224974c8193d tempest-VolumesExtendTest-1532672814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (955226f6-784d-4a68-a044-c113510a7363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:10:05 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-3ad2092f-1567-4e69-9693-224974c8193d tempest-VolumesExtendTest-1532672814 None] Flow 'volume_create_manager' (3b19a6cb-6308-466a-b8db-cfbdeb7ad74b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:10:05 devstack sudo[105505]: pam_unix(sudo:session): session closed for user root Aug 10 16:10:05 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-68a06df7-4552-4efa-ac8c-84da81712cd7 tempest-ProjectReaderTests-600290529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-7c8a8e41-818e-494e-9c75-5ffd2d392681" returned: 0 in 0.417s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:10:05 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-68a06df7-4552-4efa-ac8c-84da81712cd7 tempest-ProjectReaderTests-600290529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-7c8a8e41-818e-494e-9c75-5ffd2d392681 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:10:05 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-3ad2092f-1567-4e69-9693-224974c8193d tempest-VolumesExtendTest-1532672814 None] Created volume successfully. Aug 10 16:10:05 devstack sudo[105519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-7c8a8e41-818e-494e-9c75-5ffd2d392681 Aug 10 16:10:05 devstack sudo[105519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:10:06 devstack sudo[105519]: pam_unix(sudo:session): session closed for user root Aug 10 16:10:06 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-68a06df7-4552-4efa-ac8c-84da81712cd7 tempest-ProjectReaderTests-600290529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-7c8a8e41-818e-494e-9c75-5ffd2d392681" returned: 0 in 0.270s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:10:06 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-68a06df7-4552-4efa-ac8c-84da81712cd7 tempest-ProjectReaderTests-600290529 None] Lock "cinder-quobyte-7c8a8e41-818e-494e-9c75-5ffd2d392681" released by "delete_volume" :: held 0.728s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:10:06 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-68a06df7-4552-4efa-ac8c-84da81712cd7 tempest-ProjectReaderTests-600290529 None] Created reservations ['db6a9ceb-b82b-4f54-bc34-4690f2d69ee2', '7bb7f786-ac7b-4e6b-8445-c1391df92183', '1f22c414-166b-4452-b0a7-55c79d766e28', '8978f3b7-3e6b-418c-844a-7d2f12942995'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:10:06 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-68a06df7-4552-4efa-ac8c-84da81712cd7 tempest-ProjectReaderTests-600290529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:10:06 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-68a06df7-4552-4efa-ac8c-84da81712cd7 tempest-ProjectReaderTests-600290529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:10:06 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-68a06df7-4552-4efa-ac8c-84da81712cd7 tempest-ProjectReaderTests-600290529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:10:06 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-68a06df7-4552-4efa-ac8c-84da81712cd7 tempest-ProjectReaderTests-600290529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:10:06 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-68a06df7-4552-4efa-ac8c-84da81712cd7 tempest-ProjectReaderTests-600290529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:10:06 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-68a06df7-4552-4efa-ac8c-84da81712cd7 tempest-ProjectReaderTests-600290529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:10:06 devstack sudo[105522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:10:06 devstack sudo[105522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:10:06 devstack sudo[105522]: pam_unix(sudo:session): session closed for user root Aug 10 16:10:06 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-68a06df7-4552-4efa-ac8c-84da81712cd7 tempest-ProjectReaderTests-600290529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.249s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:10:06 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-68a06df7-4552-4efa-ac8c-84da81712cd7 tempest-ProjectReaderTests-600290529 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:10:06 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-68a06df7-4552-4efa-ac8c-84da81712cd7 tempest-ProjectReaderTests-600290529 None] Deleted volume successfully. Aug 10 16:10:06 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-68a06df7-4552-4efa-ac8c-84da81712cd7 tempest-ProjectReaderTests-600290529 None] Lock "cinder-7c8a8e41-818e-494e-9c75-5ffd2d392681-delete_volume" released by "delete_volume" :: held 1.174s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:10:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-9434038f-6f60-46e5-9459-1d483cd85466 tempest-VolumesExtendTest-1532672814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:10:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-9434038f-6f60-46e5-9459-1d483cd85466 tempest-VolumesExtendTest-1532672814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:10:07 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-9434038f-6f60-46e5-9459-1d483cd85466 tempest-VolumesExtendTest-1532672814 None] Creating offline snapshot 5201569c-3275-4a10-af9a-fbcae9bf3956 of volume f96fb8a9-87a1-4f6b-aa98-23acb8e93e68 {{(pid=88641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 16:10:07 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca91fcc-3b84-4cae-b012-b1b096a8b16a]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:10:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9434038f-6f60-46e5-9459-1d483cd85466 tempest-VolumesExtendTest-1532672814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f96fb8a9-87a1-4f6b-aa98-23acb8e93e68 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:10:07 devstack sudo[105525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f96fb8a9-87a1-4f6b-aa98-23acb8e93e68 Aug 10 16:10:07 devstack sudo[105525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:10:07 devstack sudo[105525]: pam_unix(sudo:session): session closed for user root Aug 10 16:10:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9434038f-6f60-46e5-9459-1d483cd85466 tempest-VolumesExtendTest-1532672814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f96fb8a9-87a1-4f6b-aa98-23acb8e93e68" returned: 0 in 0.394s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:10:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9434038f-6f60-46e5-9459-1d483cd85466 tempest-VolumesExtendTest-1532672814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f96fb8a9-87a1-4f6b-aa98-23acb8e93e68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f96fb8a9-87a1-4f6b-aa98-23acb8e93e68.5201569c-3275-4a10-af9a-fbcae9bf3956 1G {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:10:07 devstack sudo[105530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f96fb8a9-87a1-4f6b-aa98-23acb8e93e68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f96fb8a9-87a1-4f6b-aa98-23acb8e93e68.5201569c-3275-4a10-af9a-fbcae9bf3956 1G Aug 10 16:10:07 devstack sudo[105530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:10:08 devstack sudo[105530]: pam_unix(sudo:session): session closed for user root Aug 10 16:10:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9434038f-6f60-46e5-9459-1d483cd85466 tempest-VolumesExtendTest-1532672814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f96fb8a9-87a1-4f6b-aa98-23acb8e93e68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f96fb8a9-87a1-4f6b-aa98-23acb8e93e68.5201569c-3275-4a10-af9a-fbcae9bf3956 1G" returned: 0 in 0.429s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:10:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9434038f-6f60-46e5-9459-1d483cd85466 tempest-VolumesExtendTest-1532672814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f96fb8a9-87a1-4f6b-aa98-23acb8e93e68 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f96fb8a9-87a1-4f6b-aa98-23acb8e93e68.5201569c-3275-4a10-af9a-fbcae9bf3956 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:10:08 devstack sudo[105536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f96fb8a9-87a1-4f6b-aa98-23acb8e93e68 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f96fb8a9-87a1-4f6b-aa98-23acb8e93e68.5201569c-3275-4a10-af9a-fbcae9bf3956 Aug 10 16:10:08 devstack sudo[105536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:10:08 devstack sudo[105536]: pam_unix(sudo:session): session closed for user root Aug 10 16:10:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9434038f-6f60-46e5-9459-1d483cd85466 tempest-VolumesExtendTest-1532672814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f96fb8a9-87a1-4f6b-aa98-23acb8e93e68 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f96fb8a9-87a1-4f6b-aa98-23acb8e93e68.5201569c-3275-4a10-af9a-fbcae9bf3956" returned: 0 in 0.327s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:10:08 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-9434038f-6f60-46e5-9459-1d483cd85466 tempest-VolumesExtendTest-1532672814 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f96fb8a9-87a1-4f6b-aa98-23acb8e93e68.5201569c-3275-4a10-af9a-fbcae9bf3956 is being set with open permissions: ugo+rw Aug 10 16:10:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9434038f-6f60-46e5-9459-1d483cd85466 tempest-VolumesExtendTest-1532672814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f96fb8a9-87a1-4f6b-aa98-23acb8e93e68.5201569c-3275-4a10-af9a-fbcae9bf3956 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:10:08 devstack sudo[105541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f96fb8a9-87a1-4f6b-aa98-23acb8e93e68.5201569c-3275-4a10-af9a-fbcae9bf3956 Aug 10 16:10:08 devstack sudo[105541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:10:08 devstack sudo[105541]: pam_unix(sudo:session): session closed for user root Aug 10 16:10:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9434038f-6f60-46e5-9459-1d483cd85466 tempest-VolumesExtendTest-1532672814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f96fb8a9-87a1-4f6b-aa98-23acb8e93e68.5201569c-3275-4a10-af9a-fbcae9bf3956" returned: 0 in 0.238s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:10:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9434038f-6f60-46e5-9459-1d483cd85466 tempest-VolumesExtendTest-1532672814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f96fb8a9-87a1-4f6b-aa98-23acb8e93e68.info {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:10:08 devstack sudo[105544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f96fb8a9-87a1-4f6b-aa98-23acb8e93e68.info Aug 10 16:10:08 devstack sudo[105544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:10:08 devstack sudo[105544]: pam_unix(sudo:session): session closed for user root Aug 10 16:10:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9434038f-6f60-46e5-9459-1d483cd85466 tempest-VolumesExtendTest-1532672814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f96fb8a9-87a1-4f6b-aa98-23acb8e93e68.info" returned: 0 in 0.245s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:10:08 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-9434038f-6f60-46e5-9459-1d483cd85466 tempest-VolumesExtendTest-1532672814 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f96fb8a9-87a1-4f6b-aa98-23acb8e93e68.info is being set with open permissions: ugo+rw Aug 10 16:10:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9434038f-6f60-46e5-9459-1d483cd85466 tempest-VolumesExtendTest-1532672814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f96fb8a9-87a1-4f6b-aa98-23acb8e93e68.info {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:10:08 devstack sudo[105547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f96fb8a9-87a1-4f6b-aa98-23acb8e93e68.info Aug 10 16:10:08 devstack sudo[105547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:10:09 devstack sudo[105547]: pam_unix(sudo:session): session closed for user root Aug 10 16:10:09 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9434038f-6f60-46e5-9459-1d483cd85466 tempest-VolumesExtendTest-1532672814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f96fb8a9-87a1-4f6b-aa98-23acb8e93e68.info" returned: 0 in 0.255s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:10:09 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-9434038f-6f60-46e5-9459-1d483cd85466 tempest-VolumesExtendTest-1532672814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.981s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:10:09 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-9434038f-6f60-46e5-9459-1d483cd85466 tempest-VolumesExtendTest-1532672814 None] Create snapshot completed successfully Aug 10 16:10:09 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-0d5741fa-eb1f-4753-8596-856322092abd tempest-VolumesExtendTest-1532672814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:10:09 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-0d5741fa-eb1f-4753-8596-856322092abd tempest-VolumesExtendTest-1532672814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:10:09 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[9604a499-2c45-48e9-86e0-4aa7b3bf81c0]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:10:09 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0d5741fa-eb1f-4753-8596-856322092abd tempest-VolumesExtendTest-1532672814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f96fb8a9-87a1-4f6b-aa98-23acb8e93e68 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:10:09 devstack sudo[105550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f96fb8a9-87a1-4f6b-aa98-23acb8e93e68 Aug 10 16:10:09 devstack sudo[105550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:10:09 devstack sudo[105550]: pam_unix(sudo:session): session closed for user root Aug 10 16:10:09 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0d5741fa-eb1f-4753-8596-856322092abd tempest-VolumesExtendTest-1532672814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f96fb8a9-87a1-4f6b-aa98-23acb8e93e68" returned: 0 in 0.367s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:10:09 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0d5741fa-eb1f-4753-8596-856322092abd tempest-VolumesExtendTest-1532672814 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f96fb8a9-87a1-4f6b-aa98-23acb8e93e68.5201569c-3275-4a10-af9a-fbcae9bf3956 2G {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:10:09 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0d5741fa-eb1f-4753-8596-856322092abd tempest-VolumesExtendTest-1532672814 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f96fb8a9-87a1-4f6b-aa98-23acb8e93e68.5201569c-3275-4a10-af9a-fbcae9bf3956 2G" returned: 0 in 0.116s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:10:09 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-0d5741fa-eb1f-4753-8596-856322092abd tempest-VolumesExtendTest-1532672814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.515s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:10:09 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-0d5741fa-eb1f-4753-8596-856322092abd tempest-VolumesExtendTest-1532672814 None] Extend volume completed successfully. Aug 10 16:10:10 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-fc6b1047-803c-43f5-966e-bb6a28d7aa9c tempest-VolumesExtendTest-1532672814 None] Acquiring lock "cinder-5201569c-3275-4a10-af9a-fbcae9bf3956-delete_snapshot" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:10:10 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-fc6b1047-803c-43f5-966e-bb6a28d7aa9c tempest-VolumesExtendTest-1532672814 None] Lock "cinder-5201569c-3275-4a10-af9a-fbcae9bf3956-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:10:10 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-fc6b1047-803c-43f5-966e-bb6a28d7aa9c tempest-VolumesExtendTest-1532672814 None] Acquiring lock "cinder-quobyte-f96fb8a9-87a1-4f6b-aa98-23acb8e93e68" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:10:10 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-fc6b1047-803c-43f5-966e-bb6a28d7aa9c tempest-VolumesExtendTest-1532672814 None] Lock "cinder-quobyte-f96fb8a9-87a1-4f6b-aa98-23acb8e93e68" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:10:10 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-fc6b1047-803c-43f5-966e-bb6a28d7aa9c tempest-VolumesExtendTest-1532672814 None] Acquiring lock "cinder-quobyte-5201569c-3275-4a10-af9a-fbcae9bf3956" by "_delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:10:10 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-fc6b1047-803c-43f5-966e-bb6a28d7aa9c tempest-VolumesExtendTest-1532672814 None] Lock "cinder-quobyte-5201569c-3275-4a10-af9a-fbcae9bf3956" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:10:10 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-fc6b1047-803c-43f5-966e-bb6a28d7aa9c tempest-VolumesExtendTest-1532672814 None] Deleting offline snapshot 5201569c-3275-4a10-af9a-fbcae9bf3956 of volume f96fb8a9-87a1-4f6b-aa98-23acb8e93e68 {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 16:10:10 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-fc6b1047-803c-43f5-966e-bb6a28d7aa9c tempest-VolumesExtendTest-1532672814 None] snapshot_file for this snap is: volume-f96fb8a9-87a1-4f6b-aa98-23acb8e93e68.5201569c-3275-4a10-af9a-fbcae9bf3956 {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 16:10:10 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[e160d4d4-0619-4f9d-9b91-b0b5807214ce]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:10:10 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fc6b1047-803c-43f5-966e-bb6a28d7aa9c tempest-VolumesExtendTest-1532672814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f96fb8a9-87a1-4f6b-aa98-23acb8e93e68.5201569c-3275-4a10-af9a-fbcae9bf3956 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:10:10 devstack sudo[105558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f96fb8a9-87a1-4f6b-aa98-23acb8e93e68.5201569c-3275-4a10-af9a-fbcae9bf3956 Aug 10 16:10:10 devstack sudo[105558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:10:11 devstack sudo[105558]: pam_unix(sudo:session): session closed for user root Aug 10 16:10:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fc6b1047-803c-43f5-966e-bb6a28d7aa9c tempest-VolumesExtendTest-1532672814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f96fb8a9-87a1-4f6b-aa98-23acb8e93e68.5201569c-3275-4a10-af9a-fbcae9bf3956" returned: 0 in 0.345s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:10:11 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-fc6b1047-803c-43f5-966e-bb6a28d7aa9c tempest-VolumesExtendTest-1532672814 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f96fb8a9-87a1-4f6b-aa98-23acb8e93e68(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 16:10:11 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b7dd430-513b-4921-9213-ce2334aba917]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:10:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fc6b1047-803c-43f5-966e-bb6a28d7aa9c tempest-VolumesExtendTest-1532672814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f96fb8a9-87a1-4f6b-aa98-23acb8e93e68 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:10:11 devstack sudo[105563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f96fb8a9-87a1-4f6b-aa98-23acb8e93e68 Aug 10 16:10:11 devstack sudo[105563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:10:11 devstack sudo[105563]: pam_unix(sudo:session): session closed for user root Aug 10 16:10:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fc6b1047-803c-43f5-966e-bb6a28d7aa9c tempest-VolumesExtendTest-1532672814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f96fb8a9-87a1-4f6b-aa98-23acb8e93e68" returned: 0 in 0.338s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:10:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fc6b1047-803c-43f5-966e-bb6a28d7aa9c tempest-VolumesExtendTest-1532672814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f96fb8a9-87a1-4f6b-aa98-23acb8e93e68.5201569c-3275-4a10-af9a-fbcae9bf3956 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:10:11 devstack sudo[105568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f96fb8a9-87a1-4f6b-aa98-23acb8e93e68.5201569c-3275-4a10-af9a-fbcae9bf3956 Aug 10 16:10:11 devstack sudo[105568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:10:11 devstack sudo[105568]: pam_unix(sudo:session): session closed for user root Aug 10 16:10:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fc6b1047-803c-43f5-966e-bb6a28d7aa9c tempest-VolumesExtendTest-1532672814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f96fb8a9-87a1-4f6b-aa98-23acb8e93e68.5201569c-3275-4a10-af9a-fbcae9bf3956" returned: 0 in 0.360s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:10:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fc6b1047-803c-43f5-966e-bb6a28d7aa9c tempest-VolumesExtendTest-1532672814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f96fb8a9-87a1-4f6b-aa98-23acb8e93e68.5201569c-3275-4a10-af9a-fbcae9bf3956 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:10:11 devstack sudo[105574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f96fb8a9-87a1-4f6b-aa98-23acb8e93e68.5201569c-3275-4a10-af9a-fbcae9bf3956 Aug 10 16:10:11 devstack sudo[105574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:10:12 devstack sudo[105574]: pam_unix(sudo:session): session closed for user root Aug 10 16:10:12 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fc6b1047-803c-43f5-966e-bb6a28d7aa9c tempest-VolumesExtendTest-1532672814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f96fb8a9-87a1-4f6b-aa98-23acb8e93e68.5201569c-3275-4a10-af9a-fbcae9bf3956" returned: 0 in 0.240s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:10:12 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-fc6b1047-803c-43f5-966e-bb6a28d7aa9c tempest-VolumesExtendTest-1532672814 None] Lock "cinder-quobyte-5201569c-3275-4a10-af9a-fbcae9bf3956" released by "_delete_snapshot" :: held 1.382s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:10:12 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-fc6b1047-803c-43f5-966e-bb6a28d7aa9c tempest-VolumesExtendTest-1532672814 None] Lock "cinder-quobyte-f96fb8a9-87a1-4f6b-aa98-23acb8e93e68" released by "delete_snapshot" :: held 1.404s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:10:12 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-fc6b1047-803c-43f5-966e-bb6a28d7aa9c tempest-VolumesExtendTest-1532672814 None] Created reservations ['1d2d6199-c75c-4263-b5d2-c014efce19ca', '42d74703-084c-419c-a296-752a7dc51107', '93fff9e9-727f-4380-b19f-ed3baa39768a', 'c4850261-a9d7-4d4b-8ecd-f74c0a9bf0a3'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:10:12 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-fc6b1047-803c-43f5-966e-bb6a28d7aa9c tempest-VolumesExtendTest-1532672814 None] Delete snapshot completed successfully. Aug 10 16:10:12 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-fc6b1047-803c-43f5-966e-bb6a28d7aa9c tempest-VolumesExtendTest-1532672814 None] Lock "cinder-5201569c-3275-4a10-af9a-fbcae9bf3956-delete_snapshot" released by "delete_snapshot" :: held 1.537s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:10:12 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-77fbfa78-1d61-45d6-a0c8-6408d17a8fd1 tempest-VolumesExtendTest-1532672814 None] Acquiring lock "cinder-f96fb8a9-87a1-4f6b-aa98-23acb8e93e68-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:10:12 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-77fbfa78-1d61-45d6-a0c8-6408d17a8fd1 tempest-VolumesExtendTest-1532672814 None] Lock "cinder-f96fb8a9-87a1-4f6b-aa98-23acb8e93e68-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:10:12 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-77fbfa78-1d61-45d6-a0c8-6408d17a8fd1 tempest-VolumesExtendTest-1532672814 None] Acquiring lock "cinder-quobyte-f96fb8a9-87a1-4f6b-aa98-23acb8e93e68" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:10:12 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-77fbfa78-1d61-45d6-a0c8-6408d17a8fd1 tempest-VolumesExtendTest-1532672814 None] Lock "cinder-quobyte-f96fb8a9-87a1-4f6b-aa98-23acb8e93e68" acquired by "delete_volume" :: waited 0.019s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:10:12 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[138f4f91-f168-4442-981e-3d6542419b62]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:10:12 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-77fbfa78-1d61-45d6-a0c8-6408d17a8fd1 tempest-VolumesExtendTest-1532672814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f96fb8a9-87a1-4f6b-aa98-23acb8e93e68 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:10:13 devstack sudo[105578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f96fb8a9-87a1-4f6b-aa98-23acb8e93e68 Aug 10 16:10:13 devstack sudo[105578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:10:13 devstack sudo[105578]: pam_unix(sudo:session): session closed for user root Aug 10 16:10:13 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-77fbfa78-1d61-45d6-a0c8-6408d17a8fd1 tempest-VolumesExtendTest-1532672814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f96fb8a9-87a1-4f6b-aa98-23acb8e93e68" returned: 0 in 0.350s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:10:13 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-77fbfa78-1d61-45d6-a0c8-6408d17a8fd1 tempest-VolumesExtendTest-1532672814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f96fb8a9-87a1-4f6b-aa98-23acb8e93e68 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:10:13 devstack sudo[105583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f96fb8a9-87a1-4f6b-aa98-23acb8e93e68 Aug 10 16:10:13 devstack sudo[105583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:10:13 devstack sudo[105583]: pam_unix(sudo:session): session closed for user root Aug 10 16:10:13 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-77fbfa78-1d61-45d6-a0c8-6408d17a8fd1 tempest-VolumesExtendTest-1532672814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f96fb8a9-87a1-4f6b-aa98-23acb8e93e68" returned: 0 in 0.252s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:10:13 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-77fbfa78-1d61-45d6-a0c8-6408d17a8fd1 tempest-VolumesExtendTest-1532672814 None] Lock "cinder-quobyte-f96fb8a9-87a1-4f6b-aa98-23acb8e93e68" released by "delete_volume" :: held 0.660s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:10:13 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-77fbfa78-1d61-45d6-a0c8-6408d17a8fd1 tempest-VolumesExtendTest-1532672814 None] Created reservations ['7680059a-17f4-4eb0-aadb-551e64143ac3', 'cc5024b5-21e6-449c-8143-3c871c82619c', '7bd17036-b8ba-4ec4-acce-01a8d5e36f99', 'd3fd6921-aaa0-46f5-92b1-8d7bbf55ae3a'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:10:13 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-77fbfa78-1d61-45d6-a0c8-6408d17a8fd1 tempest-VolumesExtendTest-1532672814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:10:13 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-77fbfa78-1d61-45d6-a0c8-6408d17a8fd1 tempest-VolumesExtendTest-1532672814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:10:13 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-77fbfa78-1d61-45d6-a0c8-6408d17a8fd1 tempest-VolumesExtendTest-1532672814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:10:13 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-77fbfa78-1d61-45d6-a0c8-6408d17a8fd1 tempest-VolumesExtendTest-1532672814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:10:13 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-77fbfa78-1d61-45d6-a0c8-6408d17a8fd1 tempest-VolumesExtendTest-1532672814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:10:13 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-77fbfa78-1d61-45d6-a0c8-6408d17a8fd1 tempest-VolumesExtendTest-1532672814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:10:13 devstack sudo[105586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:10:13 devstack sudo[105586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:10:13 devstack sudo[105586]: pam_unix(sudo:session): session closed for user root Aug 10 16:10:13 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-77fbfa78-1d61-45d6-a0c8-6408d17a8fd1 tempest-VolumesExtendTest-1532672814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.247s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:10:13 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-77fbfa78-1d61-45d6-a0c8-6408d17a8fd1 tempest-VolumesExtendTest-1532672814 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:10:13 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-77fbfa78-1d61-45d6-a0c8-6408d17a8fd1 tempest-VolumesExtendTest-1532672814 None] Deleted volume successfully. Aug 10 16:10:13 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-77fbfa78-1d61-45d6-a0c8-6408d17a8fd1 tempest-VolumesExtendTest-1532672814 None] Lock "cinder-f96fb8a9-87a1-4f6b-aa98-23acb8e93e68-delete_volume" released by "delete_volume" :: held 1.116s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:10:19 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-b04f008d-0ca9-47ea-8507-0c90d3b6a905 tempest-VolumesListTestJSON-1921243388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:10:19 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b04f008d-0ca9-47ea-8507-0c90d3b6a905 tempest-VolumesListTestJSON-1921243388 None] Flow 'volume_create_manager' (fa300d6f-c417-414e-b955-01438a81cc5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:10:19 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b04f008d-0ca9-47ea-8507-0c90d3b6a905 tempest-VolumesListTestJSON-1921243388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dac59cc9-d957-4aa9-8b89-1a11eb4619de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:10:19 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b04f008d-0ca9-47ea-8507-0c90d3b6a905 tempest-VolumesListTestJSON-1921243388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dac59cc9-d957-4aa9-8b89-1a11eb4619de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:10:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1378359822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6387de2-8cd4-40e7-b044-bb2da3e312ed,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1e1454a5cd1e4986a8a3ab6bdc6d1a94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:10:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:10:19Z,use_quota=True,user_id='8166ee22dd344796be4d1f4f15468617',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:10:19 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b04f008d-0ca9-47ea-8507-0c90d3b6a905 tempest-VolumesListTestJSON-1921243388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dde7221d-e3c6-46f4-990b-20698fb60536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:10:19 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b04f008d-0ca9-47ea-8507-0c90d3b6a905 tempest-VolumesListTestJSON-1921243388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dde7221d-e3c6-46f4-990b-20698fb60536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:10:19 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b04f008d-0ca9-47ea-8507-0c90d3b6a905 tempest-VolumesListTestJSON-1921243388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96b79e2f-5afe-4e1a-8e9f-346b1677cf0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:10:19 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b04f008d-0ca9-47ea-8507-0c90d3b6a905 tempest-VolumesListTestJSON-1921243388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96b79e2f-5afe-4e1a-8e9f-346b1677cf0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6387de2-8cd4-40e7-b044-bb2da3e312ed', 'volume_name': 'volume-c6387de2-8cd4-40e7-b044-bb2da3e312ed', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:10:19 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b04f008d-0ca9-47ea-8507-0c90d3b6a905 tempest-VolumesListTestJSON-1921243388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7dd7450-4f17-4273-ac8a-1c5964ead4c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:10:19 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b04f008d-0ca9-47ea-8507-0c90d3b6a905 tempest-VolumesListTestJSON-1921243388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7dd7450-4f17-4273-ac8a-1c5964ead4c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:10:19 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b04f008d-0ca9-47ea-8507-0c90d3b6a905 tempest-VolumesListTestJSON-1921243388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (996b51d8-6834-4ad5-90d7-8bacc5d0f829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:10:19 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-b04f008d-0ca9-47ea-8507-0c90d3b6a905 tempest-VolumesListTestJSON-1921243388 None] Volume c6387de2-8cd4-40e7-b044-bb2da3e312ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6387de2-8cd4-40e7-b044-bb2da3e312ed', 'volume_size': 1} Aug 10 16:10:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-b04f008d-0ca9-47ea-8507-0c90d3b6a905 tempest-VolumesListTestJSON-1921243388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:10:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-b04f008d-0ca9-47ea-8507-0c90d3b6a905 tempest-VolumesListTestJSON-1921243388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:10:19 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-b04f008d-0ca9-47ea-8507-0c90d3b6a905 tempest-VolumesListTestJSON-1921243388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:10:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1378359822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6387de2-8cd4-40e7-b044-bb2da3e312ed,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1e1454a5cd1e4986a8a3ab6bdc6d1a94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:10:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:10:19Z,use_quota=True,user_id='8166ee22dd344796be4d1f4f15468617',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:10:19 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-b04f008d-0ca9-47ea-8507-0c90d3b6a905 tempest-VolumesListTestJSON-1921243388 None] Creating volume c6387de2-8cd4-40e7-b044-bb2da3e312ed {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:10:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-b04f008d-0ca9-47ea-8507-0c90d3b6a905 tempest-VolumesListTestJSON-1921243388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:10:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-b04f008d-0ca9-47ea-8507-0c90d3b6a905 tempest-VolumesListTestJSON-1921243388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:10:19 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-b04f008d-0ca9-47ea-8507-0c90d3b6a905 tempest-VolumesListTestJSON-1921243388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:10:19 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-b04f008d-0ca9-47ea-8507-0c90d3b6a905 tempest-VolumesListTestJSON-1921243388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:10:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-b04f008d-0ca9-47ea-8507-0c90d3b6a905 tempest-VolumesListTestJSON-1921243388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:10:19 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-b04f008d-0ca9-47ea-8507-0c90d3b6a905 tempest-VolumesListTestJSON-1921243388 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:10:19 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-b04f008d-0ca9-47ea-8507-0c90d3b6a905 tempest-VolumesListTestJSON-1921243388 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:10:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b04f008d-0ca9-47ea-8507-0c90d3b6a905 tempest-VolumesListTestJSON-1921243388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c6387de2-8cd4-40e7-b044-bb2da3e312ed 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:10:19 devstack sudo[105590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c6387de2-8cd4-40e7-b044-bb2da3e312ed 1073741824 Aug 10 16:10:19 devstack sudo[105590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:10:19 devstack sudo[105590]: pam_unix(sudo:session): session closed for user root Aug 10 16:10:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b04f008d-0ca9-47ea-8507-0c90d3b6a905 tempest-VolumesListTestJSON-1921243388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c6387de2-8cd4-40e7-b044-bb2da3e312ed 1073741824" returned: 0 in 0.442s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:10:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b04f008d-0ca9-47ea-8507-0c90d3b6a905 tempest-VolumesListTestJSON-1921243388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c6387de2-8cd4-40e7-b044-bb2da3e312ed {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:10:19 devstack sudo[105595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c6387de2-8cd4-40e7-b044-bb2da3e312ed Aug 10 16:10:19 devstack sudo[105595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:10:20 devstack sudo[105595]: pam_unix(sudo:session): session closed for user root Aug 10 16:10:20 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b04f008d-0ca9-47ea-8507-0c90d3b6a905 tempest-VolumesListTestJSON-1921243388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c6387de2-8cd4-40e7-b044-bb2da3e312ed" returned: 0 in 0.256s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:10:20 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-b04f008d-0ca9-47ea-8507-0c90d3b6a905 tempest-VolumesListTestJSON-1921243388 None] <== create_volume: return (740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:10:20 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-b04f008d-0ca9-47ea-8507-0c90d3b6a905 tempest-VolumesListTestJSON-1921243388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:10:20 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b04f008d-0ca9-47ea-8507-0c90d3b6a905 tempest-VolumesListTestJSON-1921243388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (996b51d8-6834-4ad5-90d7-8bacc5d0f829) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6387de2-8cd4-40e7-b044-bb2da3e312ed', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:10:20 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b04f008d-0ca9-47ea-8507-0c90d3b6a905 tempest-VolumesListTestJSON-1921243388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4734edb9-8b49-4d56-94e2-4449f3316440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:10:20 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-b04f008d-0ca9-47ea-8507-0c90d3b6a905 tempest-VolumesListTestJSON-1921243388 None] Volume volume-c6387de2-8cd4-40e7-b044-bb2da3e312ed (c6387de2-8cd4-40e7-b044-bb2da3e312ed): created successfully Aug 10 16:10:20 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b04f008d-0ca9-47ea-8507-0c90d3b6a905 tempest-VolumesListTestJSON-1921243388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4734edb9-8b49-4d56-94e2-4449f3316440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:10:20 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b04f008d-0ca9-47ea-8507-0c90d3b6a905 tempest-VolumesListTestJSON-1921243388 None] Flow 'volume_create_manager' (fa300d6f-c417-414e-b955-01438a81cc5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:10:20 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-b04f008d-0ca9-47ea-8507-0c90d3b6a905 tempest-VolumesListTestJSON-1921243388 None] Created volume successfully. Aug 10 16:10:20 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-66ced048-60ee-41b6-acb0-f305cb98874f tempest-VolumesListTestJSON-1921243388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:10:20 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-66ced048-60ee-41b6-acb0-f305cb98874f tempest-VolumesListTestJSON-1921243388 None] Flow 'volume_create_manager' (5cea9f6d-8efc-4af9-a82c-84452ded6d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:10:20 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-66ced048-60ee-41b6-acb0-f305cb98874f tempest-VolumesListTestJSON-1921243388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eca2323f-7d9c-4631-a290-6aff206509f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:10:20 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-66ced048-60ee-41b6-acb0-f305cb98874f tempest-VolumesListTestJSON-1921243388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eca2323f-7d9c-4631-a290-6aff206509f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-906496354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f55a05bd-64de-425c-ac7d-eb54434b1470,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1e1454a5cd1e4986a8a3ab6bdc6d1a94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:10:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:10:21Z,use_quota=True,user_id='8166ee22dd344796be4d1f4f15468617',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:10:20 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-66ced048-60ee-41b6-acb0-f305cb98874f tempest-VolumesListTestJSON-1921243388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (523cf5a4-0c53-407f-83ee-14c745236c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:10:20 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-66ced048-60ee-41b6-acb0-f305cb98874f tempest-VolumesListTestJSON-1921243388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (523cf5a4-0c53-407f-83ee-14c745236c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:10:20 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-66ced048-60ee-41b6-acb0-f305cb98874f tempest-VolumesListTestJSON-1921243388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f658197-a456-43b8-92fb-8ba94ab4fc84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:10:20 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-66ced048-60ee-41b6-acb0-f305cb98874f tempest-VolumesListTestJSON-1921243388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f658197-a456-43b8-92fb-8ba94ab4fc84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f55a05bd-64de-425c-ac7d-eb54434b1470', 'volume_name': 'volume-f55a05bd-64de-425c-ac7d-eb54434b1470', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:10:20 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-66ced048-60ee-41b6-acb0-f305cb98874f tempest-VolumesListTestJSON-1921243388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0d54948-f797-4799-847d-af1bc0f15124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:10:20 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-66ced048-60ee-41b6-acb0-f305cb98874f tempest-VolumesListTestJSON-1921243388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0d54948-f797-4799-847d-af1bc0f15124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:10:20 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-66ced048-60ee-41b6-acb0-f305cb98874f tempest-VolumesListTestJSON-1921243388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c22fb1c-0775-40d7-8f5f-9fdddd48b996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:10:20 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-66ced048-60ee-41b6-acb0-f305cb98874f tempest-VolumesListTestJSON-1921243388 None] Volume f55a05bd-64de-425c-ac7d-eb54434b1470: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f55a05bd-64de-425c-ac7d-eb54434b1470', 'volume_size': 1} Aug 10 16:10:20 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-66ced048-60ee-41b6-acb0-f305cb98874f tempest-VolumesListTestJSON-1921243388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:10:20 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-66ced048-60ee-41b6-acb0-f305cb98874f tempest-VolumesListTestJSON-1921243388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:10:20 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-66ced048-60ee-41b6-acb0-f305cb98874f tempest-VolumesListTestJSON-1921243388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-906496354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f55a05bd-64de-425c-ac7d-eb54434b1470,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1e1454a5cd1e4986a8a3ab6bdc6d1a94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:10:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:10:21Z,use_quota=True,user_id='8166ee22dd344796be4d1f4f15468617',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:10:20 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-66ced048-60ee-41b6-acb0-f305cb98874f tempest-VolumesListTestJSON-1921243388 None] Creating volume f55a05bd-64de-425c-ac7d-eb54434b1470 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:10:20 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-66ced048-60ee-41b6-acb0-f305cb98874f tempest-VolumesListTestJSON-1921243388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:10:20 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-66ced048-60ee-41b6-acb0-f305cb98874f tempest-VolumesListTestJSON-1921243388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:10:20 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-66ced048-60ee-41b6-acb0-f305cb98874f tempest-VolumesListTestJSON-1921243388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:10:20 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-66ced048-60ee-41b6-acb0-f305cb98874f tempest-VolumesListTestJSON-1921243388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:10:20 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-66ced048-60ee-41b6-acb0-f305cb98874f tempest-VolumesListTestJSON-1921243388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:10:20 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-66ced048-60ee-41b6-acb0-f305cb98874f tempest-VolumesListTestJSON-1921243388 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:10:20 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-66ced048-60ee-41b6-acb0-f305cb98874f tempest-VolumesListTestJSON-1921243388 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:10:20 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-66ced048-60ee-41b6-acb0-f305cb98874f tempest-VolumesListTestJSON-1921243388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f55a05bd-64de-425c-ac7d-eb54434b1470 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:10:20 devstack sudo[105598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f55a05bd-64de-425c-ac7d-eb54434b1470 1073741824 Aug 10 16:10:20 devstack sudo[105598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:10:21 devstack sudo[105598]: pam_unix(sudo:session): session closed for user root Aug 10 16:10:21 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-66ced048-60ee-41b6-acb0-f305cb98874f tempest-VolumesListTestJSON-1921243388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f55a05bd-64de-425c-ac7d-eb54434b1470 1073741824" returned: 0 in 0.420s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:10:21 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-66ced048-60ee-41b6-acb0-f305cb98874f tempest-VolumesListTestJSON-1921243388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f55a05bd-64de-425c-ac7d-eb54434b1470 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:10:21 devstack sudo[105603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f55a05bd-64de-425c-ac7d-eb54434b1470 Aug 10 16:10:21 devstack sudo[105603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:10:21 devstack sudo[105603]: pam_unix(sudo:session): session closed for user root Aug 10 16:10:21 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-66ced048-60ee-41b6-acb0-f305cb98874f tempest-VolumesListTestJSON-1921243388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f55a05bd-64de-425c-ac7d-eb54434b1470" returned: 0 in 0.263s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:10:21 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-66ced048-60ee-41b6-acb0-f305cb98874f tempest-VolumesListTestJSON-1921243388 None] <== create_volume: return (725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:10:21 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-66ced048-60ee-41b6-acb0-f305cb98874f tempest-VolumesListTestJSON-1921243388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.728s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:10:21 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-66ced048-60ee-41b6-acb0-f305cb98874f tempest-VolumesListTestJSON-1921243388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c22fb1c-0775-40d7-8f5f-9fdddd48b996) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f55a05bd-64de-425c-ac7d-eb54434b1470', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:10:21 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-66ced048-60ee-41b6-acb0-f305cb98874f tempest-VolumesListTestJSON-1921243388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09b8f129-eeed-40b0-884e-d83f9a77b30a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:10:21 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-66ced048-60ee-41b6-acb0-f305cb98874f tempest-VolumesListTestJSON-1921243388 None] Volume volume-f55a05bd-64de-425c-ac7d-eb54434b1470 (f55a05bd-64de-425c-ac7d-eb54434b1470): created successfully Aug 10 16:10:21 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-66ced048-60ee-41b6-acb0-f305cb98874f tempest-VolumesListTestJSON-1921243388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09b8f129-eeed-40b0-884e-d83f9a77b30a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:10:21 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-66ced048-60ee-41b6-acb0-f305cb98874f tempest-VolumesListTestJSON-1921243388 None] Flow 'volume_create_manager' (5cea9f6d-8efc-4af9-a82c-84452ded6d1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:10:21 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-66ced048-60ee-41b6-acb0-f305cb98874f tempest-VolumesListTestJSON-1921243388 None] Created volume successfully. Aug 10 16:10:22 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd6ffd46-f7b5-4f35-881b-f9afdcf1d9e9 tempest-VolumesListTestJSON-1921243388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:10:22 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bd6ffd46-f7b5-4f35-881b-f9afdcf1d9e9 tempest-VolumesListTestJSON-1921243388 None] Flow 'volume_create_manager' (d94436b0-6367-47b4-ab36-27573d87db9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:10:22 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bd6ffd46-f7b5-4f35-881b-f9afdcf1d9e9 tempest-VolumesListTestJSON-1921243388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5cb4228-1a90-427f-8402-58d3dbd90b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:10:22 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bd6ffd46-f7b5-4f35-881b-f9afdcf1d9e9 tempest-VolumesListTestJSON-1921243388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5cb4228-1a90-427f-8402-58d3dbd90b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:10:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-971417900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e9088c2-7a4c-4667-9202-0041a32b8809,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1e1454a5cd1e4986a8a3ab6bdc6d1a94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:10:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:10:22Z,use_quota=True,user_id='8166ee22dd344796be4d1f4f15468617',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:10:22 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bd6ffd46-f7b5-4f35-881b-f9afdcf1d9e9 tempest-VolumesListTestJSON-1921243388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9568ff09-d4a9-4547-9e7f-df8fedc37b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:10:22 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bd6ffd46-f7b5-4f35-881b-f9afdcf1d9e9 tempest-VolumesListTestJSON-1921243388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9568ff09-d4a9-4547-9e7f-df8fedc37b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:10:22 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bd6ffd46-f7b5-4f35-881b-f9afdcf1d9e9 tempest-VolumesListTestJSON-1921243388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c16e3a0e-82df-4891-a7a3-0db5ec9f24cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:10:22 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bd6ffd46-f7b5-4f35-881b-f9afdcf1d9e9 tempest-VolumesListTestJSON-1921243388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c16e3a0e-82df-4891-a7a3-0db5ec9f24cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e9088c2-7a4c-4667-9202-0041a32b8809', 'volume_name': 'volume-5e9088c2-7a4c-4667-9202-0041a32b8809', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:10:22 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bd6ffd46-f7b5-4f35-881b-f9afdcf1d9e9 tempest-VolumesListTestJSON-1921243388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f590c2a1-e89d-4b20-9efa-4f28c6256f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:10:22 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bd6ffd46-f7b5-4f35-881b-f9afdcf1d9e9 tempest-VolumesListTestJSON-1921243388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f590c2a1-e89d-4b20-9efa-4f28c6256f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:10:22 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bd6ffd46-f7b5-4f35-881b-f9afdcf1d9e9 tempest-VolumesListTestJSON-1921243388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5318b93e-290f-4b1f-9288-d14532122076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:10:22 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-bd6ffd46-f7b5-4f35-881b-f9afdcf1d9e9 tempest-VolumesListTestJSON-1921243388 None] Volume 5e9088c2-7a4c-4667-9202-0041a32b8809: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e9088c2-7a4c-4667-9202-0041a32b8809', 'volume_size': 1} Aug 10 16:10:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bd6ffd46-f7b5-4f35-881b-f9afdcf1d9e9 tempest-VolumesListTestJSON-1921243388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:10:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bd6ffd46-f7b5-4f35-881b-f9afdcf1d9e9 tempest-VolumesListTestJSON-1921243388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:10:22 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-bd6ffd46-f7b5-4f35-881b-f9afdcf1d9e9 tempest-VolumesListTestJSON-1921243388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:10:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-971417900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e9088c2-7a4c-4667-9202-0041a32b8809,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1e1454a5cd1e4986a8a3ab6bdc6d1a94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:10:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:10:22Z,use_quota=True,user_id='8166ee22dd344796be4d1f4f15468617',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:10:22 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-bd6ffd46-f7b5-4f35-881b-f9afdcf1d9e9 tempest-VolumesListTestJSON-1921243388 None] Creating volume 5e9088c2-7a4c-4667-9202-0041a32b8809 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:10:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bd6ffd46-f7b5-4f35-881b-f9afdcf1d9e9 tempest-VolumesListTestJSON-1921243388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:10:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bd6ffd46-f7b5-4f35-881b-f9afdcf1d9e9 tempest-VolumesListTestJSON-1921243388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:10:22 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-bd6ffd46-f7b5-4f35-881b-f9afdcf1d9e9 tempest-VolumesListTestJSON-1921243388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:10:22 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-bd6ffd46-f7b5-4f35-881b-f9afdcf1d9e9 tempest-VolumesListTestJSON-1921243388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:10:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bd6ffd46-f7b5-4f35-881b-f9afdcf1d9e9 tempest-VolumesListTestJSON-1921243388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:10:22 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-bd6ffd46-f7b5-4f35-881b-f9afdcf1d9e9 tempest-VolumesListTestJSON-1921243388 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:10:22 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-bd6ffd46-f7b5-4f35-881b-f9afdcf1d9e9 tempest-VolumesListTestJSON-1921243388 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:10:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bd6ffd46-f7b5-4f35-881b-f9afdcf1d9e9 tempest-VolumesListTestJSON-1921243388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-5e9088c2-7a4c-4667-9202-0041a32b8809 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:10:22 devstack sudo[105609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-5e9088c2-7a4c-4667-9202-0041a32b8809 1073741824 Aug 10 16:10:22 devstack sudo[105609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:10:22 devstack sudo[105609]: pam_unix(sudo:session): session closed for user root Aug 10 16:10:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bd6ffd46-f7b5-4f35-881b-f9afdcf1d9e9 tempest-VolumesListTestJSON-1921243388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-5e9088c2-7a4c-4667-9202-0041a32b8809 1073741824" returned: 0 in 0.426s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:10:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bd6ffd46-f7b5-4f35-881b-f9afdcf1d9e9 tempest-VolumesListTestJSON-1921243388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-5e9088c2-7a4c-4667-9202-0041a32b8809 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:10:22 devstack sudo[105615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-5e9088c2-7a4c-4667-9202-0041a32b8809 Aug 10 16:10:22 devstack sudo[105615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:10:23 devstack sudo[105615]: pam_unix(sudo:session): session closed for user root Aug 10 16:10:23 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bd6ffd46-f7b5-4f35-881b-f9afdcf1d9e9 tempest-VolumesListTestJSON-1921243388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-5e9088c2-7a4c-4667-9202-0041a32b8809" returned: 0 in 0.260s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:10:23 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-bd6ffd46-f7b5-4f35-881b-f9afdcf1d9e9 tempest-VolumesListTestJSON-1921243388 None] <== create_volume: return (728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:10:23 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bd6ffd46-f7b5-4f35-881b-f9afdcf1d9e9 tempest-VolumesListTestJSON-1921243388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.731s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:10:23 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bd6ffd46-f7b5-4f35-881b-f9afdcf1d9e9 tempest-VolumesListTestJSON-1921243388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5318b93e-290f-4b1f-9288-d14532122076) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e9088c2-7a4c-4667-9202-0041a32b8809', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:10:23 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bd6ffd46-f7b5-4f35-881b-f9afdcf1d9e9 tempest-VolumesListTestJSON-1921243388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec5a31f2-bc0a-4e05-887e-cb5631ec2768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:10:23 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-bd6ffd46-f7b5-4f35-881b-f9afdcf1d9e9 tempest-VolumesListTestJSON-1921243388 None] Volume volume-5e9088c2-7a4c-4667-9202-0041a32b8809 (5e9088c2-7a4c-4667-9202-0041a32b8809): created successfully Aug 10 16:10:23 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bd6ffd46-f7b5-4f35-881b-f9afdcf1d9e9 tempest-VolumesListTestJSON-1921243388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec5a31f2-bc0a-4e05-887e-cb5631ec2768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:10:23 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bd6ffd46-f7b5-4f35-881b-f9afdcf1d9e9 tempest-VolumesListTestJSON-1921243388 None] Flow 'volume_create_manager' (d94436b0-6367-47b4-ab36-27573d87db9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:10:23 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-bd6ffd46-f7b5-4f35-881b-f9afdcf1d9e9 tempest-VolumesListTestJSON-1921243388 None] Created volume successfully. Aug 10 16:10:25 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-e9a71ff9-eb24-4621-8828-e0e8f6337de0 tempest-VolumesListTestJSON-1921243388 None] Acquiring lock "cinder-5e9088c2-7a4c-4667-9202-0041a32b8809-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:10:25 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-e9a71ff9-eb24-4621-8828-e0e8f6337de0 tempest-VolumesListTestJSON-1921243388 None] Lock "cinder-5e9088c2-7a4c-4667-9202-0041a32b8809-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:10:25 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-e9a71ff9-eb24-4621-8828-e0e8f6337de0 tempest-VolumesListTestJSON-1921243388 None] Acquiring lock "cinder-quobyte-5e9088c2-7a4c-4667-9202-0041a32b8809" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:10:25 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-e9a71ff9-eb24-4621-8828-e0e8f6337de0 tempest-VolumesListTestJSON-1921243388 None] Lock "cinder-quobyte-5e9088c2-7a4c-4667-9202-0041a32b8809" acquired by "delete_volume" :: waited 0.015s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:10:25 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf44c0f-ffc6-46df-a474-1f90348b4c8e]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:10:25 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e9a71ff9-eb24-4621-8828-e0e8f6337de0 tempest-VolumesListTestJSON-1921243388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-5e9088c2-7a4c-4667-9202-0041a32b8809 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:10:25 devstack sudo[105618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-5e9088c2-7a4c-4667-9202-0041a32b8809 Aug 10 16:10:25 devstack sudo[105618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:10:25 devstack sudo[105618]: pam_unix(sudo:session): session closed for user root Aug 10 16:10:25 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e9a71ff9-eb24-4621-8828-e0e8f6337de0 tempest-VolumesListTestJSON-1921243388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-5e9088c2-7a4c-4667-9202-0041a32b8809" returned: 0 in 0.359s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:10:25 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e9a71ff9-eb24-4621-8828-e0e8f6337de0 tempest-VolumesListTestJSON-1921243388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-5e9088c2-7a4c-4667-9202-0041a32b8809 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:10:25 devstack sudo[105623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-5e9088c2-7a4c-4667-9202-0041a32b8809 Aug 10 16:10:25 devstack sudo[105623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:10:25 devstack sudo[105623]: pam_unix(sudo:session): session closed for user root Aug 10 16:10:25 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e9a71ff9-eb24-4621-8828-e0e8f6337de0 tempest-VolumesListTestJSON-1921243388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-5e9088c2-7a4c-4667-9202-0041a32b8809" returned: 0 in 0.243s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:10:25 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-e9a71ff9-eb24-4621-8828-e0e8f6337de0 tempest-VolumesListTestJSON-1921243388 None] Lock "cinder-quobyte-5e9088c2-7a4c-4667-9202-0041a32b8809" released by "delete_volume" :: held 0.642s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:10:25 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-e9a71ff9-eb24-4621-8828-e0e8f6337de0 tempest-VolumesListTestJSON-1921243388 None] Created reservations ['3797dcf5-e354-4d42-babb-08b96936e9aa', 'b5c89214-45e9-48db-89bb-fc7f3ab03c6c', '7b5c0623-636f-4a40-92d6-8603d414fc7b', '6339285b-ae5f-49a1-adbe-c51ad5e1a22e'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:10:26 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-e9a71ff9-eb24-4621-8828-e0e8f6337de0 tempest-VolumesListTestJSON-1921243388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:10:26 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-e9a71ff9-eb24-4621-8828-e0e8f6337de0 tempest-VolumesListTestJSON-1921243388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:10:26 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-e9a71ff9-eb24-4621-8828-e0e8f6337de0 tempest-VolumesListTestJSON-1921243388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:10:26 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-e9a71ff9-eb24-4621-8828-e0e8f6337de0 tempest-VolumesListTestJSON-1921243388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:10:26 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-e9a71ff9-eb24-4621-8828-e0e8f6337de0 tempest-VolumesListTestJSON-1921243388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:10:26 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e9a71ff9-eb24-4621-8828-e0e8f6337de0 tempest-VolumesListTestJSON-1921243388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:10:26 devstack sudo[105626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:10:26 devstack sudo[105626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:10:26 devstack sudo[105626]: pam_unix(sudo:session): session closed for user root Aug 10 16:10:26 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e9a71ff9-eb24-4621-8828-e0e8f6337de0 tempest-VolumesListTestJSON-1921243388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.245s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:10:26 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-e9a71ff9-eb24-4621-8828-e0e8f6337de0 tempest-VolumesListTestJSON-1921243388 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:10:26 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-e9a71ff9-eb24-4621-8828-e0e8f6337de0 tempest-VolumesListTestJSON-1921243388 None] Deleted volume successfully. Aug 10 16:10:26 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-e9a71ff9-eb24-4621-8828-e0e8f6337de0 tempest-VolumesListTestJSON-1921243388 None] Lock "cinder-5e9088c2-7a4c-4667-9202-0041a32b8809-delete_volume" released by "delete_volume" :: held 1.083s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:10:26 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-b4dcade8-bb5c-4d01-8d70-5268e3685c0b tempest-VolumesListTestJSON-1921243388 None] Acquiring lock "cinder-f55a05bd-64de-425c-ac7d-eb54434b1470-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:10:26 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-b4dcade8-bb5c-4d01-8d70-5268e3685c0b tempest-VolumesListTestJSON-1921243388 None] Lock "cinder-f55a05bd-64de-425c-ac7d-eb54434b1470-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:10:26 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-b4dcade8-bb5c-4d01-8d70-5268e3685c0b tempest-VolumesListTestJSON-1921243388 None] Acquiring lock "cinder-quobyte-f55a05bd-64de-425c-ac7d-eb54434b1470" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:10:26 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-b4dcade8-bb5c-4d01-8d70-5268e3685c0b tempest-VolumesListTestJSON-1921243388 None] Lock "cinder-quobyte-f55a05bd-64de-425c-ac7d-eb54434b1470" acquired by "delete_volume" :: waited 0.015s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:10:26 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf30e2d-8586-40fe-bf54-35991d84c476]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:10:26 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b4dcade8-bb5c-4d01-8d70-5268e3685c0b tempest-VolumesListTestJSON-1921243388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f55a05bd-64de-425c-ac7d-eb54434b1470 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:10:26 devstack sudo[105629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f55a05bd-64de-425c-ac7d-eb54434b1470 Aug 10 16:10:26 devstack sudo[105629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:10:26 devstack sudo[105629]: pam_unix(sudo:session): session closed for user root Aug 10 16:10:26 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b4dcade8-bb5c-4d01-8d70-5268e3685c0b tempest-VolumesListTestJSON-1921243388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f55a05bd-64de-425c-ac7d-eb54434b1470" returned: 0 in 0.364s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:10:26 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b4dcade8-bb5c-4d01-8d70-5268e3685c0b tempest-VolumesListTestJSON-1921243388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f55a05bd-64de-425c-ac7d-eb54434b1470 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:10:26 devstack sudo[105636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f55a05bd-64de-425c-ac7d-eb54434b1470 Aug 10 16:10:26 devstack sudo[105636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:10:27 devstack sudo[105636]: pam_unix(sudo:session): session closed for user root Aug 10 16:10:27 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b4dcade8-bb5c-4d01-8d70-5268e3685c0b tempest-VolumesListTestJSON-1921243388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f55a05bd-64de-425c-ac7d-eb54434b1470" returned: 0 in 0.236s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:10:27 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-b4dcade8-bb5c-4d01-8d70-5268e3685c0b tempest-VolumesListTestJSON-1921243388 None] Lock "cinder-quobyte-f55a05bd-64de-425c-ac7d-eb54434b1470" released by "delete_volume" :: held 0.639s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:10:27 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-b4dcade8-bb5c-4d01-8d70-5268e3685c0b tempest-VolumesListTestJSON-1921243388 None] Created reservations ['0bb57db7-443c-47d0-bf0b-2c3a3df1b82a', 'a2c278d7-c052-4de3-b887-a5b98d0fe2fa', 'f4f8ebe5-1ad1-4b27-9fd9-dc19b4f7b7b7', 'ab506949-6336-43b3-848d-20c1415ef4f7'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:10:27 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-b4dcade8-bb5c-4d01-8d70-5268e3685c0b tempest-VolumesListTestJSON-1921243388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:10:27 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-b4dcade8-bb5c-4d01-8d70-5268e3685c0b tempest-VolumesListTestJSON-1921243388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:10:27 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-b4dcade8-bb5c-4d01-8d70-5268e3685c0b tempest-VolumesListTestJSON-1921243388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:10:27 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-b4dcade8-bb5c-4d01-8d70-5268e3685c0b tempest-VolumesListTestJSON-1921243388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:10:27 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-b4dcade8-bb5c-4d01-8d70-5268e3685c0b tempest-VolumesListTestJSON-1921243388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:10:27 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b4dcade8-bb5c-4d01-8d70-5268e3685c0b tempest-VolumesListTestJSON-1921243388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:10:27 devstack sudo[105639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:10:27 devstack sudo[105639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:10:27 devstack sudo[105639]: pam_unix(sudo:session): session closed for user root Aug 10 16:10:27 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b4dcade8-bb5c-4d01-8d70-5268e3685c0b tempest-VolumesListTestJSON-1921243388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.247s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:10:27 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-b4dcade8-bb5c-4d01-8d70-5268e3685c0b tempest-VolumesListTestJSON-1921243388 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:10:27 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-b4dcade8-bb5c-4d01-8d70-5268e3685c0b tempest-VolumesListTestJSON-1921243388 None] Deleted volume successfully. Aug 10 16:10:27 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-b4dcade8-bb5c-4d01-8d70-5268e3685c0b tempest-VolumesListTestJSON-1921243388 None] Lock "cinder-f55a05bd-64de-425c-ac7d-eb54434b1470-delete_volume" released by "delete_volume" :: held 1.082s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:10:27 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-796a5c68-2a6a-4724-bc6e-4ce0a72c2460 tempest-VolumesListTestJSON-1921243388 None] Acquiring lock "cinder-c6387de2-8cd4-40e7-b044-bb2da3e312ed-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:10:27 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-796a5c68-2a6a-4724-bc6e-4ce0a72c2460 tempest-VolumesListTestJSON-1921243388 None] Lock "cinder-c6387de2-8cd4-40e7-b044-bb2da3e312ed-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:10:27 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-796a5c68-2a6a-4724-bc6e-4ce0a72c2460 tempest-VolumesListTestJSON-1921243388 None] Acquiring lock "cinder-quobyte-c6387de2-8cd4-40e7-b044-bb2da3e312ed" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:10:27 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-796a5c68-2a6a-4724-bc6e-4ce0a72c2460 tempest-VolumesListTestJSON-1921243388 None] Lock "cinder-quobyte-c6387de2-8cd4-40e7-b044-bb2da3e312ed" acquired by "delete_volume" :: waited 0.017s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:10:27 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[8729e5b6-4db0-423c-9976-4e2c71900e45]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:10:27 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-796a5c68-2a6a-4724-bc6e-4ce0a72c2460 tempest-VolumesListTestJSON-1921243388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c6387de2-8cd4-40e7-b044-bb2da3e312ed {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:10:27 devstack sudo[105642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c6387de2-8cd4-40e7-b044-bb2da3e312ed Aug 10 16:10:27 devstack sudo[105642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:10:28 devstack sudo[105642]: pam_unix(sudo:session): session closed for user root Aug 10 16:10:28 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-796a5c68-2a6a-4724-bc6e-4ce0a72c2460 tempest-VolumesListTestJSON-1921243388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c6387de2-8cd4-40e7-b044-bb2da3e312ed" returned: 0 in 0.360s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:10:28 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-796a5c68-2a6a-4724-bc6e-4ce0a72c2460 tempest-VolumesListTestJSON-1921243388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c6387de2-8cd4-40e7-b044-bb2da3e312ed {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:10:28 devstack sudo[105647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c6387de2-8cd4-40e7-b044-bb2da3e312ed Aug 10 16:10:28 devstack sudo[105647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:10:28 devstack sudo[105647]: pam_unix(sudo:session): session closed for user root Aug 10 16:10:28 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-796a5c68-2a6a-4724-bc6e-4ce0a72c2460 tempest-VolumesListTestJSON-1921243388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c6387de2-8cd4-40e7-b044-bb2da3e312ed" returned: 0 in 0.237s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:10:28 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-796a5c68-2a6a-4724-bc6e-4ce0a72c2460 tempest-VolumesListTestJSON-1921243388 None] Lock "cinder-quobyte-c6387de2-8cd4-40e7-b044-bb2da3e312ed" released by "delete_volume" :: held 0.635s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:10:28 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-796a5c68-2a6a-4724-bc6e-4ce0a72c2460 tempest-VolumesListTestJSON-1921243388 None] Created reservations ['78e24de3-746b-4aeb-ad1c-0cbd05576555', 'cb83aac2-dccf-4aa3-aa99-f6d0b82f9dbf', '863d175f-4ac9-4105-8b46-21ac9c6a2b71', '273e87cb-5be6-4305-bfc6-ee74aad0e323'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:10:28 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-796a5c68-2a6a-4724-bc6e-4ce0a72c2460 tempest-VolumesListTestJSON-1921243388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:10:28 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-796a5c68-2a6a-4724-bc6e-4ce0a72c2460 tempest-VolumesListTestJSON-1921243388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:10:28 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-796a5c68-2a6a-4724-bc6e-4ce0a72c2460 tempest-VolumesListTestJSON-1921243388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:10:28 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-796a5c68-2a6a-4724-bc6e-4ce0a72c2460 tempest-VolumesListTestJSON-1921243388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:10:28 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-796a5c68-2a6a-4724-bc6e-4ce0a72c2460 tempest-VolumesListTestJSON-1921243388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:10:28 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-796a5c68-2a6a-4724-bc6e-4ce0a72c2460 tempest-VolumesListTestJSON-1921243388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:10:28 devstack sudo[105650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:10:28 devstack sudo[105650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:10:28 devstack sudo[105650]: pam_unix(sudo:session): session closed for user root Aug 10 16:10:28 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-796a5c68-2a6a-4724-bc6e-4ce0a72c2460 tempest-VolumesListTestJSON-1921243388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.237s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:10:28 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-796a5c68-2a6a-4724-bc6e-4ce0a72c2460 tempest-VolumesListTestJSON-1921243388 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:10:28 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-796a5c68-2a6a-4724-bc6e-4ce0a72c2460 tempest-VolumesListTestJSON-1921243388 None] Deleted volume successfully. Aug 10 16:10:28 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-796a5c68-2a6a-4724-bc6e-4ce0a72c2460 tempest-VolumesListTestJSON-1921243388 None] Lock "cinder-c6387de2-8cd4-40e7-b044-bb2da3e312ed-delete_volume" released by "delete_volume" :: held 1.075s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:10:36 devstack cinder-volume[88641]: DEBUG oslo_service.periodic_task [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88641) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 16:10:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:10:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:10:36 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:10:36 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:10:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:10:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:10:36 devstack sudo[105655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:10:36 devstack sudo[105655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:10:36 devstack sudo[105655]: pam_unix(sudo:session): session closed for user root Aug 10 16:10:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.308s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:10:36 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:10:36 devstack cinder-volume[88641]: DEBUG oslo_service.periodic_task [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Running periodic task VolumeManager._thread_info {{(pid=88641) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 16:10:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] thread count: 28 {{(pid=88641) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 10 16:10:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] thread info: [<_MainThread(MainThread, started 127361545748608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88641) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 10 16:10:38 devstack cinder-volume[88641]: DEBUG dbcounter [-] [88641] Writing DB stats cinder:SELECT=97,cinder:UPDATE=126,cinder:DELETE=13,cinder:INSERT=34 {{(pid=88641) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 16:10:38 devstack cinder-volume[88641]: DEBUG dbcounter [-] [88641] Writing DB stats cinder:UPDATE=137,cinder:SELECT=91,cinder:INSERT=38,cinder:DELETE=9 {{(pid=88641) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 16:11:00 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-049c610e-14a0-4253-857b-425a74fcfa7d tempest-TestMinimumBasicScenario-2065792472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:11:00 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-049c610e-14a0-4253-857b-425a74fcfa7d tempest-TestMinimumBasicScenario-2065792472 None] Flow 'volume_create_manager' (33dd7c57-b3a9-4abc-a540-c4e766559568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:11:00 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-049c610e-14a0-4253-857b-425a74fcfa7d tempest-TestMinimumBasicScenario-2065792472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f91a2fe9-c860-45e8-9e3b-c74fe9626e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:11:00 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-049c610e-14a0-4253-857b-425a74fcfa7d tempest-TestMinimumBasicScenario-2065792472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f91a2fe9-c860-45e8-9e3b-c74fe9626e0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:11:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-181640996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84f81980-21b2-4079-9d40-c67d65397b5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9640c61c52cc4dca9a2cfaba9f0c237f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:11:01Z,use_quota=True,user_id='08c039b1c0044f65ae1ac8c63c8265e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:11:00 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-049c610e-14a0-4253-857b-425a74fcfa7d tempest-TestMinimumBasicScenario-2065792472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b004a9dc-325c-4895-8c8a-79c51c2c3823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:11:00 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-049c610e-14a0-4253-857b-425a74fcfa7d tempest-TestMinimumBasicScenario-2065792472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b004a9dc-325c-4895-8c8a-79c51c2c3823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:11:00 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-049c610e-14a0-4253-857b-425a74fcfa7d tempest-TestMinimumBasicScenario-2065792472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba6cef53-f1af-481c-b3a1-496a04b80a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:11:00 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-049c610e-14a0-4253-857b-425a74fcfa7d tempest-TestMinimumBasicScenario-2065792472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba6cef53-f1af-481c-b3a1-496a04b80a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84f81980-21b2-4079-9d40-c67d65397b5f', 'volume_name': 'volume-84f81980-21b2-4079-9d40-c67d65397b5f', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:11:00 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-049c610e-14a0-4253-857b-425a74fcfa7d tempest-TestMinimumBasicScenario-2065792472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78bb0500-c385-48d6-8969-eb563a3aec8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:11:00 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-049c610e-14a0-4253-857b-425a74fcfa7d tempest-TestMinimumBasicScenario-2065792472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78bb0500-c385-48d6-8969-eb563a3aec8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:11:00 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-049c610e-14a0-4253-857b-425a74fcfa7d tempest-TestMinimumBasicScenario-2065792472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3ea7a2c-6eaf-4bc9-b1a6-d7cb31c41f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:11:00 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-049c610e-14a0-4253-857b-425a74fcfa7d tempest-TestMinimumBasicScenario-2065792472 None] Volume 84f81980-21b2-4079-9d40-c67d65397b5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84f81980-21b2-4079-9d40-c67d65397b5f', 'volume_size': 1} Aug 10 16:11:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-049c610e-14a0-4253-857b-425a74fcfa7d tempest-TestMinimumBasicScenario-2065792472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:11:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-049c610e-14a0-4253-857b-425a74fcfa7d tempest-TestMinimumBasicScenario-2065792472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:11:00 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-049c610e-14a0-4253-857b-425a74fcfa7d tempest-TestMinimumBasicScenario-2065792472 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:11:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-181640996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84f81980-21b2-4079-9d40-c67d65397b5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9640c61c52cc4dca9a2cfaba9f0c237f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:11:01Z,use_quota=True,user_id='08c039b1c0044f65ae1ac8c63c8265e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:11:00 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-049c610e-14a0-4253-857b-425a74fcfa7d tempest-TestMinimumBasicScenario-2065792472 None] Creating volume 84f81980-21b2-4079-9d40-c67d65397b5f {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:11:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-049c610e-14a0-4253-857b-425a74fcfa7d tempest-TestMinimumBasicScenario-2065792472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:11:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-049c610e-14a0-4253-857b-425a74fcfa7d tempest-TestMinimumBasicScenario-2065792472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:11:00 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-049c610e-14a0-4253-857b-425a74fcfa7d tempest-TestMinimumBasicScenario-2065792472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:11:00 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-049c610e-14a0-4253-857b-425a74fcfa7d tempest-TestMinimumBasicScenario-2065792472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:11:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-049c610e-14a0-4253-857b-425a74fcfa7d tempest-TestMinimumBasicScenario-2065792472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:11:00 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-049c610e-14a0-4253-857b-425a74fcfa7d tempest-TestMinimumBasicScenario-2065792472 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:11:00 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-049c610e-14a0-4253-857b-425a74fcfa7d tempest-TestMinimumBasicScenario-2065792472 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:11:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-049c610e-14a0-4253-857b-425a74fcfa7d tempest-TestMinimumBasicScenario-2065792472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-84f81980-21b2-4079-9d40-c67d65397b5f 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:11:00 devstack sudo[105816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-84f81980-21b2-4079-9d40-c67d65397b5f 1073741824 Aug 10 16:11:00 devstack sudo[105816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:11:01 devstack sudo[105816]: pam_unix(sudo:session): session closed for user root Aug 10 16:11:01 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-049c610e-14a0-4253-857b-425a74fcfa7d tempest-TestMinimumBasicScenario-2065792472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-84f81980-21b2-4079-9d40-c67d65397b5f 1073741824" returned: 0 in 0.426s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:11:01 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-049c610e-14a0-4253-857b-425a74fcfa7d tempest-TestMinimumBasicScenario-2065792472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-84f81980-21b2-4079-9d40-c67d65397b5f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:11:01 devstack sudo[105821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-84f81980-21b2-4079-9d40-c67d65397b5f Aug 10 16:11:01 devstack sudo[105821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:11:01 devstack sudo[105821]: pam_unix(sudo:session): session closed for user root Aug 10 16:11:01 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-049c610e-14a0-4253-857b-425a74fcfa7d tempest-TestMinimumBasicScenario-2065792472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-84f81980-21b2-4079-9d40-c67d65397b5f" returned: 0 in 0.259s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:11:01 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-049c610e-14a0-4253-857b-425a74fcfa7d tempest-TestMinimumBasicScenario-2065792472 None] <== create_volume: return (740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:11:01 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-049c610e-14a0-4253-857b-425a74fcfa7d tempest-TestMinimumBasicScenario-2065792472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:11:01 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-049c610e-14a0-4253-857b-425a74fcfa7d tempest-TestMinimumBasicScenario-2065792472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3ea7a2c-6eaf-4bc9-b1a6-d7cb31c41f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84f81980-21b2-4079-9d40-c67d65397b5f', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:11:01 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-049c610e-14a0-4253-857b-425a74fcfa7d tempest-TestMinimumBasicScenario-2065792472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbd5069c-8ddb-4116-bbc7-a389c2dd3d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:11:01 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-049c610e-14a0-4253-857b-425a74fcfa7d tempest-TestMinimumBasicScenario-2065792472 None] Volume volume-84f81980-21b2-4079-9d40-c67d65397b5f (84f81980-21b2-4079-9d40-c67d65397b5f): created successfully Aug 10 16:11:01 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-049c610e-14a0-4253-857b-425a74fcfa7d tempest-TestMinimumBasicScenario-2065792472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbd5069c-8ddb-4116-bbc7-a389c2dd3d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:11:01 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-049c610e-14a0-4253-857b-425a74fcfa7d tempest-TestMinimumBasicScenario-2065792472 None] Flow 'volume_create_manager' (33dd7c57-b3a9-4abc-a540-c4e766559568) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:11:01 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-049c610e-14a0-4253-857b-425a74fcfa7d tempest-TestMinimumBasicScenario-2065792472 None] Created volume successfully. Aug 10 16:11:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-a97a1d36-9302-486b-8885-28d9340aebf4 req-7c372260-16ce-4fd7-a55e-3c585ae9951e tempest-TestMinimumBasicScenario-2065792472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:11:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-a97a1d36-9302-486b-8885-28d9340aebf4 req-7c372260-16ce-4fd7-a55e-3c585ae9951e tempest-TestMinimumBasicScenario-2065792472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:11:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-a97a1d36-9302-486b-8885-28d9340aebf4 req-7c372260-16ce-4fd7-a55e-3c585ae9951e tempest-TestMinimumBasicScenario-2065792472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:11:02 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [req-a97a1d36-9302-486b-8885-28d9340aebf4 req-7c372260-16ce-4fd7-a55e-3c585ae9951e tempest-TestMinimumBasicScenario-2065792472 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc', 'name': 'volume-84f81980-21b2-4079-9d40-c67d65397b5f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4dc608ac-35a8-46f1-8c93-a0f8b78e2f03', 'enforce_multipath': True} {{(pid=88641) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 10 16:11:02 devstack cinder-volume[88641]: INFO cinder.volume.manager [req-a97a1d36-9302-486b-8885-28d9340aebf4 req-7c372260-16ce-4fd7-a55e-3c585ae9951e tempest-TestMinimumBasicScenario-2065792472 None] attachment_update completed successfully. Aug 10 16:11:12 devstack cinder-volume[88641]: DEBUG dbcounter [-] [88641] Writing DB stats cinder:SELECT=9,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=88641) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 16:11:12 devstack cinder-volume[88641]: DEBUG dbcounter [-] [88641] Writing DB stats cinder:SELECT=8,cinder:UPDATE=5,cinder:INSERT=1 {{(pid=88641) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 16:11:36 devstack cinder-volume[88641]: DEBUG oslo_service.periodic_task [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88641) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 16:11:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:11:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:11:36 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:11:36 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:11:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:11:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:11:36 devstack sudo[106340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:11:36 devstack sudo[106340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:11:36 devstack sudo[106340]: pam_unix(sudo:session): session closed for user root Aug 10 16:11:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.264s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:11:36 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:11:36 devstack cinder-volume[88641]: DEBUG oslo_service.periodic_task [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Running periodic task VolumeManager._thread_info {{(pid=88641) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 16:11:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] thread count: 28 {{(pid=88641) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 10 16:11:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] thread info: [<_MainThread(MainThread, started 127361545748608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88641) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 10 16:11:39 devstack cinder-volume[88641]: DEBUG dbcounter [-] [88641] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=88641) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 16:11:48 devstack cinder-volume[88641]: INFO cinder.volume.manager [req-6e0c17ae-f25b-464a-b17f-22a30a4c2b87 req-b48deefd-dfc5-4829-bb6e-b34ae9c32885 tempest-TestMinimumBasicScenario-2065792472 None] Terminate volume connection completed successfully. Aug 10 16:11:48 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [req-6e0c17ae-f25b-464a-b17f-22a30a4c2b87 req-b48deefd-dfc5-4829-bb6e-b34ae9c32885 tempest-TestMinimumBasicScenario-2065792472 None] Deleting attachment 4dc608ac-35a8-46f1-8c93-a0f8b78e2f03. {{(pid=88641) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 10 16:11:49 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-5c6ffb41-6f0e-4df1-afc5-6a4e462e5fa1 tempest-TestMinimumBasicScenario-2065792472 None] Acquiring lock "cinder-84f81980-21b2-4079-9d40-c67d65397b5f-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:11:49 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-5c6ffb41-6f0e-4df1-afc5-6a4e462e5fa1 tempest-TestMinimumBasicScenario-2065792472 None] Lock "cinder-84f81980-21b2-4079-9d40-c67d65397b5f-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:11:49 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-5c6ffb41-6f0e-4df1-afc5-6a4e462e5fa1 tempest-TestMinimumBasicScenario-2065792472 None] Acquiring lock "cinder-quobyte-84f81980-21b2-4079-9d40-c67d65397b5f" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:11:49 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-5c6ffb41-6f0e-4df1-afc5-6a4e462e5fa1 tempest-TestMinimumBasicScenario-2065792472 None] Lock "cinder-quobyte-84f81980-21b2-4079-9d40-c67d65397b5f" acquired by "delete_volume" :: waited 0.021s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:11:49 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[c018eecf-28f3-42a8-9713-f10cfd9629b8]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:11:49 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5c6ffb41-6f0e-4df1-afc5-6a4e462e5fa1 tempest-TestMinimumBasicScenario-2065792472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-84f81980-21b2-4079-9d40-c67d65397b5f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:11:49 devstack sudo[106375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-84f81980-21b2-4079-9d40-c67d65397b5f Aug 10 16:11:49 devstack sudo[106375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:11:50 devstack sudo[106375]: pam_unix(sudo:session): session closed for user root Aug 10 16:11:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5c6ffb41-6f0e-4df1-afc5-6a4e462e5fa1 tempest-TestMinimumBasicScenario-2065792472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-84f81980-21b2-4079-9d40-c67d65397b5f" returned: 0 in 0.355s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:11:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5c6ffb41-6f0e-4df1-afc5-6a4e462e5fa1 tempest-TestMinimumBasicScenario-2065792472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-84f81980-21b2-4079-9d40-c67d65397b5f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:11:50 devstack sudo[106380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-84f81980-21b2-4079-9d40-c67d65397b5f Aug 10 16:11:50 devstack sudo[106380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:11:50 devstack sudo[106380]: pam_unix(sudo:session): session closed for user root Aug 10 16:11:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5c6ffb41-6f0e-4df1-afc5-6a4e462e5fa1 tempest-TestMinimumBasicScenario-2065792472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-84f81980-21b2-4079-9d40-c67d65397b5f" returned: 0 in 0.262s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:11:50 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-5c6ffb41-6f0e-4df1-afc5-6a4e462e5fa1 tempest-TestMinimumBasicScenario-2065792472 None] Lock "cinder-quobyte-84f81980-21b2-4079-9d40-c67d65397b5f" released by "delete_volume" :: held 0.664s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:11:50 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-5c6ffb41-6f0e-4df1-afc5-6a4e462e5fa1 tempest-TestMinimumBasicScenario-2065792472 None] Created reservations ['271a4b35-aa1e-472f-9bc1-71f45729efaa', '8d8c58fd-2974-4f2b-aff0-a4b67b579525', '269a04fe-4657-483d-a6d8-481489d00348', '55eeacb4-42b9-4e72-a449-170ae73204a0'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:11:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-5c6ffb41-6f0e-4df1-afc5-6a4e462e5fa1 tempest-TestMinimumBasicScenario-2065792472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:11:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-5c6ffb41-6f0e-4df1-afc5-6a4e462e5fa1 tempest-TestMinimumBasicScenario-2065792472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:11:50 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-5c6ffb41-6f0e-4df1-afc5-6a4e462e5fa1 tempest-TestMinimumBasicScenario-2065792472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:11:50 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-5c6ffb41-6f0e-4df1-afc5-6a4e462e5fa1 tempest-TestMinimumBasicScenario-2065792472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:11:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-5c6ffb41-6f0e-4df1-afc5-6a4e462e5fa1 tempest-TestMinimumBasicScenario-2065792472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:11:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5c6ffb41-6f0e-4df1-afc5-6a4e462e5fa1 tempest-TestMinimumBasicScenario-2065792472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:11:50 devstack sudo[106383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:11:50 devstack sudo[106383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:11:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5c6ffb41-6f0e-4df1-afc5-6a4e462e5fa1 tempest-TestMinimumBasicScenario-2065792472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.269s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:11:50 devstack sudo[106383]: pam_unix(sudo:session): session closed for user root Aug 10 16:11:50 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-5c6ffb41-6f0e-4df1-afc5-6a4e462e5fa1 tempest-TestMinimumBasicScenario-2065792472 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:11:50 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-5c6ffb41-6f0e-4df1-afc5-6a4e462e5fa1 tempest-TestMinimumBasicScenario-2065792472 None] Deleted volume successfully. Aug 10 16:11:50 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-5c6ffb41-6f0e-4df1-afc5-6a4e462e5fa1 tempest-TestMinimumBasicScenario-2065792472 None] Lock "cinder-84f81980-21b2-4079-9d40-c67d65397b5f-delete_volume" released by "delete_volume" :: held 1.188s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:12:00 devstack cinder-volume[88641]: DEBUG dbcounter [-] [88641] Writing DB stats cinder:SELECT=5,cinder:UPDATE=8,cinder:INSERT=3 {{(pid=88641) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 16:12:00 devstack cinder-volume[88641]: DEBUG dbcounter [-] [88641] Writing DB stats cinder:SELECT=7,cinder:INSERT=1,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=88641) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 16:12:36 devstack cinder-volume[88641]: DEBUG oslo_service.periodic_task [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88641) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 16:12:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:12:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:12:36 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:12:36 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:12:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:12:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:12:36 devstack sudo[106570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:12:36 devstack sudo[106570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:12:36 devstack sudo[106570]: pam_unix(sudo:session): session closed for user root Aug 10 16:12:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.257s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:12:36 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:12:36 devstack cinder-volume[88641]: DEBUG oslo_service.periodic_task [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Running periodic task VolumeManager._thread_info {{(pid=88641) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 16:12:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] thread count: 28 {{(pid=88641) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 10 16:12:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] thread info: [<_MainThread(MainThread, started 127361545748608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88641) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 10 16:12:55 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-79221019-44e7-4060-b1df-3f4e14c63237 tempest-TestServerVolumeAttachScenarioOldVersion-1916600596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:12:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-79221019-44e7-4060-b1df-3f4e14c63237 tempest-TestServerVolumeAttachScenarioOldVersion-1916600596 None] Flow 'volume_create_manager' (f329b6fb-6643-4280-ba85-8330dd811af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:12:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-79221019-44e7-4060-b1df-3f4e14c63237 tempest-TestServerVolumeAttachScenarioOldVersion-1916600596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee8fc19e-9563-4ab2-9458-7117a1504d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:12:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-79221019-44e7-4060-b1df-3f4e14c63237 tempest-TestServerVolumeAttachScenarioOldVersion-1916600596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee8fc19e-9563-4ab2-9458-7117a1504d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:12:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-72426513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c15a2a3-4e68-477f-a0c6-8fa09693b395,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52248795253e4898a6ecad337c182bba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:12:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:12:55Z,use_quota=True,user_id='7d1fcc8a21514be787c0324c5f37a3eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:12:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-79221019-44e7-4060-b1df-3f4e14c63237 tempest-TestServerVolumeAttachScenarioOldVersion-1916600596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d673b1e0-caf6-493f-b2f8-c13d7853def1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:12:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-79221019-44e7-4060-b1df-3f4e14c63237 tempest-TestServerVolumeAttachScenarioOldVersion-1916600596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d673b1e0-caf6-493f-b2f8-c13d7853def1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:12:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-79221019-44e7-4060-b1df-3f4e14c63237 tempest-TestServerVolumeAttachScenarioOldVersion-1916600596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bf57139-57d1-49fa-81f7-c828eb954b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:12:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-79221019-44e7-4060-b1df-3f4e14c63237 tempest-TestServerVolumeAttachScenarioOldVersion-1916600596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bf57139-57d1-49fa-81f7-c828eb954b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c15a2a3-4e68-477f-a0c6-8fa09693b395', 'volume_name': 'volume-8c15a2a3-4e68-477f-a0c6-8fa09693b395', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:12:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-79221019-44e7-4060-b1df-3f4e14c63237 tempest-TestServerVolumeAttachScenarioOldVersion-1916600596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12e87d17-b4f8-4006-8a72-eba7cc317818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:12:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-79221019-44e7-4060-b1df-3f4e14c63237 tempest-TestServerVolumeAttachScenarioOldVersion-1916600596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12e87d17-b4f8-4006-8a72-eba7cc317818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:12:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-79221019-44e7-4060-b1df-3f4e14c63237 tempest-TestServerVolumeAttachScenarioOldVersion-1916600596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2df560d3-3efa-47c9-86dd-84226f293a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:12:55 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-79221019-44e7-4060-b1df-3f4e14c63237 tempest-TestServerVolumeAttachScenarioOldVersion-1916600596 None] Volume 8c15a2a3-4e68-477f-a0c6-8fa09693b395: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c15a2a3-4e68-477f-a0c6-8fa09693b395', 'volume_size': 1} Aug 10 16:12:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-79221019-44e7-4060-b1df-3f4e14c63237 tempest-TestServerVolumeAttachScenarioOldVersion-1916600596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:12:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-79221019-44e7-4060-b1df-3f4e14c63237 tempest-TestServerVolumeAttachScenarioOldVersion-1916600596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:12:55 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-79221019-44e7-4060-b1df-3f4e14c63237 tempest-TestServerVolumeAttachScenarioOldVersion-1916600596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:12:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-72426513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c15a2a3-4e68-477f-a0c6-8fa09693b395,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52248795253e4898a6ecad337c182bba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:12:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:12:55Z,use_quota=True,user_id='7d1fcc8a21514be787c0324c5f37a3eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:12:55 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-79221019-44e7-4060-b1df-3f4e14c63237 tempest-TestServerVolumeAttachScenarioOldVersion-1916600596 None] Creating volume 8c15a2a3-4e68-477f-a0c6-8fa09693b395 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:12:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-79221019-44e7-4060-b1df-3f4e14c63237 tempest-TestServerVolumeAttachScenarioOldVersion-1916600596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:12:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-79221019-44e7-4060-b1df-3f4e14c63237 tempest-TestServerVolumeAttachScenarioOldVersion-1916600596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:12:55 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-79221019-44e7-4060-b1df-3f4e14c63237 tempest-TestServerVolumeAttachScenarioOldVersion-1916600596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:12:55 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-79221019-44e7-4060-b1df-3f4e14c63237 tempest-TestServerVolumeAttachScenarioOldVersion-1916600596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:12:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-79221019-44e7-4060-b1df-3f4e14c63237 tempest-TestServerVolumeAttachScenarioOldVersion-1916600596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:12:55 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-79221019-44e7-4060-b1df-3f4e14c63237 tempest-TestServerVolumeAttachScenarioOldVersion-1916600596 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:12:55 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-79221019-44e7-4060-b1df-3f4e14c63237 tempest-TestServerVolumeAttachScenarioOldVersion-1916600596 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:12:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-79221019-44e7-4060-b1df-3f4e14c63237 tempest-TestServerVolumeAttachScenarioOldVersion-1916600596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-8c15a2a3-4e68-477f-a0c6-8fa09693b395 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:12:55 devstack sudo[106602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-8c15a2a3-4e68-477f-a0c6-8fa09693b395 1073741824 Aug 10 16:12:55 devstack sudo[106602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:12:55 devstack sudo[106602]: pam_unix(sudo:session): session closed for user root Aug 10 16:12:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-79221019-44e7-4060-b1df-3f4e14c63237 tempest-TestServerVolumeAttachScenarioOldVersion-1916600596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-8c15a2a3-4e68-477f-a0c6-8fa09693b395 1073741824" returned: 0 in 0.420s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:12:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-79221019-44e7-4060-b1df-3f4e14c63237 tempest-TestServerVolumeAttachScenarioOldVersion-1916600596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-8c15a2a3-4e68-477f-a0c6-8fa09693b395 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:12:55 devstack sudo[106608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-8c15a2a3-4e68-477f-a0c6-8fa09693b395 Aug 10 16:12:55 devstack sudo[106608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:12:55 devstack sudo[106608]: pam_unix(sudo:session): session closed for user root Aug 10 16:12:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-79221019-44e7-4060-b1df-3f4e14c63237 tempest-TestServerVolumeAttachScenarioOldVersion-1916600596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-8c15a2a3-4e68-477f-a0c6-8fa09693b395" returned: 0 in 0.266s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:12:55 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-79221019-44e7-4060-b1df-3f4e14c63237 tempest-TestServerVolumeAttachScenarioOldVersion-1916600596 None] <== create_volume: return (727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:12:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-79221019-44e7-4060-b1df-3f4e14c63237 tempest-TestServerVolumeAttachScenarioOldVersion-1916600596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:12:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-79221019-44e7-4060-b1df-3f4e14c63237 tempest-TestServerVolumeAttachScenarioOldVersion-1916600596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2df560d3-3efa-47c9-86dd-84226f293a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c15a2a3-4e68-477f-a0c6-8fa09693b395', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:12:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-79221019-44e7-4060-b1df-3f4e14c63237 tempest-TestServerVolumeAttachScenarioOldVersion-1916600596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d970c976-0806-45ca-bb26-fd15b41a92bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:12:55 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-79221019-44e7-4060-b1df-3f4e14c63237 tempest-TestServerVolumeAttachScenarioOldVersion-1916600596 None] Volume volume-8c15a2a3-4e68-477f-a0c6-8fa09693b395 (8c15a2a3-4e68-477f-a0c6-8fa09693b395): created successfully Aug 10 16:12:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-79221019-44e7-4060-b1df-3f4e14c63237 tempest-TestServerVolumeAttachScenarioOldVersion-1916600596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d970c976-0806-45ca-bb26-fd15b41a92bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:12:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-79221019-44e7-4060-b1df-3f4e14c63237 tempest-TestServerVolumeAttachScenarioOldVersion-1916600596 None] Flow 'volume_create_manager' (f329b6fb-6643-4280-ba85-8330dd811af8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:12:55 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-79221019-44e7-4060-b1df-3f4e14c63237 tempest-TestServerVolumeAttachScenarioOldVersion-1916600596 None] Created volume successfully. Aug 10 16:12:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-6b91d736-12d3-49b4-8072-fa888226eeaf req-74972e84-c3bc-44da-9e04-3e6a4dbc7629 tempest-TestServerVolumeAttachScenarioOldVersion-1916600596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:12:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-6b91d736-12d3-49b4-8072-fa888226eeaf req-74972e84-c3bc-44da-9e04-3e6a4dbc7629 tempest-TestServerVolumeAttachScenarioOldVersion-1916600596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:12:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-6b91d736-12d3-49b4-8072-fa888226eeaf req-74972e84-c3bc-44da-9e04-3e6a4dbc7629 tempest-TestServerVolumeAttachScenarioOldVersion-1916600596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:12:56 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [req-6b91d736-12d3-49b4-8072-fa888226eeaf req-74972e84-c3bc-44da-9e04-3e6a4dbc7629 tempest-TestServerVolumeAttachScenarioOldVersion-1916600596 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc', 'name': 'volume-8c15a2a3-4e68-477f-a0c6-8fa09693b395', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '694917a7-51dd-4c76-b108-afd517807414', 'enforce_multipath': True} {{(pid=88641) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 10 16:12:56 devstack cinder-volume[88641]: INFO cinder.volume.manager [req-6b91d736-12d3-49b4-8072-fa888226eeaf req-74972e84-c3bc-44da-9e04-3e6a4dbc7629 tempest-TestServerVolumeAttachScenarioOldVersion-1916600596 None] attachment_update completed successfully. Aug 10 16:13:00 devstack cinder-volume[88641]: INFO cinder.volume.manager [req-e942deae-a7e1-4bd7-8998-5985b9b6bc49 req-07f70626-4702-4fc6-8310-5d8a2c7efb47 tempest-TestServerVolumeAttachScenarioOldVersion-1916600596 None] Terminate volume connection completed successfully. Aug 10 16:13:00 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [req-e942deae-a7e1-4bd7-8998-5985b9b6bc49 req-07f70626-4702-4fc6-8310-5d8a2c7efb47 tempest-TestServerVolumeAttachScenarioOldVersion-1916600596 None] Deleting attachment 694917a7-51dd-4c76-b108-afd517807414. {{(pid=88641) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 10 16:13:01 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-4aed64da-910f-43a9-92ce-09d45277de08 tempest-TestServerVolumeAttachScenarioOldVersion-1916600596 None] Acquiring lock "cinder-8c15a2a3-4e68-477f-a0c6-8fa09693b395-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:13:01 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-4aed64da-910f-43a9-92ce-09d45277de08 tempest-TestServerVolumeAttachScenarioOldVersion-1916600596 None] Lock "cinder-8c15a2a3-4e68-477f-a0c6-8fa09693b395-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:13:01 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-4aed64da-910f-43a9-92ce-09d45277de08 tempest-TestServerVolumeAttachScenarioOldVersion-1916600596 None] Acquiring lock "cinder-quobyte-8c15a2a3-4e68-477f-a0c6-8fa09693b395" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:13:01 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-4aed64da-910f-43a9-92ce-09d45277de08 tempest-TestServerVolumeAttachScenarioOldVersion-1916600596 None] Lock "cinder-quobyte-8c15a2a3-4e68-477f-a0c6-8fa09693b395" acquired by "delete_volume" :: waited 0.019s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:13:01 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[770e1e78-6d63-4991-a31d-69159eb04b14]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:13:01 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4aed64da-910f-43a9-92ce-09d45277de08 tempest-TestServerVolumeAttachScenarioOldVersion-1916600596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-8c15a2a3-4e68-477f-a0c6-8fa09693b395 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:13:01 devstack sudo[107073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-8c15a2a3-4e68-477f-a0c6-8fa09693b395 Aug 10 16:13:01 devstack sudo[107073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:13:01 devstack sudo[107073]: pam_unix(sudo:session): session closed for user root Aug 10 16:13:01 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4aed64da-910f-43a9-92ce-09d45277de08 tempest-TestServerVolumeAttachScenarioOldVersion-1916600596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-8c15a2a3-4e68-477f-a0c6-8fa09693b395" returned: 0 in 0.356s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:13:01 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4aed64da-910f-43a9-92ce-09d45277de08 tempest-TestServerVolumeAttachScenarioOldVersion-1916600596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-8c15a2a3-4e68-477f-a0c6-8fa09693b395 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:13:01 devstack sudo[107078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-8c15a2a3-4e68-477f-a0c6-8fa09693b395 Aug 10 16:13:01 devstack sudo[107078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:13:01 devstack sudo[107078]: pam_unix(sudo:session): session closed for user root Aug 10 16:13:01 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4aed64da-910f-43a9-92ce-09d45277de08 tempest-TestServerVolumeAttachScenarioOldVersion-1916600596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-8c15a2a3-4e68-477f-a0c6-8fa09693b395" returned: 0 in 0.242s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:13:01 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-4aed64da-910f-43a9-92ce-09d45277de08 tempest-TestServerVolumeAttachScenarioOldVersion-1916600596 None] Lock "cinder-quobyte-8c15a2a3-4e68-477f-a0c6-8fa09693b395" released by "delete_volume" :: held 0.639s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:13:01 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-4aed64da-910f-43a9-92ce-09d45277de08 tempest-TestServerVolumeAttachScenarioOldVersion-1916600596 None] Created reservations ['fb9ceb1f-ca72-469c-b583-c33ac339fc1a', 'c76694fd-b705-4b4a-ae9d-75c24ff71eb0', '12a55606-7ad0-434d-8d69-653aab6e57b8', 'd884989b-7137-415c-8123-2f1f9b6cdc15'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:13:01 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-4aed64da-910f-43a9-92ce-09d45277de08 tempest-TestServerVolumeAttachScenarioOldVersion-1916600596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:13:01 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-4aed64da-910f-43a9-92ce-09d45277de08 tempest-TestServerVolumeAttachScenarioOldVersion-1916600596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:13:01 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-4aed64da-910f-43a9-92ce-09d45277de08 tempest-TestServerVolumeAttachScenarioOldVersion-1916600596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:13:02 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-4aed64da-910f-43a9-92ce-09d45277de08 tempest-TestServerVolumeAttachScenarioOldVersion-1916600596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:13:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-4aed64da-910f-43a9-92ce-09d45277de08 tempest-TestServerVolumeAttachScenarioOldVersion-1916600596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:13:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4aed64da-910f-43a9-92ce-09d45277de08 tempest-TestServerVolumeAttachScenarioOldVersion-1916600596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:13:02 devstack sudo[107081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:13:02 devstack sudo[107081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:13:02 devstack sudo[107081]: pam_unix(sudo:session): session closed for user root Aug 10 16:13:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4aed64da-910f-43a9-92ce-09d45277de08 tempest-TestServerVolumeAttachScenarioOldVersion-1916600596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.236s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:13:02 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-4aed64da-910f-43a9-92ce-09d45277de08 tempest-TestServerVolumeAttachScenarioOldVersion-1916600596 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:13:02 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-4aed64da-910f-43a9-92ce-09d45277de08 tempest-TestServerVolumeAttachScenarioOldVersion-1916600596 None] Deleted volume successfully. Aug 10 16:13:02 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-4aed64da-910f-43a9-92ce-09d45277de08 tempest-TestServerVolumeAttachScenarioOldVersion-1916600596 None] Lock "cinder-8c15a2a3-4e68-477f-a0c6-8fa09693b395-delete_volume" released by "delete_volume" :: held 1.070s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:13:11 devstack cinder-volume[88641]: DEBUG dbcounter [-] [88641] Writing DB stats cinder:SELECT=17,cinder:UPDATE=11,cinder:INSERT=4 {{(pid=88641) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 16:13:12 devstack cinder-volume[88641]: DEBUG dbcounter [-] [88641] Writing DB stats cinder:UPDATE=14,cinder:SELECT=12,cinder:DELETE=2,cinder:INSERT=1 {{(pid=88641) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 16:13:35 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b29b941-b8d7-418e-add2-e2cfda3d1ff3 tempest-TestServerVolumeAttachmentScenario-756080469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:13:35 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2b29b941-b8d7-418e-add2-e2cfda3d1ff3 tempest-TestServerVolumeAttachmentScenario-756080469 None] Flow 'volume_create_manager' (a9f4dd4e-96ba-4f24-8b84-e9619a1ac1f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:13:35 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2b29b941-b8d7-418e-add2-e2cfda3d1ff3 tempest-TestServerVolumeAttachmentScenario-756080469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (550ee124-cfd7-4635-9cde-fdcdad10696c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:13:35 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2b29b941-b8d7-418e-add2-e2cfda3d1ff3 tempest-TestServerVolumeAttachmentScenario-756080469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (550ee124-cfd7-4635-9cde-fdcdad10696c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:13:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1678882980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=641f1872-69f8-460d-a935-4ec6b47240c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11905af7084747b8b5b633da8a675e08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:13:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:13:36Z,use_quota=True,user_id='1e5dd2d8b49647f1aca26d6babba4f3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:13:35 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2b29b941-b8d7-418e-add2-e2cfda3d1ff3 tempest-TestServerVolumeAttachmentScenario-756080469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df1c14fc-37a9-44c9-9470-26f873c6aea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:13:35 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2b29b941-b8d7-418e-add2-e2cfda3d1ff3 tempest-TestServerVolumeAttachmentScenario-756080469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df1c14fc-37a9-44c9-9470-26f873c6aea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:13:35 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2b29b941-b8d7-418e-add2-e2cfda3d1ff3 tempest-TestServerVolumeAttachmentScenario-756080469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4776202-7307-4c0b-bfea-74cccbf5305a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:13:35 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2b29b941-b8d7-418e-add2-e2cfda3d1ff3 tempest-TestServerVolumeAttachmentScenario-756080469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4776202-7307-4c0b-bfea-74cccbf5305a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '641f1872-69f8-460d-a935-4ec6b47240c6', 'volume_name': 'volume-641f1872-69f8-460d-a935-4ec6b47240c6', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:13:35 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2b29b941-b8d7-418e-add2-e2cfda3d1ff3 tempest-TestServerVolumeAttachmentScenario-756080469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21690637-2d16-4e5c-8280-53ab2365455f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:13:35 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2b29b941-b8d7-418e-add2-e2cfda3d1ff3 tempest-TestServerVolumeAttachmentScenario-756080469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21690637-2d16-4e5c-8280-53ab2365455f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:13:35 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2b29b941-b8d7-418e-add2-e2cfda3d1ff3 tempest-TestServerVolumeAttachmentScenario-756080469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d6c3447-6de5-469f-ab1e-95159ab99c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:13:35 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-2b29b941-b8d7-418e-add2-e2cfda3d1ff3 tempest-TestServerVolumeAttachmentScenario-756080469 None] Volume 641f1872-69f8-460d-a935-4ec6b47240c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-641f1872-69f8-460d-a935-4ec6b47240c6', 'volume_size': 1} Aug 10 16:13:35 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-2b29b941-b8d7-418e-add2-e2cfda3d1ff3 tempest-TestServerVolumeAttachmentScenario-756080469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:13:35 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-2b29b941-b8d7-418e-add2-e2cfda3d1ff3 tempest-TestServerVolumeAttachmentScenario-756080469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:13:35 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-2b29b941-b8d7-418e-add2-e2cfda3d1ff3 tempest-TestServerVolumeAttachmentScenario-756080469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:13:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1678882980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=641f1872-69f8-460d-a935-4ec6b47240c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11905af7084747b8b5b633da8a675e08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:13:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:13:36Z,use_quota=True,user_id='1e5dd2d8b49647f1aca26d6babba4f3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:13:35 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-2b29b941-b8d7-418e-add2-e2cfda3d1ff3 tempest-TestServerVolumeAttachmentScenario-756080469 None] Creating volume 641f1872-69f8-460d-a935-4ec6b47240c6 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:13:35 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-2b29b941-b8d7-418e-add2-e2cfda3d1ff3 tempest-TestServerVolumeAttachmentScenario-756080469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:13:35 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-2b29b941-b8d7-418e-add2-e2cfda3d1ff3 tempest-TestServerVolumeAttachmentScenario-756080469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:13:35 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-2b29b941-b8d7-418e-add2-e2cfda3d1ff3 tempest-TestServerVolumeAttachmentScenario-756080469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:13:35 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-2b29b941-b8d7-418e-add2-e2cfda3d1ff3 tempest-TestServerVolumeAttachmentScenario-756080469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:13:35 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-2b29b941-b8d7-418e-add2-e2cfda3d1ff3 tempest-TestServerVolumeAttachmentScenario-756080469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:13:35 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-2b29b941-b8d7-418e-add2-e2cfda3d1ff3 tempest-TestServerVolumeAttachmentScenario-756080469 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:13:35 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-2b29b941-b8d7-418e-add2-e2cfda3d1ff3 tempest-TestServerVolumeAttachmentScenario-756080469 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:13:35 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-2b29b941-b8d7-418e-add2-e2cfda3d1ff3 tempest-TestServerVolumeAttachmentScenario-756080469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-641f1872-69f8-460d-a935-4ec6b47240c6 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:13:35 devstack sudo[107131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-641f1872-69f8-460d-a935-4ec6b47240c6 1073741824 Aug 10 16:13:35 devstack sudo[107131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:13:36 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-1063b8c6-783c-41dd-ac43-5046f366ec2d tempest-TestServerVolumeAttachmentScenario-756080469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:13:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-1063b8c6-783c-41dd-ac43-5046f366ec2d tempest-TestServerVolumeAttachmentScenario-756080469 None] Flow 'volume_create_manager' (11c87af4-bd05-4d02-a88f-077471c8b447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:13:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-1063b8c6-783c-41dd-ac43-5046f366ec2d tempest-TestServerVolumeAttachmentScenario-756080469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c10fe4dc-e91d-4631-92de-4ea1c6be72ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:13:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-1063b8c6-783c-41dd-ac43-5046f366ec2d tempest-TestServerVolumeAttachmentScenario-756080469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c10fe4dc-e91d-4631-92de-4ea1c6be72ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:13:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-185111192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ed9195b-8ae5-41fa-ad7f-046ba9349674,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11905af7084747b8b5b633da8a675e08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:13:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:13:36Z,use_quota=True,user_id='1e5dd2d8b49647f1aca26d6babba4f3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:13:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-1063b8c6-783c-41dd-ac43-5046f366ec2d tempest-TestServerVolumeAttachmentScenario-756080469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba08d290-5d22-42cd-9d3f-3baff557eb80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:13:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-1063b8c6-783c-41dd-ac43-5046f366ec2d tempest-TestServerVolumeAttachmentScenario-756080469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba08d290-5d22-42cd-9d3f-3baff557eb80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:13:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-1063b8c6-783c-41dd-ac43-5046f366ec2d tempest-TestServerVolumeAttachmentScenario-756080469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c3278c8-f382-4631-a743-adbc45896e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:13:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-1063b8c6-783c-41dd-ac43-5046f366ec2d tempest-TestServerVolumeAttachmentScenario-756080469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c3278c8-f382-4631-a743-adbc45896e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ed9195b-8ae5-41fa-ad7f-046ba9349674', 'volume_name': 'volume-9ed9195b-8ae5-41fa-ad7f-046ba9349674', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:13:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-1063b8c6-783c-41dd-ac43-5046f366ec2d tempest-TestServerVolumeAttachmentScenario-756080469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3335e19c-066a-432d-8dcd-39e0cd86a637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:13:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-1063b8c6-783c-41dd-ac43-5046f366ec2d tempest-TestServerVolumeAttachmentScenario-756080469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3335e19c-066a-432d-8dcd-39e0cd86a637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:13:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-1063b8c6-783c-41dd-ac43-5046f366ec2d tempest-TestServerVolumeAttachmentScenario-756080469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88d71446-6f58-4336-b1df-fbb3cb5d4e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:13:36 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-1063b8c6-783c-41dd-ac43-5046f366ec2d tempest-TestServerVolumeAttachmentScenario-756080469 None] Volume 9ed9195b-8ae5-41fa-ad7f-046ba9349674: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ed9195b-8ae5-41fa-ad7f-046ba9349674', 'volume_size': 1} Aug 10 16:13:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-1063b8c6-783c-41dd-ac43-5046f366ec2d tempest-TestServerVolumeAttachmentScenario-756080469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:13:36 devstack sudo[107131]: pam_unix(sudo:session): session closed for user root Aug 10 16:13:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-2b29b941-b8d7-418e-add2-e2cfda3d1ff3 tempest-TestServerVolumeAttachmentScenario-756080469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-641f1872-69f8-460d-a935-4ec6b47240c6 1073741824" returned: 0 in 0.506s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:13:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-2b29b941-b8d7-418e-add2-e2cfda3d1ff3 tempest-TestServerVolumeAttachmentScenario-756080469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-641f1872-69f8-460d-a935-4ec6b47240c6 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:13:36 devstack cinder-volume[88641]: DEBUG oslo_service.periodic_task [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88641) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 16:13:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:13:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:13:36 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:13:36 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:13:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:13:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:13:36 devstack sudo[107137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-641f1872-69f8-460d-a935-4ec6b47240c6 Aug 10 16:13:36 devstack sudo[107137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:13:36 devstack sudo[107139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:13:36 devstack sudo[107139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:13:36 devstack sudo[107137]: pam_unix(sudo:session): session closed for user root Aug 10 16:13:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-2b29b941-b8d7-418e-add2-e2cfda3d1ff3 tempest-TestServerVolumeAttachmentScenario-756080469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-641f1872-69f8-460d-a935-4ec6b47240c6" returned: 0 in 0.280s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:13:36 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-2b29b941-b8d7-418e-add2-e2cfda3d1ff3 tempest-TestServerVolumeAttachmentScenario-756080469 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:13:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-2b29b941-b8d7-418e-add2-e2cfda3d1ff3 tempest-TestServerVolumeAttachmentScenario-756080469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:13:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-1063b8c6-783c-41dd-ac43-5046f366ec2d tempest-TestServerVolumeAttachmentScenario-756080469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.486s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:13:36 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-1063b8c6-783c-41dd-ac43-5046f366ec2d tempest-TestServerVolumeAttachmentScenario-756080469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:13:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-185111192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ed9195b-8ae5-41fa-ad7f-046ba9349674,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11905af7084747b8b5b633da8a675e08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:13:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:13:36Z,use_quota=True,user_id='1e5dd2d8b49647f1aca26d6babba4f3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:13:36 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-1063b8c6-783c-41dd-ac43-5046f366ec2d tempest-TestServerVolumeAttachmentScenario-756080469 None] Creating volume 9ed9195b-8ae5-41fa-ad7f-046ba9349674 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:13:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-1063b8c6-783c-41dd-ac43-5046f366ec2d tempest-TestServerVolumeAttachmentScenario-756080469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:13:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-1063b8c6-783c-41dd-ac43-5046f366ec2d tempest-TestServerVolumeAttachmentScenario-756080469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:13:36 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-1063b8c6-783c-41dd-ac43-5046f366ec2d tempest-TestServerVolumeAttachmentScenario-756080469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:13:36 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-1063b8c6-783c-41dd-ac43-5046f366ec2d tempest-TestServerVolumeAttachmentScenario-756080469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:13:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-1063b8c6-783c-41dd-ac43-5046f366ec2d tempest-TestServerVolumeAttachmentScenario-756080469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:13:36 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-1063b8c6-783c-41dd-ac43-5046f366ec2d tempest-TestServerVolumeAttachmentScenario-756080469 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:13:36 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-1063b8c6-783c-41dd-ac43-5046f366ec2d tempest-TestServerVolumeAttachmentScenario-756080469 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:13:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-1063b8c6-783c-41dd-ac43-5046f366ec2d tempest-TestServerVolumeAttachmentScenario-756080469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9ed9195b-8ae5-41fa-ad7f-046ba9349674 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:13:36 devstack sudo[107139]: pam_unix(sudo:session): session closed for user root Aug 10 16:13:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.294s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:13:36 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:13:36 devstack cinder-volume[88641]: DEBUG oslo_service.periodic_task [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Running periodic task VolumeManager._thread_info {{(pid=88641) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 16:13:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] thread count: 28 {{(pid=88641) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 10 16:13:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] thread info: [<_MainThread(MainThread, started 127361545748608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88641) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 10 16:13:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2b29b941-b8d7-418e-add2-e2cfda3d1ff3 tempest-TestServerVolumeAttachmentScenario-756080469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d6c3447-6de5-469f-ab1e-95159ab99c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-641f1872-69f8-460d-a935-4ec6b47240c6', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:13:36 devstack sudo[107143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9ed9195b-8ae5-41fa-ad7f-046ba9349674 1073741824 Aug 10 16:13:36 devstack sudo[107143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:13:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2b29b941-b8d7-418e-add2-e2cfda3d1ff3 tempest-TestServerVolumeAttachmentScenario-756080469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84431046-83e1-4360-8efe-ab49104f0200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:13:36 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-2b29b941-b8d7-418e-add2-e2cfda3d1ff3 tempest-TestServerVolumeAttachmentScenario-756080469 None] Volume volume-641f1872-69f8-460d-a935-4ec6b47240c6 (641f1872-69f8-460d-a935-4ec6b47240c6): created successfully Aug 10 16:13:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2b29b941-b8d7-418e-add2-e2cfda3d1ff3 tempest-TestServerVolumeAttachmentScenario-756080469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84431046-83e1-4360-8efe-ab49104f0200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:13:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2b29b941-b8d7-418e-add2-e2cfda3d1ff3 tempest-TestServerVolumeAttachmentScenario-756080469 None] Flow 'volume_create_manager' (a9f4dd4e-96ba-4f24-8b84-e9619a1ac1f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:13:36 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-2b29b941-b8d7-418e-add2-e2cfda3d1ff3 tempest-TestServerVolumeAttachmentScenario-756080469 None] Created volume successfully. Aug 10 16:13:37 devstack sudo[107143]: pam_unix(sudo:session): session closed for user root Aug 10 16:13:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-1063b8c6-783c-41dd-ac43-5046f366ec2d tempest-TestServerVolumeAttachmentScenario-756080469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9ed9195b-8ae5-41fa-ad7f-046ba9349674 1073741824" returned: 0 in 0.484s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:13:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-1063b8c6-783c-41dd-ac43-5046f366ec2d tempest-TestServerVolumeAttachmentScenario-756080469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9ed9195b-8ae5-41fa-ad7f-046ba9349674 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:13:37 devstack sudo[107149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9ed9195b-8ae5-41fa-ad7f-046ba9349674 Aug 10 16:13:37 devstack sudo[107149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:13:37 devstack sudo[107149]: pam_unix(sudo:session): session closed for user root Aug 10 16:13:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-1063b8c6-783c-41dd-ac43-5046f366ec2d tempest-TestServerVolumeAttachmentScenario-756080469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9ed9195b-8ae5-41fa-ad7f-046ba9349674" returned: 0 in 0.254s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:13:37 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-1063b8c6-783c-41dd-ac43-5046f366ec2d tempest-TestServerVolumeAttachmentScenario-756080469 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:13:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-1063b8c6-783c-41dd-ac43-5046f366ec2d tempest-TestServerVolumeAttachmentScenario-756080469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:13:37 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-1063b8c6-783c-41dd-ac43-5046f366ec2d tempest-TestServerVolumeAttachmentScenario-756080469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88d71446-6f58-4336-b1df-fbb3cb5d4e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ed9195b-8ae5-41fa-ad7f-046ba9349674', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:13:37 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-1063b8c6-783c-41dd-ac43-5046f366ec2d tempest-TestServerVolumeAttachmentScenario-756080469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0dffee0-0bfc-4add-956b-93aea70778ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:13:37 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-1063b8c6-783c-41dd-ac43-5046f366ec2d tempest-TestServerVolumeAttachmentScenario-756080469 None] Volume volume-9ed9195b-8ae5-41fa-ad7f-046ba9349674 (9ed9195b-8ae5-41fa-ad7f-046ba9349674): created successfully Aug 10 16:13:37 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-1063b8c6-783c-41dd-ac43-5046f366ec2d tempest-TestServerVolumeAttachmentScenario-756080469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0dffee0-0bfc-4add-956b-93aea70778ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:13:37 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-1063b8c6-783c-41dd-ac43-5046f366ec2d tempest-TestServerVolumeAttachmentScenario-756080469 None] Flow 'volume_create_manager' (11c87af4-bd05-4d02-a88f-077471c8b447) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:13:37 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-1063b8c6-783c-41dd-ac43-5046f366ec2d tempest-TestServerVolumeAttachmentScenario-756080469 None] Created volume successfully. Aug 10 16:13:47 devstack cinder-volume[88641]: DEBUG dbcounter [-] [88641] Writing DB stats cinder:UPDATE=7,cinder:SELECT=2,cinder:INSERT=1 {{(pid=88641) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 16:13:47 devstack cinder-volume[88641]: DEBUG dbcounter [-] [88641] Writing DB stats cinder:SELECT=7,cinder:UPDATE=6,cinder:DELETE=2,cinder:INSERT=1 {{(pid=88641) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 16:14:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-a406e3cb-fb94-433b-a984-8bb5c47c3b1e req-f9e904a0-3464-47d1-8dd7-10106e332810 tempest-TestServerVolumeAttachmentScenario-756080469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:14:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-a406e3cb-fb94-433b-a984-8bb5c47c3b1e req-f9e904a0-3464-47d1-8dd7-10106e332810 tempest-TestServerVolumeAttachmentScenario-756080469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:14:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-a406e3cb-fb94-433b-a984-8bb5c47c3b1e req-f9e904a0-3464-47d1-8dd7-10106e332810 tempest-TestServerVolumeAttachmentScenario-756080469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:14:07 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [req-a406e3cb-fb94-433b-a984-8bb5c47c3b1e req-f9e904a0-3464-47d1-8dd7-10106e332810 tempest-TestServerVolumeAttachmentScenario-756080469 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc', 'name': 'volume-641f1872-69f8-460d-a935-4ec6b47240c6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5de96312-5aac-4b68-bb43-a1a98261ce74', 'enforce_multipath': True} {{(pid=88641) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 10 16:14:07 devstack cinder-volume[88641]: INFO cinder.volume.manager [req-a406e3cb-fb94-433b-a984-8bb5c47c3b1e req-f9e904a0-3464-47d1-8dd7-10106e332810 tempest-TestServerVolumeAttachmentScenario-756080469 None] attachment_update completed successfully. Aug 10 16:14:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-7b214bbc-b2a1-4f46-9605-450d332a604a req-d614bfb1-ef6c-4a2a-8189-883ad97e9f24 tempest-TestServerVolumeAttachmentScenario-756080469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:14:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-7b214bbc-b2a1-4f46-9605-450d332a604a req-d614bfb1-ef6c-4a2a-8189-883ad97e9f24 tempest-TestServerVolumeAttachmentScenario-756080469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:14:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [req-7b214bbc-b2a1-4f46-9605-450d332a604a req-d614bfb1-ef6c-4a2a-8189-883ad97e9f24 tempest-TestServerVolumeAttachmentScenario-756080469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:14:12 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [req-7b214bbc-b2a1-4f46-9605-450d332a604a req-d614bfb1-ef6c-4a2a-8189-883ad97e9f24 tempest-TestServerVolumeAttachmentScenario-756080469 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc', 'name': 'volume-9ed9195b-8ae5-41fa-ad7f-046ba9349674', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a4142010-cfd7-4b90-8c1b-94888aa17735', 'enforce_multipath': True} {{(pid=88641) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 10 16:14:12 devstack cinder-volume[88641]: INFO cinder.volume.manager [req-7b214bbc-b2a1-4f46-9605-450d332a604a req-d614bfb1-ef6c-4a2a-8189-883ad97e9f24 tempest-TestServerVolumeAttachmentScenario-756080469 None] attachment_update completed successfully. Aug 10 16:14:13 devstack cinder-volume[88641]: INFO cinder.volume.manager [req-15c2a334-03a0-41bc-adff-72a75d74f778 req-437ac8cd-234d-4cec-b1ff-d67d3adfb108 tempest-TestServerVolumeAttachmentScenario-756080469 None] Terminate volume connection completed successfully. Aug 10 16:14:13 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [req-15c2a334-03a0-41bc-adff-72a75d74f778 req-437ac8cd-234d-4cec-b1ff-d67d3adfb108 tempest-TestServerVolumeAttachmentScenario-756080469 None] Deleting attachment a4142010-cfd7-4b90-8c1b-94888aa17735. {{(pid=88641) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 10 16:14:15 devstack cinder-volume[88641]: INFO cinder.volume.manager [req-2668ba49-9ca0-4305-863e-aec9e2c4c385 req-341e08ed-3d41-4eeb-b4ab-b2e64b20c6e8 tempest-TestServerVolumeAttachmentScenario-756080469 None] Terminate volume connection completed successfully. Aug 10 16:14:15 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [req-2668ba49-9ca0-4305-863e-aec9e2c4c385 req-341e08ed-3d41-4eeb-b4ab-b2e64b20c6e8 tempest-TestServerVolumeAttachmentScenario-756080469 None] Deleting attachment 5de96312-5aac-4b68-bb43-a1a98261ce74. {{(pid=88641) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 10 16:14:19 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-3b44a1e9-467d-4f18-8419-c61ea44ef21d tempest-TestServerVolumeAttachmentScenario-756080469 None] Acquiring lock "cinder-9ed9195b-8ae5-41fa-ad7f-046ba9349674-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:14:19 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-3b44a1e9-467d-4f18-8419-c61ea44ef21d tempest-TestServerVolumeAttachmentScenario-756080469 None] Lock "cinder-9ed9195b-8ae5-41fa-ad7f-046ba9349674-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:14:19 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-3b44a1e9-467d-4f18-8419-c61ea44ef21d tempest-TestServerVolumeAttachmentScenario-756080469 None] Acquiring lock "cinder-quobyte-9ed9195b-8ae5-41fa-ad7f-046ba9349674" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:14:19 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-3b44a1e9-467d-4f18-8419-c61ea44ef21d tempest-TestServerVolumeAttachmentScenario-756080469 None] Lock "cinder-quobyte-9ed9195b-8ae5-41fa-ad7f-046ba9349674" acquired by "delete_volume" :: waited 0.013s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:14:19 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[817a24f4-dd0c-4090-b4e7-65cb88ef1627]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:14:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-3b44a1e9-467d-4f18-8419-c61ea44ef21d tempest-TestServerVolumeAttachmentScenario-756080469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9ed9195b-8ae5-41fa-ad7f-046ba9349674 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:14:19 devstack sudo[107805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9ed9195b-8ae5-41fa-ad7f-046ba9349674 Aug 10 16:14:19 devstack sudo[107805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:14:19 devstack sudo[107805]: pam_unix(sudo:session): session closed for user root Aug 10 16:14:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-3b44a1e9-467d-4f18-8419-c61ea44ef21d tempest-TestServerVolumeAttachmentScenario-756080469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9ed9195b-8ae5-41fa-ad7f-046ba9349674" returned: 0 in 0.348s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:14:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-3b44a1e9-467d-4f18-8419-c61ea44ef21d tempest-TestServerVolumeAttachmentScenario-756080469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9ed9195b-8ae5-41fa-ad7f-046ba9349674 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:14:19 devstack sudo[107810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9ed9195b-8ae5-41fa-ad7f-046ba9349674 Aug 10 16:14:19 devstack sudo[107810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:14:20 devstack sudo[107810]: pam_unix(sudo:session): session closed for user root Aug 10 16:14:20 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-3b44a1e9-467d-4f18-8419-c61ea44ef21d tempest-TestServerVolumeAttachmentScenario-756080469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9ed9195b-8ae5-41fa-ad7f-046ba9349674" returned: 0 in 0.236s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:14:20 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-3b44a1e9-467d-4f18-8419-c61ea44ef21d tempest-TestServerVolumeAttachmentScenario-756080469 None] Lock "cinder-quobyte-9ed9195b-8ae5-41fa-ad7f-046ba9349674" released by "delete_volume" :: held 0.621s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:14:20 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-3b44a1e9-467d-4f18-8419-c61ea44ef21d tempest-TestServerVolumeAttachmentScenario-756080469 None] Created reservations ['799b1aff-3e4c-4acb-b595-ddc808aed517', 'f6286f12-33f4-495b-9827-ebb15ed0b1f9', '0cbb1251-1b36-41e9-b37b-f004b4cfa8db', 'a6a9fe7e-2bfb-477e-adb3-d895b8e811be'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:14:20 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-3b44a1e9-467d-4f18-8419-c61ea44ef21d tempest-TestServerVolumeAttachmentScenario-756080469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:14:20 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-3b44a1e9-467d-4f18-8419-c61ea44ef21d tempest-TestServerVolumeAttachmentScenario-756080469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:14:20 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-3b44a1e9-467d-4f18-8419-c61ea44ef21d tempest-TestServerVolumeAttachmentScenario-756080469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:14:20 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-3b44a1e9-467d-4f18-8419-c61ea44ef21d tempest-TestServerVolumeAttachmentScenario-756080469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:14:20 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-3b44a1e9-467d-4f18-8419-c61ea44ef21d tempest-TestServerVolumeAttachmentScenario-756080469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:14:20 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-3b44a1e9-467d-4f18-8419-c61ea44ef21d tempest-TestServerVolumeAttachmentScenario-756080469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:14:20 devstack sudo[107813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:14:20 devstack sudo[107813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:14:20 devstack sudo[107813]: pam_unix(sudo:session): session closed for user root Aug 10 16:14:20 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-3b44a1e9-467d-4f18-8419-c61ea44ef21d tempest-TestServerVolumeAttachmentScenario-756080469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.238s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:14:20 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-3b44a1e9-467d-4f18-8419-c61ea44ef21d tempest-TestServerVolumeAttachmentScenario-756080469 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:14:20 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-3b44a1e9-467d-4f18-8419-c61ea44ef21d tempest-TestServerVolumeAttachmentScenario-756080469 None] Deleted volume successfully. Aug 10 16:14:20 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-3b44a1e9-467d-4f18-8419-c61ea44ef21d tempest-TestServerVolumeAttachmentScenario-756080469 None] Lock "cinder-9ed9195b-8ae5-41fa-ad7f-046ba9349674-delete_volume" released by "delete_volume" :: held 1.034s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:14:20 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-4a45f2fd-04f3-4e86-a65e-c05b9ecba4b9 tempest-TestServerVolumeAttachmentScenario-756080469 None] Acquiring lock "cinder-641f1872-69f8-460d-a935-4ec6b47240c6-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:14:20 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-4a45f2fd-04f3-4e86-a65e-c05b9ecba4b9 tempest-TestServerVolumeAttachmentScenario-756080469 None] Lock "cinder-641f1872-69f8-460d-a935-4ec6b47240c6-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:14:20 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-4a45f2fd-04f3-4e86-a65e-c05b9ecba4b9 tempest-TestServerVolumeAttachmentScenario-756080469 None] Acquiring lock "cinder-quobyte-641f1872-69f8-460d-a935-4ec6b47240c6" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:14:20 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-4a45f2fd-04f3-4e86-a65e-c05b9ecba4b9 tempest-TestServerVolumeAttachmentScenario-756080469 None] Lock "cinder-quobyte-641f1872-69f8-460d-a935-4ec6b47240c6" acquired by "delete_volume" :: waited 0.013s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:14:20 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd9e82f-fe20-46e2-a0b5-8c6eaec4d448]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:14:20 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4a45f2fd-04f3-4e86-a65e-c05b9ecba4b9 tempest-TestServerVolumeAttachmentScenario-756080469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-641f1872-69f8-460d-a935-4ec6b47240c6 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:14:20 devstack sudo[107816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-641f1872-69f8-460d-a935-4ec6b47240c6 Aug 10 16:14:20 devstack sudo[107816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:14:20 devstack sudo[107816]: pam_unix(sudo:session): session closed for user root Aug 10 16:14:20 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4a45f2fd-04f3-4e86-a65e-c05b9ecba4b9 tempest-TestServerVolumeAttachmentScenario-756080469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-641f1872-69f8-460d-a935-4ec6b47240c6" returned: 0 in 0.341s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:14:20 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4a45f2fd-04f3-4e86-a65e-c05b9ecba4b9 tempest-TestServerVolumeAttachmentScenario-756080469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-641f1872-69f8-460d-a935-4ec6b47240c6 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:14:21 devstack sudo[107821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-641f1872-69f8-460d-a935-4ec6b47240c6 Aug 10 16:14:21 devstack sudo[107821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:14:21 devstack sudo[107821]: pam_unix(sudo:session): session closed for user root Aug 10 16:14:21 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4a45f2fd-04f3-4e86-a65e-c05b9ecba4b9 tempest-TestServerVolumeAttachmentScenario-756080469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-641f1872-69f8-460d-a935-4ec6b47240c6" returned: 0 in 0.247s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:14:21 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-4a45f2fd-04f3-4e86-a65e-c05b9ecba4b9 tempest-TestServerVolumeAttachmentScenario-756080469 None] Lock "cinder-quobyte-641f1872-69f8-460d-a935-4ec6b47240c6" released by "delete_volume" :: held 0.625s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:14:21 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-4a45f2fd-04f3-4e86-a65e-c05b9ecba4b9 tempest-TestServerVolumeAttachmentScenario-756080469 None] Created reservations ['aef54663-ed7b-449c-a6b5-e01bdeb229c7', 'ad1c3f96-4d03-49ff-b624-6eaaeb17df4d', '797930d0-d5c6-4e84-af6d-8cd47221b21d', '9b91242a-ae4d-4bf6-887b-069879e4e709'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:14:21 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-4a45f2fd-04f3-4e86-a65e-c05b9ecba4b9 tempest-TestServerVolumeAttachmentScenario-756080469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:14:21 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-4a45f2fd-04f3-4e86-a65e-c05b9ecba4b9 tempest-TestServerVolumeAttachmentScenario-756080469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:14:21 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-4a45f2fd-04f3-4e86-a65e-c05b9ecba4b9 tempest-TestServerVolumeAttachmentScenario-756080469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:14:21 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-4a45f2fd-04f3-4e86-a65e-c05b9ecba4b9 tempest-TestServerVolumeAttachmentScenario-756080469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:14:21 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-4a45f2fd-04f3-4e86-a65e-c05b9ecba4b9 tempest-TestServerVolumeAttachmentScenario-756080469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:14:21 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4a45f2fd-04f3-4e86-a65e-c05b9ecba4b9 tempest-TestServerVolumeAttachmentScenario-756080469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:14:21 devstack sudo[107825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:14:21 devstack sudo[107825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:14:21 devstack sudo[107825]: pam_unix(sudo:session): session closed for user root Aug 10 16:14:21 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4a45f2fd-04f3-4e86-a65e-c05b9ecba4b9 tempest-TestServerVolumeAttachmentScenario-756080469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.237s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:14:21 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-4a45f2fd-04f3-4e86-a65e-c05b9ecba4b9 tempest-TestServerVolumeAttachmentScenario-756080469 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:14:21 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-4a45f2fd-04f3-4e86-a65e-c05b9ecba4b9 tempest-TestServerVolumeAttachmentScenario-756080469 None] Deleted volume successfully. Aug 10 16:14:21 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-4a45f2fd-04f3-4e86-a65e-c05b9ecba4b9 tempest-TestServerVolumeAttachmentScenario-756080469 None] Lock "cinder-641f1872-69f8-460d-a935-4ec6b47240c6-delete_volume" released by "delete_volume" :: held 1.065s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:14:31 devstack cinder-volume[88641]: DEBUG dbcounter [-] [88641] Writing DB stats cinder:SELECT=24,cinder:UPDATE=20,cinder:INSERT=4,cinder:DELETE=1 {{(pid=88641) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 16:14:31 devstack cinder-volume[88641]: DEBUG dbcounter [-] [88641] Writing DB stats cinder:SELECT=26,cinder:UPDATE=18,cinder:INSERT=4,cinder:DELETE=1 {{(pid=88641) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 16:14:36 devstack cinder-volume[88641]: DEBUG oslo_service.periodic_task [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88641) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 16:14:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:14:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:14:36 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:14:36 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:14:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:14:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:14:36 devstack sudo[107859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:14:36 devstack sudo[107859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:14:36 devstack sudo[107859]: pam_unix(sudo:session): session closed for user root Aug 10 16:14:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.272s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:14:36 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:14:36 devstack cinder-volume[88641]: DEBUG oslo_service.periodic_task [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Running periodic task VolumeManager._thread_info {{(pid=88641) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 16:14:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] thread count: 28 {{(pid=88641) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 10 16:14:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] thread info: [<_MainThread(MainThread, started 127361545748608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88641) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 10 16:14:42 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd5f94b2-c0c3-4038-9df3-f39f59e25200 tempest-CreateVolumesFromImageTest-582537208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:14:42 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-fd5f94b2-c0c3-4038-9df3-f39f59e25200 tempest-CreateVolumesFromImageTest-582537208 None] Flow 'volume_create_manager' (6741e4b7-3db6-42be-be7d-bf1659e4d14e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:14:42 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-fd5f94b2-c0c3-4038-9df3-f39f59e25200 tempest-CreateVolumesFromImageTest-582537208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4436743-0438-4021-bc3c-256d3e70f2d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:14:42 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-fd5f94b2-c0c3-4038-9df3-f39f59e25200 tempest-CreateVolumesFromImageTest-582537208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4436743-0438-4021-bc3c-256d3e70f2d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:14:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1406819000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=153bb157-ed53-4ddf-bbb8-f116ad1d0e63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='458ef4e9aa4542e183f344fecf23cd63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:14:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:14:42Z,use_quota=True,user_id='dbead3da8a1340b6bbc45a7f1c3aad50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:14:42 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-fd5f94b2-c0c3-4038-9df3-f39f59e25200 tempest-CreateVolumesFromImageTest-582537208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04b80429-5d7d-4a12-ac56-98ea7a0e8929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:14:42 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-fd5f94b2-c0c3-4038-9df3-f39f59e25200 tempest-CreateVolumesFromImageTest-582537208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04b80429-5d7d-4a12-ac56-98ea7a0e8929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:14:42 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-fd5f94b2-c0c3-4038-9df3-f39f59e25200 tempest-CreateVolumesFromImageTest-582537208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2251887-3c2f-4eba-9704-ce1a1eb75ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:14:42 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-fd5f94b2-c0c3-4038-9df3-f39f59e25200 tempest-CreateVolumesFromImageTest-582537208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2251887-3c2f-4eba-9704-ce1a1eb75ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '153bb157-ed53-4ddf-bbb8-f116ad1d0e63', 'volume_name': 'volume-153bb157-ed53-4ddf-bbb8-f116ad1d0e63', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:14:42 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-fd5f94b2-c0c3-4038-9df3-f39f59e25200 tempest-CreateVolumesFromImageTest-582537208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7249c3f-ab62-46d4-b260-101587de6e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:14:42 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-fd5f94b2-c0c3-4038-9df3-f39f59e25200 tempest-CreateVolumesFromImageTest-582537208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7249c3f-ab62-46d4-b260-101587de6e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:14:42 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-fd5f94b2-c0c3-4038-9df3-f39f59e25200 tempest-CreateVolumesFromImageTest-582537208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (030dc98e-2c4b-447e-a1e6-6ab090d737c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:14:42 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-fd5f94b2-c0c3-4038-9df3-f39f59e25200 tempest-CreateVolumesFromImageTest-582537208 None] Volume 153bb157-ed53-4ddf-bbb8-f116ad1d0e63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-153bb157-ed53-4ddf-bbb8-f116ad1d0e63', 'volume_size': 1} Aug 10 16:14:42 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-fd5f94b2-c0c3-4038-9df3-f39f59e25200 tempest-CreateVolumesFromImageTest-582537208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:14:42 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-fd5f94b2-c0c3-4038-9df3-f39f59e25200 tempest-CreateVolumesFromImageTest-582537208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:14:42 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-fd5f94b2-c0c3-4038-9df3-f39f59e25200 tempest-CreateVolumesFromImageTest-582537208 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:14:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1406819000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=153bb157-ed53-4ddf-bbb8-f116ad1d0e63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='458ef4e9aa4542e183f344fecf23cd63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:14:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:14:42Z,use_quota=True,user_id='dbead3da8a1340b6bbc45a7f1c3aad50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:14:42 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-fd5f94b2-c0c3-4038-9df3-f39f59e25200 tempest-CreateVolumesFromImageTest-582537208 None] Creating volume 153bb157-ed53-4ddf-bbb8-f116ad1d0e63 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:14:42 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-fd5f94b2-c0c3-4038-9df3-f39f59e25200 tempest-CreateVolumesFromImageTest-582537208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:14:42 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-fd5f94b2-c0c3-4038-9df3-f39f59e25200 tempest-CreateVolumesFromImageTest-582537208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:14:42 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-fd5f94b2-c0c3-4038-9df3-f39f59e25200 tempest-CreateVolumesFromImageTest-582537208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:14:42 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-fd5f94b2-c0c3-4038-9df3-f39f59e25200 tempest-CreateVolumesFromImageTest-582537208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:14:42 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-fd5f94b2-c0c3-4038-9df3-f39f59e25200 tempest-CreateVolumesFromImageTest-582537208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:14:42 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-fd5f94b2-c0c3-4038-9df3-f39f59e25200 tempest-CreateVolumesFromImageTest-582537208 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:14:42 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-fd5f94b2-c0c3-4038-9df3-f39f59e25200 tempest-CreateVolumesFromImageTest-582537208 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:14:42 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fd5f94b2-c0c3-4038-9df3-f39f59e25200 tempest-CreateVolumesFromImageTest-582537208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-153bb157-ed53-4ddf-bbb8-f116ad1d0e63 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:14:42 devstack sudo[107877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-153bb157-ed53-4ddf-bbb8-f116ad1d0e63 1073741824 Aug 10 16:14:42 devstack sudo[107877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:14:42 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-528b5d1d-92a0-4cab-a0fd-58e67d313ff6 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:14:42 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-528b5d1d-92a0-4cab-a0fd-58e67d313ff6 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Flow 'volume_create_manager' (2668ee84-24e0-4492-a255-1cf7503497d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:14:42 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-528b5d1d-92a0-4cab-a0fd-58e67d313ff6 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eba743c-beb8-48da-b89f-7dec82582b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:14:42 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-528b5d1d-92a0-4cab-a0fd-58e67d313ff6 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eba743c-beb8-48da-b89f-7dec82582b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:14:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-227235880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=054e3c13-16a6-4833-85d0-861028d67e1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9968a27b1d64b9ca715ae98e87583dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:14:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:14:43Z,use_quota=True,user_id='b5cabc3b7083421eb2f45121b9ac3836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:14:42 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-528b5d1d-92a0-4cab-a0fd-58e67d313ff6 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf892c59-672e-4b06-addf-69b1af8b6088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:14:42 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-528b5d1d-92a0-4cab-a0fd-58e67d313ff6 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf892c59-672e-4b06-addf-69b1af8b6088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:14:42 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-528b5d1d-92a0-4cab-a0fd-58e67d313ff6 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fb47158-ce78-4b32-b062-0546083ab040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:14:42 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-528b5d1d-92a0-4cab-a0fd-58e67d313ff6 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fb47158-ce78-4b32-b062-0546083ab040) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '054e3c13-16a6-4833-85d0-861028d67e1c', 'volume_name': 'volume-054e3c13-16a6-4833-85d0-861028d67e1c', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:14:42 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-528b5d1d-92a0-4cab-a0fd-58e67d313ff6 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16ac9724-ae04-4426-8108-9f01ee0fe307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:14:42 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-528b5d1d-92a0-4cab-a0fd-58e67d313ff6 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16ac9724-ae04-4426-8108-9f01ee0fe307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:14:42 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-528b5d1d-92a0-4cab-a0fd-58e67d313ff6 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7380e9a1-5681-4bcf-a70d-cb7de78e1342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:14:42 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-528b5d1d-92a0-4cab-a0fd-58e67d313ff6 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Volume 054e3c13-16a6-4833-85d0-861028d67e1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-054e3c13-16a6-4833-85d0-861028d67e1c', 'volume_size': 1} Aug 10 16:14:42 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-528b5d1d-92a0-4cab-a0fd-58e67d313ff6 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:14:43 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-44bbe8b3-3c57-4b35-a4b4-2df4785d1559 tempest-CreateVolumesFromImageTest-582537208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:14:43 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-44bbe8b3-3c57-4b35-a4b4-2df4785d1559 tempest-CreateVolumesFromImageTest-582537208 None] Flow 'volume_create_manager' (695203a8-bd4e-4e5f-93c1-c17cca6961df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:14:43 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-44bbe8b3-3c57-4b35-a4b4-2df4785d1559 tempest-CreateVolumesFromImageTest-582537208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91589c0d-dd2c-4072-b933-f14eb859e4a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:14:43 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-44bbe8b3-3c57-4b35-a4b4-2df4785d1559 tempest-CreateVolumesFromImageTest-582537208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91589c0d-dd2c-4072-b933-f14eb859e4a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:14:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1246384617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be1a5ac0-ec43-4b46-a898-66851e202572,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='458ef4e9aa4542e183f344fecf23cd63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:14:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:14:43Z,use_quota=True,user_id='dbead3da8a1340b6bbc45a7f1c3aad50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:14:43 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-44bbe8b3-3c57-4b35-a4b4-2df4785d1559 tempest-CreateVolumesFromImageTest-582537208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2023ac74-1547-4e5a-a451-866ae3827c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:14:43 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-44bbe8b3-3c57-4b35-a4b4-2df4785d1559 tempest-CreateVolumesFromImageTest-582537208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2023ac74-1547-4e5a-a451-866ae3827c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:14:43 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-44bbe8b3-3c57-4b35-a4b4-2df4785d1559 tempest-CreateVolumesFromImageTest-582537208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48b1ad2b-344d-4af9-a5c4-48373f4dc070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:14:43 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-44bbe8b3-3c57-4b35-a4b4-2df4785d1559 tempest-CreateVolumesFromImageTest-582537208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48b1ad2b-344d-4af9-a5c4-48373f4dc070) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be1a5ac0-ec43-4b46-a898-66851e202572', 'volume_name': 'volume-be1a5ac0-ec43-4b46-a898-66851e202572', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:14:43 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-44bbe8b3-3c57-4b35-a4b4-2df4785d1559 tempest-CreateVolumesFromImageTest-582537208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e9f2959-0666-44df-b731-9ae59a954b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:14:43 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-44bbe8b3-3c57-4b35-a4b4-2df4785d1559 tempest-CreateVolumesFromImageTest-582537208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e9f2959-0666-44df-b731-9ae59a954b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:14:43 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-44bbe8b3-3c57-4b35-a4b4-2df4785d1559 tempest-CreateVolumesFromImageTest-582537208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a32396a4-c4d8-4ddf-aa8b-bdd79543d3a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:14:43 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-44bbe8b3-3c57-4b35-a4b4-2df4785d1559 tempest-CreateVolumesFromImageTest-582537208 None] Volume be1a5ac0-ec43-4b46-a898-66851e202572: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be1a5ac0-ec43-4b46-a898-66851e202572', 'volume_size': 1} Aug 10 16:14:43 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-44bbe8b3-3c57-4b35-a4b4-2df4785d1559 tempest-CreateVolumesFromImageTest-582537208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:14:43 devstack sudo[107877]: pam_unix(sudo:session): session closed for user root Aug 10 16:14:43 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fd5f94b2-c0c3-4038-9df3-f39f59e25200 tempest-CreateVolumesFromImageTest-582537208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-153bb157-ed53-4ddf-bbb8-f116ad1d0e63 1073741824" returned: 0 in 0.791s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:14:43 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fd5f94b2-c0c3-4038-9df3-f39f59e25200 tempest-CreateVolumesFromImageTest-582537208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-153bb157-ed53-4ddf-bbb8-f116ad1d0e63 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:14:43 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-adec3fb0-e87d-4e83-90c1-0a5c70f7d746 tempest-CreateVolumesFromImageTest-582537208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:14:43 devstack sudo[107882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-153bb157-ed53-4ddf-bbb8-f116ad1d0e63 Aug 10 16:14:43 devstack sudo[107882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:14:43 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-adec3fb0-e87d-4e83-90c1-0a5c70f7d746 tempest-CreateVolumesFromImageTest-582537208 None] Flow 'volume_create_manager' (86eaf54a-d583-40bb-99c0-241333ee0dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:14:43 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-adec3fb0-e87d-4e83-90c1-0a5c70f7d746 tempest-CreateVolumesFromImageTest-582537208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0a85801-7d92-40dc-9ed8-6d8a46253f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:14:43 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-adec3fb0-e87d-4e83-90c1-0a5c70f7d746 tempest-CreateVolumesFromImageTest-582537208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0a85801-7d92-40dc-9ed8-6d8a46253f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:14:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-768412787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9727c05f-7fd7-44b9-b08f-3613aa3f9000,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='458ef4e9aa4542e183f344fecf23cd63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:14:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:14:44Z,use_quota=True,user_id='dbead3da8a1340b6bbc45a7f1c3aad50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:14:43 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-adec3fb0-e87d-4e83-90c1-0a5c70f7d746 tempest-CreateVolumesFromImageTest-582537208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7448955b-5a5f-4cc3-b9fb-85b2d941496e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:14:43 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-adec3fb0-e87d-4e83-90c1-0a5c70f7d746 tempest-CreateVolumesFromImageTest-582537208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7448955b-5a5f-4cc3-b9fb-85b2d941496e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:14:43 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-adec3fb0-e87d-4e83-90c1-0a5c70f7d746 tempest-CreateVolumesFromImageTest-582537208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d89dfbe-77f8-4204-8f01-8e3196fbf0f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:14:43 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-adec3fb0-e87d-4e83-90c1-0a5c70f7d746 tempest-CreateVolumesFromImageTest-582537208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d89dfbe-77f8-4204-8f01-8e3196fbf0f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9727c05f-7fd7-44b9-b08f-3613aa3f9000', 'volume_name': 'volume-9727c05f-7fd7-44b9-b08f-3613aa3f9000', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:14:43 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-adec3fb0-e87d-4e83-90c1-0a5c70f7d746 tempest-CreateVolumesFromImageTest-582537208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f373a20-5aed-4674-9be6-53f6bc0d1e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:14:43 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-adec3fb0-e87d-4e83-90c1-0a5c70f7d746 tempest-CreateVolumesFromImageTest-582537208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f373a20-5aed-4674-9be6-53f6bc0d1e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:14:43 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-adec3fb0-e87d-4e83-90c1-0a5c70f7d746 tempest-CreateVolumesFromImageTest-582537208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10998633-3059-4beb-8f3f-5619384fa159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:14:43 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-adec3fb0-e87d-4e83-90c1-0a5c70f7d746 tempest-CreateVolumesFromImageTest-582537208 None] Volume 9727c05f-7fd7-44b9-b08f-3613aa3f9000: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9727c05f-7fd7-44b9-b08f-3613aa3f9000', 'volume_size': 1} Aug 10 16:14:43 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-adec3fb0-e87d-4e83-90c1-0a5c70f7d746 tempest-CreateVolumesFromImageTest-582537208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:14:44 devstack sudo[107882]: pam_unix(sudo:session): session closed for user root Aug 10 16:14:44 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fd5f94b2-c0c3-4038-9df3-f39f59e25200 tempest-CreateVolumesFromImageTest-582537208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-153bb157-ed53-4ddf-bbb8-f116ad1d0e63" returned: 0 in 0.434s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:14:44 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-fd5f94b2-c0c3-4038-9df3-f39f59e25200 tempest-CreateVolumesFromImageTest-582537208 None] <== create_volume: return (1358ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:14:44 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-fd5f94b2-c0c3-4038-9df3-f39f59e25200 tempest-CreateVolumesFromImageTest-582537208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.362s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:14:44 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-528b5d1d-92a0-4cab-a0fd-58e67d313ff6 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.112s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:14:44 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-528b5d1d-92a0-4cab-a0fd-58e67d313ff6 tempest-CreateVolumesFromSnapshotTest-1045154512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:14:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-227235880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=054e3c13-16a6-4833-85d0-861028d67e1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9968a27b1d64b9ca715ae98e87583dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:14:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:14:43Z,use_quota=True,user_id='b5cabc3b7083421eb2f45121b9ac3836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:14:44 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-528b5d1d-92a0-4cab-a0fd-58e67d313ff6 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Creating volume 054e3c13-16a6-4833-85d0-861028d67e1c {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:14:44 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-528b5d1d-92a0-4cab-a0fd-58e67d313ff6 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:14:44 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-528b5d1d-92a0-4cab-a0fd-58e67d313ff6 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:14:44 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-528b5d1d-92a0-4cab-a0fd-58e67d313ff6 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:14:44 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-528b5d1d-92a0-4cab-a0fd-58e67d313ff6 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:14:44 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-528b5d1d-92a0-4cab-a0fd-58e67d313ff6 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:14:44 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-528b5d1d-92a0-4cab-a0fd-58e67d313ff6 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:14:44 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-528b5d1d-92a0-4cab-a0fd-58e67d313ff6 tempest-CreateVolumesFromSnapshotTest-1045154512 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:14:44 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-528b5d1d-92a0-4cab-a0fd-58e67d313ff6 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-054e3c13-16a6-4833-85d0-861028d67e1c 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:14:44 devstack sudo[107885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-054e3c13-16a6-4833-85d0-861028d67e1c 1073741824 Aug 10 16:14:44 devstack sudo[107885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:14:44 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-fd5f94b2-c0c3-4038-9df3-f39f59e25200 tempest-CreateVolumesFromImageTest-582537208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (030dc98e-2c4b-447e-a1e6-6ab090d737c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-153bb157-ed53-4ddf-bbb8-f116ad1d0e63', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:14:44 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-fd5f94b2-c0c3-4038-9df3-f39f59e25200 tempest-CreateVolumesFromImageTest-582537208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c10bd1b6-10a3-4cf5-b935-1ff2a0802770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:14:44 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-fd5f94b2-c0c3-4038-9df3-f39f59e25200 tempest-CreateVolumesFromImageTest-582537208 None] Volume volume-153bb157-ed53-4ddf-bbb8-f116ad1d0e63 (153bb157-ed53-4ddf-bbb8-f116ad1d0e63): created successfully Aug 10 16:14:44 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-fd5f94b2-c0c3-4038-9df3-f39f59e25200 tempest-CreateVolumesFromImageTest-582537208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c10bd1b6-10a3-4cf5-b935-1ff2a0802770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:14:44 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-fd5f94b2-c0c3-4038-9df3-f39f59e25200 tempest-CreateVolumesFromImageTest-582537208 None] Flow 'volume_create_manager' (6741e4b7-3db6-42be-be7d-bf1659e4d14e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:14:44 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-32912e6f-1c73-49e9-bfdf-750ff79cb6d4 tempest-CreateVolumesFromImageTest-582537208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:14:44 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-32912e6f-1c73-49e9-bfdf-750ff79cb6d4 tempest-CreateVolumesFromImageTest-582537208 None] Flow 'volume_create_manager' (e6fce839-04c2-4bba-bd8b-83568f40290c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:14:44 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-32912e6f-1c73-49e9-bfdf-750ff79cb6d4 tempest-CreateVolumesFromImageTest-582537208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df52b8fa-44dc-40c4-bf3d-2736252c132d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:14:44 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-fd5f94b2-c0c3-4038-9df3-f39f59e25200 tempest-CreateVolumesFromImageTest-582537208 None] Created volume successfully. Aug 10 16:14:44 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-32912e6f-1c73-49e9-bfdf-750ff79cb6d4 tempest-CreateVolumesFromImageTest-582537208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df52b8fa-44dc-40c4-bf3d-2736252c132d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:14:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1119373822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfeb1a92-87db-4925-9ce4-7ab09265d8fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='458ef4e9aa4542e183f344fecf23cd63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:14:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:14:44Z,use_quota=True,user_id='dbead3da8a1340b6bbc45a7f1c3aad50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:14:44 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-32912e6f-1c73-49e9-bfdf-750ff79cb6d4 tempest-CreateVolumesFromImageTest-582537208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdeaf028-2cf1-4a76-8b65-e43c507831df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:14:44 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-32912e6f-1c73-49e9-bfdf-750ff79cb6d4 tempest-CreateVolumesFromImageTest-582537208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdeaf028-2cf1-4a76-8b65-e43c507831df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:14:44 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-32912e6f-1c73-49e9-bfdf-750ff79cb6d4 tempest-CreateVolumesFromImageTest-582537208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6938db04-f367-41dc-9687-cc852b8f83d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:14:44 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-32912e6f-1c73-49e9-bfdf-750ff79cb6d4 tempest-CreateVolumesFromImageTest-582537208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6938db04-f367-41dc-9687-cc852b8f83d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfeb1a92-87db-4925-9ce4-7ab09265d8fa', 'volume_name': 'volume-dfeb1a92-87db-4925-9ce4-7ab09265d8fa', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:14:44 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-32912e6f-1c73-49e9-bfdf-750ff79cb6d4 tempest-CreateVolumesFromImageTest-582537208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cbb55b2-15c9-4924-96bd-57c44dbd93ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:14:44 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-32912e6f-1c73-49e9-bfdf-750ff79cb6d4 tempest-CreateVolumesFromImageTest-582537208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cbb55b2-15c9-4924-96bd-57c44dbd93ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:14:44 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-32912e6f-1c73-49e9-bfdf-750ff79cb6d4 tempest-CreateVolumesFromImageTest-582537208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c9c73ec-921e-4562-9e2e-e72af09b0630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:14:44 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-32912e6f-1c73-49e9-bfdf-750ff79cb6d4 tempest-CreateVolumesFromImageTest-582537208 None] Volume dfeb1a92-87db-4925-9ce4-7ab09265d8fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfeb1a92-87db-4925-9ce4-7ab09265d8fa', 'volume_size': 1} Aug 10 16:14:44 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-32912e6f-1c73-49e9-bfdf-750ff79cb6d4 tempest-CreateVolumesFromImageTest-582537208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:14:44 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ca97f8a-52e5-4665-a8d2-d59d825d0b37 tempest-CreateVolumesFromImageTest-582537208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:14:44 devstack sudo[107885]: pam_unix(sudo:session): session closed for user root Aug 10 16:14:44 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-5ca97f8a-52e5-4665-a8d2-d59d825d0b37 tempest-CreateVolumesFromImageTest-582537208 None] Flow 'volume_create_manager' (197860df-c023-4e5a-9da4-3a510a4d7df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:14:44 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-5ca97f8a-52e5-4665-a8d2-d59d825d0b37 tempest-CreateVolumesFromImageTest-582537208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84ac677e-cc00-48f6-bc20-e61fc8a9f15a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:14:44 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-528b5d1d-92a0-4cab-a0fd-58e67d313ff6 tempest-CreateVolumesFromSnapshotTest-1045154512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-054e3c13-16a6-4833-85d0-861028d67e1c 1073741824" returned: 0 in 0.694s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:14:44 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-5ca97f8a-52e5-4665-a8d2-d59d825d0b37 tempest-CreateVolumesFromImageTest-582537208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84ac677e-cc00-48f6-bc20-e61fc8a9f15a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:14:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-150972756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eac7401-5c00-4788-8e30-c36f381c6bdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='458ef4e9aa4542e183f344fecf23cd63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:14:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:14:45Z,use_quota=True,user_id='dbead3da8a1340b6bbc45a7f1c3aad50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:14:44 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-5ca97f8a-52e5-4665-a8d2-d59d825d0b37 tempest-CreateVolumesFromImageTest-582537208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bddeb8a-d35c-431d-9891-cffe886be977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:14:44 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-5ca97f8a-52e5-4665-a8d2-d59d825d0b37 tempest-CreateVolumesFromImageTest-582537208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bddeb8a-d35c-431d-9891-cffe886be977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:14:44 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-5ca97f8a-52e5-4665-a8d2-d59d825d0b37 tempest-CreateVolumesFromImageTest-582537208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2bcbda4-03b2-4c29-926d-4afeeb5e5dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:14:44 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-5ca97f8a-52e5-4665-a8d2-d59d825d0b37 tempest-CreateVolumesFromImageTest-582537208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2bcbda4-03b2-4c29-926d-4afeeb5e5dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2eac7401-5c00-4788-8e30-c36f381c6bdd', 'volume_name': 'volume-2eac7401-5c00-4788-8e30-c36f381c6bdd', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:14:44 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-5ca97f8a-52e5-4665-a8d2-d59d825d0b37 tempest-CreateVolumesFromImageTest-582537208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4e2defb-fd46-44f2-80b5-b405e0a9554f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:14:44 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-5ca97f8a-52e5-4665-a8d2-d59d825d0b37 tempest-CreateVolumesFromImageTest-582537208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4e2defb-fd46-44f2-80b5-b405e0a9554f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:14:44 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-5ca97f8a-52e5-4665-a8d2-d59d825d0b37 tempest-CreateVolumesFromImageTest-582537208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22876a09-c2c2-411c-8be9-b2d451691b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:14:44 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-5ca97f8a-52e5-4665-a8d2-d59d825d0b37 tempest-CreateVolumesFromImageTest-582537208 None] Volume 2eac7401-5c00-4788-8e30-c36f381c6bdd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2eac7401-5c00-4788-8e30-c36f381c6bdd', 'volume_size': 1} Aug 10 16:14:44 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-5ca97f8a-52e5-4665-a8d2-d59d825d0b37 tempest-CreateVolumesFromImageTest-582537208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:14:44 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-528b5d1d-92a0-4cab-a0fd-58e67d313ff6 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-054e3c13-16a6-4833-85d0-861028d67e1c {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:14:44 devstack sudo[107892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-054e3c13-16a6-4833-85d0-861028d67e1c Aug 10 16:14:44 devstack sudo[107892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:14:45 devstack sudo[107892]: pam_unix(sudo:session): session closed for user root Aug 10 16:14:45 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-528b5d1d-92a0-4cab-a0fd-58e67d313ff6 tempest-CreateVolumesFromSnapshotTest-1045154512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-054e3c13-16a6-4833-85d0-861028d67e1c" returned: 0 in 0.300s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:14:45 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-528b5d1d-92a0-4cab-a0fd-58e67d313ff6 tempest-CreateVolumesFromSnapshotTest-1045154512 None] <== create_volume: return (1119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:14:45 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-528b5d1d-92a0-4cab-a0fd-58e67d313ff6 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:14:45 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-44bbe8b3-3c57-4b35-a4b4-2df4785d1559 tempest-CreateVolumesFromImageTest-582537208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.008s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:14:45 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-44bbe8b3-3c57-4b35-a4b4-2df4785d1559 tempest-CreateVolumesFromImageTest-582537208 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:14:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1246384617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be1a5ac0-ec43-4b46-a898-66851e202572,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='458ef4e9aa4542e183f344fecf23cd63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:14:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:14:43Z,use_quota=True,user_id='dbead3da8a1340b6bbc45a7f1c3aad50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:14:45 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-44bbe8b3-3c57-4b35-a4b4-2df4785d1559 tempest-CreateVolumesFromImageTest-582537208 None] Creating volume be1a5ac0-ec43-4b46-a898-66851e202572 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:14:45 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-44bbe8b3-3c57-4b35-a4b4-2df4785d1559 tempest-CreateVolumesFromImageTest-582537208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:14:45 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-44bbe8b3-3c57-4b35-a4b4-2df4785d1559 tempest-CreateVolumesFromImageTest-582537208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:14:45 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-44bbe8b3-3c57-4b35-a4b4-2df4785d1559 tempest-CreateVolumesFromImageTest-582537208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:14:45 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-44bbe8b3-3c57-4b35-a4b4-2df4785d1559 tempest-CreateVolumesFromImageTest-582537208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:14:45 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-44bbe8b3-3c57-4b35-a4b4-2df4785d1559 tempest-CreateVolumesFromImageTest-582537208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:14:45 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-44bbe8b3-3c57-4b35-a4b4-2df4785d1559 tempest-CreateVolumesFromImageTest-582537208 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:14:45 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-44bbe8b3-3c57-4b35-a4b4-2df4785d1559 tempest-CreateVolumesFromImageTest-582537208 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:14:45 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-44bbe8b3-3c57-4b35-a4b4-2df4785d1559 tempest-CreateVolumesFromImageTest-582537208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-be1a5ac0-ec43-4b46-a898-66851e202572 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:14:45 devstack sudo[107895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-be1a5ac0-ec43-4b46-a898-66851e202572 1073741824 Aug 10 16:14:45 devstack sudo[107895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:14:45 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-528b5d1d-92a0-4cab-a0fd-58e67d313ff6 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7380e9a1-5681-4bcf-a70d-cb7de78e1342) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-054e3c13-16a6-4833-85d0-861028d67e1c', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:14:45 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-528b5d1d-92a0-4cab-a0fd-58e67d313ff6 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed11337a-e372-4b7b-9cc4-610c90e98f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:14:45 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-528b5d1d-92a0-4cab-a0fd-58e67d313ff6 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Volume volume-054e3c13-16a6-4833-85d0-861028d67e1c (054e3c13-16a6-4833-85d0-861028d67e1c): created successfully Aug 10 16:14:45 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-528b5d1d-92a0-4cab-a0fd-58e67d313ff6 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed11337a-e372-4b7b-9cc4-610c90e98f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:14:45 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-528b5d1d-92a0-4cab-a0fd-58e67d313ff6 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Flow 'volume_create_manager' (2668ee84-24e0-4492-a255-1cf7503497d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:14:45 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-528b5d1d-92a0-4cab-a0fd-58e67d313ff6 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Created volume successfully. Aug 10 16:14:45 devstack sudo[107895]: pam_unix(sudo:session): session closed for user root Aug 10 16:14:45 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-44bbe8b3-3c57-4b35-a4b4-2df4785d1559 tempest-CreateVolumesFromImageTest-582537208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-be1a5ac0-ec43-4b46-a898-66851e202572 1073741824" returned: 0 in 0.485s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:14:45 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-44bbe8b3-3c57-4b35-a4b4-2df4785d1559 tempest-CreateVolumesFromImageTest-582537208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-be1a5ac0-ec43-4b46-a898-66851e202572 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:14:45 devstack sudo[107901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-be1a5ac0-ec43-4b46-a898-66851e202572 Aug 10 16:14:45 devstack sudo[107901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:14:46 devstack sudo[107901]: pam_unix(sudo:session): session closed for user root Aug 10 16:14:46 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-44bbe8b3-3c57-4b35-a4b4-2df4785d1559 tempest-CreateVolumesFromImageTest-582537208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-be1a5ac0-ec43-4b46-a898-66851e202572" returned: 0 in 0.348s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:14:46 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-44bbe8b3-3c57-4b35-a4b4-2df4785d1559 tempest-CreateVolumesFromImageTest-582537208 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:14:46 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-44bbe8b3-3c57-4b35-a4b4-2df4785d1559 tempest-CreateVolumesFromImageTest-582537208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:14:46 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-adec3fb0-e87d-4e83-90c1-0a5c70f7d746 tempest-CreateVolumesFromImageTest-582537208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.328s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:14:46 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-adec3fb0-e87d-4e83-90c1-0a5c70f7d746 tempest-CreateVolumesFromImageTest-582537208 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:14:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-768412787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9727c05f-7fd7-44b9-b08f-3613aa3f9000,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='458ef4e9aa4542e183f344fecf23cd63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:14:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:14:44Z,use_quota=True,user_id='dbead3da8a1340b6bbc45a7f1c3aad50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:14:46 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-adec3fb0-e87d-4e83-90c1-0a5c70f7d746 tempest-CreateVolumesFromImageTest-582537208 None] Creating volume 9727c05f-7fd7-44b9-b08f-3613aa3f9000 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:14:46 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-adec3fb0-e87d-4e83-90c1-0a5c70f7d746 tempest-CreateVolumesFromImageTest-582537208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:14:46 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-adec3fb0-e87d-4e83-90c1-0a5c70f7d746 tempest-CreateVolumesFromImageTest-582537208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:14:46 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-adec3fb0-e87d-4e83-90c1-0a5c70f7d746 tempest-CreateVolumesFromImageTest-582537208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:14:46 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-adec3fb0-e87d-4e83-90c1-0a5c70f7d746 tempest-CreateVolumesFromImageTest-582537208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:14:46 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-adec3fb0-e87d-4e83-90c1-0a5c70f7d746 tempest-CreateVolumesFromImageTest-582537208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:14:46 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-adec3fb0-e87d-4e83-90c1-0a5c70f7d746 tempest-CreateVolumesFromImageTest-582537208 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:14:46 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-adec3fb0-e87d-4e83-90c1-0a5c70f7d746 tempest-CreateVolumesFromImageTest-582537208 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:14:46 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-adec3fb0-e87d-4e83-90c1-0a5c70f7d746 tempest-CreateVolumesFromImageTest-582537208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9727c05f-7fd7-44b9-b08f-3613aa3f9000 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:14:46 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-44bbe8b3-3c57-4b35-a4b4-2df4785d1559 tempest-CreateVolumesFromImageTest-582537208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a32396a4-c4d8-4ddf-aa8b-bdd79543d3a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be1a5ac0-ec43-4b46-a898-66851e202572', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:14:46 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-44bbe8b3-3c57-4b35-a4b4-2df4785d1559 tempest-CreateVolumesFromImageTest-582537208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5561d3e-2adc-475c-ad04-a94f582663d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:14:46 devstack sudo[107904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9727c05f-7fd7-44b9-b08f-3613aa3f9000 1073741824 Aug 10 16:14:46 devstack sudo[107904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:14:46 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-44bbe8b3-3c57-4b35-a4b4-2df4785d1559 tempest-CreateVolumesFromImageTest-582537208 None] Volume volume-be1a5ac0-ec43-4b46-a898-66851e202572 (be1a5ac0-ec43-4b46-a898-66851e202572): created successfully Aug 10 16:14:46 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-44bbe8b3-3c57-4b35-a4b4-2df4785d1559 tempest-CreateVolumesFromImageTest-582537208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5561d3e-2adc-475c-ad04-a94f582663d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:14:46 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-44bbe8b3-3c57-4b35-a4b4-2df4785d1559 tempest-CreateVolumesFromImageTest-582537208 None] Flow 'volume_create_manager' (695203a8-bd4e-4e5f-93c1-c17cca6961df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:14:46 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-44bbe8b3-3c57-4b35-a4b4-2df4785d1559 tempest-CreateVolumesFromImageTest-582537208 None] Created volume successfully. Aug 10 16:14:46 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-d69a94b1-ed86-48b6-8cd0-e996f2261006 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:14:46 devstack sudo[107904]: pam_unix(sudo:session): session closed for user root Aug 10 16:14:46 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-adec3fb0-e87d-4e83-90c1-0a5c70f7d746 tempest-CreateVolumesFromImageTest-582537208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9727c05f-7fd7-44b9-b08f-3613aa3f9000 1073741824" returned: 0 in 0.708s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:14:46 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-adec3fb0-e87d-4e83-90c1-0a5c70f7d746 tempest-CreateVolumesFromImageTest-582537208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9727c05f-7fd7-44b9-b08f-3613aa3f9000 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:14:46 devstack sudo[107909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9727c05f-7fd7-44b9-b08f-3613aa3f9000 Aug 10 16:14:46 devstack sudo[107909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:14:47 devstack sudo[107909]: pam_unix(sudo:session): session closed for user root Aug 10 16:14:47 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-adec3fb0-e87d-4e83-90c1-0a5c70f7d746 tempest-CreateVolumesFromImageTest-582537208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9727c05f-7fd7-44b9-b08f-3613aa3f9000" returned: 0 in 0.382s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:14:47 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-adec3fb0-e87d-4e83-90c1-0a5c70f7d746 tempest-CreateVolumesFromImageTest-582537208 None] <== create_volume: return (1160ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:14:47 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-adec3fb0-e87d-4e83-90c1-0a5c70f7d746 tempest-CreateVolumesFromImageTest-582537208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.163s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:14:47 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-32912e6f-1c73-49e9-bfdf-750ff79cb6d4 tempest-CreateVolumesFromImageTest-582537208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.768s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:14:47 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-32912e6f-1c73-49e9-bfdf-750ff79cb6d4 tempest-CreateVolumesFromImageTest-582537208 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:14:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1119373822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfeb1a92-87db-4925-9ce4-7ab09265d8fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='458ef4e9aa4542e183f344fecf23cd63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:14:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:14:44Z,use_quota=True,user_id='dbead3da8a1340b6bbc45a7f1c3aad50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:14:47 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-32912e6f-1c73-49e9-bfdf-750ff79cb6d4 tempest-CreateVolumesFromImageTest-582537208 None] Creating volume dfeb1a92-87db-4925-9ce4-7ab09265d8fa {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:14:47 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-32912e6f-1c73-49e9-bfdf-750ff79cb6d4 tempest-CreateVolumesFromImageTest-582537208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:14:47 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-32912e6f-1c73-49e9-bfdf-750ff79cb6d4 tempest-CreateVolumesFromImageTest-582537208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:14:47 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-32912e6f-1c73-49e9-bfdf-750ff79cb6d4 tempest-CreateVolumesFromImageTest-582537208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:14:47 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-32912e6f-1c73-49e9-bfdf-750ff79cb6d4 tempest-CreateVolumesFromImageTest-582537208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:14:47 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-32912e6f-1c73-49e9-bfdf-750ff79cb6d4 tempest-CreateVolumesFromImageTest-582537208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:14:47 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-32912e6f-1c73-49e9-bfdf-750ff79cb6d4 tempest-CreateVolumesFromImageTest-582537208 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:14:47 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-32912e6f-1c73-49e9-bfdf-750ff79cb6d4 tempest-CreateVolumesFromImageTest-582537208 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:14:47 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-32912e6f-1c73-49e9-bfdf-750ff79cb6d4 tempest-CreateVolumesFromImageTest-582537208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-dfeb1a92-87db-4925-9ce4-7ab09265d8fa 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:14:47 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-adec3fb0-e87d-4e83-90c1-0a5c70f7d746 tempest-CreateVolumesFromImageTest-582537208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10998633-3059-4beb-8f3f-5619384fa159) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9727c05f-7fd7-44b9-b08f-3613aa3f9000', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:14:47 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-adec3fb0-e87d-4e83-90c1-0a5c70f7d746 tempest-CreateVolumesFromImageTest-582537208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89beca37-a17f-4fc7-9df0-7270b408bcff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:14:47 devstack sudo[107912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-dfeb1a92-87db-4925-9ce4-7ab09265d8fa 1073741824 Aug 10 16:14:47 devstack sudo[107912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:14:47 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-adec3fb0-e87d-4e83-90c1-0a5c70f7d746 tempest-CreateVolumesFromImageTest-582537208 None] Volume volume-9727c05f-7fd7-44b9-b08f-3613aa3f9000 (9727c05f-7fd7-44b9-b08f-3613aa3f9000): created successfully Aug 10 16:14:47 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-adec3fb0-e87d-4e83-90c1-0a5c70f7d746 tempest-CreateVolumesFromImageTest-582537208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89beca37-a17f-4fc7-9df0-7270b408bcff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:14:47 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-adec3fb0-e87d-4e83-90c1-0a5c70f7d746 tempest-CreateVolumesFromImageTest-582537208 None] Flow 'volume_create_manager' (86eaf54a-d583-40bb-99c0-241333ee0dba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:14:47 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-adec3fb0-e87d-4e83-90c1-0a5c70f7d746 tempest-CreateVolumesFromImageTest-582537208 None] Created volume successfully. Aug 10 16:14:47 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-12f857f8-3f1b-492e-9dde-10c08925eb80 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:14:47 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-12f857f8-3f1b-492e-9dde-10c08925eb80 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] Flow 'volume_create_manager' (a3ddfb9d-f3c9-4798-a16f-dba7821aa205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:14:47 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-12f857f8-3f1b-492e-9dde-10c08925eb80 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (433fbed3-2fe9-4a6c-8f44-fd1ab997d28c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:14:47 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-12f857f8-3f1b-492e-9dde-10c08925eb80 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (433fbed3-2fe9-4a6c-8f44-fd1ab997d28c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:14:47Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ce95623-20e8-49bd-bbb8-c53f703f0a16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eca3ac77cd140e9a5f5f80010599108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:14:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:14:47Z,use_quota=True,user_id='82086b027a0344faa5cb5d00231b73e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33ace038-34b5-4518-aea2-a860a697a3e7),volume_type_id=33ace038-34b5-4518-aea2-a860a697a3e7)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:14:47 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-12f857f8-3f1b-492e-9dde-10c08925eb80 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ee894ea-f19b-414f-83a7-36a781649cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:14:47 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-12f857f8-3f1b-492e-9dde-10c08925eb80 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ee894ea-f19b-414f-83a7-36a781649cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:14:47 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-12f857f8-3f1b-492e-9dde-10c08925eb80 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97da52ac-9fd3-48ca-84e5-b0906399e40a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:14:47 devstack cinder-volume[88641]: DEBUG cinder.image.glance [None req-12f857f8-3f1b-492e-9dde-10c08925eb80 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] Creating Keystone auth plugin from conf {{(pid=88641) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 10 16:14:47 devstack sudo[107912]: pam_unix(sudo:session): session closed for user root Aug 10 16:14:47 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-32912e6f-1c73-49e9-bfdf-750ff79cb6d4 tempest-CreateVolumesFromImageTest-582537208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-dfeb1a92-87db-4925-9ce4-7ab09265d8fa 1073741824" returned: 0 in 0.535s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:14:47 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-32912e6f-1c73-49e9-bfdf-750ff79cb6d4 tempest-CreateVolumesFromImageTest-582537208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-dfeb1a92-87db-4925-9ce4-7ab09265d8fa {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:14:47 devstack sudo[107918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-dfeb1a92-87db-4925-9ce4-7ab09265d8fa Aug 10 16:14:47 devstack sudo[107918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:14:48 devstack sudo[107918]: pam_unix(sudo:session): session closed for user root Aug 10 16:14:48 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-32912e6f-1c73-49e9-bfdf-750ff79cb6d4 tempest-CreateVolumesFromImageTest-582537208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-dfeb1a92-87db-4925-9ce4-7ab09265d8fa" returned: 0 in 0.260s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:14:48 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-32912e6f-1c73-49e9-bfdf-750ff79cb6d4 tempest-CreateVolumesFromImageTest-582537208 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:14:48 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-32912e6f-1c73-49e9-bfdf-750ff79cb6d4 tempest-CreateVolumesFromImageTest-582537208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:14:48 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-5ca97f8a-52e5-4665-a8d2-d59d825d0b37 tempest-CreateVolumesFromImageTest-582537208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.276s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:14:48 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-5ca97f8a-52e5-4665-a8d2-d59d825d0b37 tempest-CreateVolumesFromImageTest-582537208 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:14:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-150972756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eac7401-5c00-4788-8e30-c36f381c6bdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='458ef4e9aa4542e183f344fecf23cd63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:14:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:14:45Z,use_quota=True,user_id='dbead3da8a1340b6bbc45a7f1c3aad50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:14:48 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-5ca97f8a-52e5-4665-a8d2-d59d825d0b37 tempest-CreateVolumesFromImageTest-582537208 None] Creating volume 2eac7401-5c00-4788-8e30-c36f381c6bdd {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:14:48 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-5ca97f8a-52e5-4665-a8d2-d59d825d0b37 tempest-CreateVolumesFromImageTest-582537208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:14:48 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-5ca97f8a-52e5-4665-a8d2-d59d825d0b37 tempest-CreateVolumesFromImageTest-582537208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:14:48 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-5ca97f8a-52e5-4665-a8d2-d59d825d0b37 tempest-CreateVolumesFromImageTest-582537208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:14:48 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-5ca97f8a-52e5-4665-a8d2-d59d825d0b37 tempest-CreateVolumesFromImageTest-582537208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:14:48 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-5ca97f8a-52e5-4665-a8d2-d59d825d0b37 tempest-CreateVolumesFromImageTest-582537208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:14:48 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-5ca97f8a-52e5-4665-a8d2-d59d825d0b37 tempest-CreateVolumesFromImageTest-582537208 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:14:48 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-5ca97f8a-52e5-4665-a8d2-d59d825d0b37 tempest-CreateVolumesFromImageTest-582537208 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:14:48 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5ca97f8a-52e5-4665-a8d2-d59d825d0b37 tempest-CreateVolumesFromImageTest-582537208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2eac7401-5c00-4788-8e30-c36f381c6bdd 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:14:48 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-12f857f8-3f1b-492e-9dde-10c08925eb80 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97da52ac-9fd3-48ca-84e5-b0906399e40a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9ce95623-20e8-49bd-bbb8-c53f703f0a16', 'volume_name': 'volume-9ce95623-20e8-49bd-bbb8-c53f703f0a16', 'volume_size': 1, 'image_id': 'c78aa51a-6580-461f-8ae2-f1000468c5fd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c78aa51a-6580-461f-8ae2-f1000468c5fd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '79bbaa20c1bb48f1a01c191114d69611', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6eca3ac77cd140e9a5f5f80010599108', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4ae2f35bb2a885323dbcf63ba53fc201a965b72a3e85e4a369c4359370e71a7d4e6e0f10e2132a68a0ea8cbab2f9bbd2aba50d76075b95e339b73e2bea4e9cdf', 'id': 'c78aa51a-6580-461f-8ae2-f1000468c5fd', 'created_at': datetime.datetime(2026, 8, 10, 14, 14, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 10, 14, 14, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c78aa51a-6580-461f-8ae2-f1000468c5fd/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:14:48 devstack sudo[107921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2eac7401-5c00-4788-8e30-c36f381c6bdd 1073741824 Aug 10 16:14:48 devstack sudo[107921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:14:48 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-12f857f8-3f1b-492e-9dde-10c08925eb80 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bf9e447-b354-4110-88d8-bd2558df6163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:14:48 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-12f857f8-3f1b-492e-9dde-10c08925eb80 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bf9e447-b354-4110-88d8-bd2558df6163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:14:48 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-12f857f8-3f1b-492e-9dde-10c08925eb80 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8b732bc-feff-4047-a6ce-cb4d9d1fe936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:14:48 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-12f857f8-3f1b-492e-9dde-10c08925eb80 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] Volume 9ce95623-20e8-49bd-bbb8-c53f703f0a16: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9ce95623-20e8-49bd-bbb8-c53f703f0a16', 'volume_size': 1, 'image_id': 'c78aa51a-6580-461f-8ae2-f1000468c5fd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c78aa51a-6580-461f-8ae2-f1000468c5fd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '79bbaa20c1bb48f1a01c191114d69611', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6eca3ac77cd140e9a5f5f80010599108', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4ae2f35bb2a885323dbcf63ba53fc201a965b72a3e85e4a369c4359370e71a7d4e6e0f10e2132a68a0ea8cbab2f9bbd2aba50d76075b95e339b73e2bea4e9cdf', 'id': 'c78aa51a-6580-461f-8ae2-f1000468c5fd', 'created_at': datetime.datetime(2026, 8, 10, 14, 14, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 10, 14, 14, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c78aa51a-6580-461f-8ae2-f1000468c5fd/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Aug 10 16:14:48 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-12f857f8-3f1b-492e-9dde-10c08925eb80 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] Trying to clone 9ce95623-20e8-49bd-bbb8-c53f703f0a16 from image c78aa51a-6580-461f-8ae2-f1000468c5fd at location (None, [{'url': 'file:///opt/stack/data/glance/images/c78aa51a-6580-461f-8ae2-f1000468c5fd', 'metadata': {}}]). {{(pid=88641) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 10 16:14:48 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-32912e6f-1c73-49e9-bfdf-750ff79cb6d4 tempest-CreateVolumesFromImageTest-582537208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c9c73ec-921e-4562-9e2e-e72af09b0630) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfeb1a92-87db-4925-9ce4-7ab09265d8fa', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:14:48 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-32912e6f-1c73-49e9-bfdf-750ff79cb6d4 tempest-CreateVolumesFromImageTest-582537208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a59ed700-9b45-4e37-a349-fad1965858c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:14:48 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-32912e6f-1c73-49e9-bfdf-750ff79cb6d4 tempest-CreateVolumesFromImageTest-582537208 None] Volume volume-dfeb1a92-87db-4925-9ce4-7ab09265d8fa (dfeb1a92-87db-4925-9ce4-7ab09265d8fa): created successfully Aug 10 16:14:48 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-32912e6f-1c73-49e9-bfdf-750ff79cb6d4 tempest-CreateVolumesFromImageTest-582537208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a59ed700-9b45-4e37-a349-fad1965858c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:14:48 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-32912e6f-1c73-49e9-bfdf-750ff79cb6d4 tempest-CreateVolumesFromImageTest-582537208 None] Flow 'volume_create_manager' (e6fce839-04c2-4bba-bd8b-83568f40290c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:14:48 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-32912e6f-1c73-49e9-bfdf-750ff79cb6d4 tempest-CreateVolumesFromImageTest-582537208 None] Created volume successfully. Aug 10 16:14:48 devstack cinder-volume[88641]: DEBUG cinder.image.image_utils [None req-12f857f8-3f1b-492e-9dde-10c08925eb80 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c78aa51a-6580-461f-8ae2-f1000468c5fd_5m8vkjrjdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88641) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 10 16:14:48 devstack cinder-volume[88641]: INFO cinder.image.image_utils [None req-12f857f8-3f1b-492e-9dde-10c08925eb80 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] Image download 0.00 MB at 0.00 MB/s Aug 10 16:14:48 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c7715b-072c-4804-98f7-f175f260ed42]: (4, 'raw') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:14:48 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-12f857f8-3f1b-492e-9dde-10c08925eb80 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c78aa51a-6580-461f-8ae2-f1000468c5fd_5m8vkjrjdevstack@QuobyteHD {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:14:48 devstack sudo[107923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c78aa51a-6580-461f-8ae2-f1000468c5fd_5m8vkjrjdevstack@QuobyteHD Aug 10 16:14:48 devstack sudo[107923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:14:48 devstack sudo[107921]: pam_unix(sudo:session): session closed for user root Aug 10 16:14:48 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5ca97f8a-52e5-4665-a8d2-d59d825d0b37 tempest-CreateVolumesFromImageTest-582537208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2eac7401-5c00-4788-8e30-c36f381c6bdd 1073741824" returned: 0 in 0.575s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:14:48 devstack sudo[107923]: pam_unix(sudo:session): session closed for user root Aug 10 16:14:48 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-12f857f8-3f1b-492e-9dde-10c08925eb80 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c78aa51a-6580-461f-8ae2-f1000468c5fd_5m8vkjrjdevstack@QuobyteHD" returned: 0 in 0.359s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:14:48 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-12f857f8-3f1b-492e-9dde-10c08925eb80 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c78aa51a-6580-461f-8ae2-f1000468c5fd_5m8vkjrjdevstack@QuobyteHD {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:14:48 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5ca97f8a-52e5-4665-a8d2-d59d825d0b37 tempest-CreateVolumesFromImageTest-582537208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2eac7401-5c00-4788-8e30-c36f381c6bdd {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:14:48 devstack sudo[107931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2eac7401-5c00-4788-8e30-c36f381c6bdd Aug 10 16:14:48 devstack sudo[107931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:14:48 devstack sudo[107930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c78aa51a-6580-461f-8ae2-f1000468c5fd_5m8vkjrjdevstack@QuobyteHD Aug 10 16:14:48 devstack sudo[107930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:14:49 devstack sudo[107931]: pam_unix(sudo:session): session closed for user root Aug 10 16:14:49 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5ca97f8a-52e5-4665-a8d2-d59d825d0b37 tempest-CreateVolumesFromImageTest-582537208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2eac7401-5c00-4788-8e30-c36f381c6bdd" returned: 0 in 0.280s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:14:49 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-5ca97f8a-52e5-4665-a8d2-d59d825d0b37 tempest-CreateVolumesFromImageTest-582537208 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:14:49 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-5ca97f8a-52e5-4665-a8d2-d59d825d0b37 tempest-CreateVolumesFromImageTest-582537208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:14:49 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-d69a94b1-ed86-48b6-8cd0-e996f2261006 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.634s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:14:49 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-5ca97f8a-52e5-4665-a8d2-d59d825d0b37 tempest-CreateVolumesFromImageTest-582537208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22876a09-c2c2-411c-8be9-b2d451691b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2eac7401-5c00-4788-8e30-c36f381c6bdd', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:14:49 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-5ca97f8a-52e5-4665-a8d2-d59d825d0b37 tempest-CreateVolumesFromImageTest-582537208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a54fb87-4a24-44e8-b062-75cf63879970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:14:49 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-5ca97f8a-52e5-4665-a8d2-d59d825d0b37 tempest-CreateVolumesFromImageTest-582537208 None] Volume volume-2eac7401-5c00-4788-8e30-c36f381c6bdd (2eac7401-5c00-4788-8e30-c36f381c6bdd): created successfully Aug 10 16:14:49 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-5ca97f8a-52e5-4665-a8d2-d59d825d0b37 tempest-CreateVolumesFromImageTest-582537208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a54fb87-4a24-44e8-b062-75cf63879970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:14:49 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-5ca97f8a-52e5-4665-a8d2-d59d825d0b37 tempest-CreateVolumesFromImageTest-582537208 None] Flow 'volume_create_manager' (197860df-c023-4e5a-9da4-3a510a4d7df5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:14:49 devstack sudo[107930]: pam_unix(sudo:session): session closed for user root Aug 10 16:14:49 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-12f857f8-3f1b-492e-9dde-10c08925eb80 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c78aa51a-6580-461f-8ae2-f1000468c5fd_5m8vkjrjdevstack@QuobyteHD" returned: 1 in 0.382s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:14:49 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-12f857f8-3f1b-492e-9dde-10c08925eb80 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c78aa51a-6580-461f-8ae2-f1000468c5fd_5m8vkjrjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 10 16:14:49 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-d69a94b1-ed86-48b6-8cd0-e996f2261006 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Creating offline snapshot e9a5f876-5574-481b-a7ee-6efa6321a666 of volume 054e3c13-16a6-4833-85d0-861028d67e1c {{(pid=88641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 16:14:49 devstack cinder-volume[88641]: DEBUG cinder.image.image_utils [None req-12f857f8-3f1b-492e-9dde-10c08925eb80 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] Temporary image c78aa51a-6580-461f-8ae2-f1000468c5fd is fetched for user 82086b027a0344faa5cb5d00231b73e3. {{(pid=88641) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 10 16:14:49 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-5ca97f8a-52e5-4665-a8d2-d59d825d0b37 tempest-CreateVolumesFromImageTest-582537208 None] Created volume successfully. Aug 10 16:14:49 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e2df871-2d57-4ee3-aed2-c14d6eab0709]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:14:49 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d69a94b1-ed86-48b6-8cd0-e996f2261006 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-054e3c13-16a6-4833-85d0-861028d67e1c {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:14:49 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e98c48-580d-4052-940c-79d8936b2acb]: (4, 'raw') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:14:49 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-12f857f8-3f1b-492e-9dde-10c08925eb80 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c78aa51a-6580-461f-8ae2-f1000468c5fd_5m8vkjrjdevstack@QuobyteHD {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:14:49 devstack sudo[107938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-054e3c13-16a6-4833-85d0-861028d67e1c Aug 10 16:14:49 devstack sudo[107938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:14:49 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-dfef9358-e7f7-4a1d-96fd-1a9c1cfdf581 tempest-CreateVolumesFromImageTest-582537208 None] Acquiring lock "cinder-2eac7401-5c00-4788-8e30-c36f381c6bdd-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:14:49 devstack sudo[107939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c78aa51a-6580-461f-8ae2-f1000468c5fd_5m8vkjrjdevstack@QuobyteHD Aug 10 16:14:49 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-dfef9358-e7f7-4a1d-96fd-1a9c1cfdf581 tempest-CreateVolumesFromImageTest-582537208 None] Lock "cinder-2eac7401-5c00-4788-8e30-c36f381c6bdd-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:14:49 devstack sudo[107939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:14:49 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-dfef9358-e7f7-4a1d-96fd-1a9c1cfdf581 tempest-CreateVolumesFromImageTest-582537208 None] Acquiring lock "cinder-quobyte-2eac7401-5c00-4788-8e30-c36f381c6bdd" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:14:49 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-dfef9358-e7f7-4a1d-96fd-1a9c1cfdf581 tempest-CreateVolumesFromImageTest-582537208 None] Lock "cinder-quobyte-2eac7401-5c00-4788-8e30-c36f381c6bdd" acquired by "delete_volume" :: waited 0.035s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:14:49 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c56444-b404-4558-8406-38524f8867e3]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:14:49 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-dfef9358-e7f7-4a1d-96fd-1a9c1cfdf581 tempest-CreateVolumesFromImageTest-582537208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2eac7401-5c00-4788-8e30-c36f381c6bdd {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:14:49 devstack sudo[107942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2eac7401-5c00-4788-8e30-c36f381c6bdd Aug 10 16:14:49 devstack sudo[107942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:14:49 devstack sudo[107939]: pam_unix(sudo:session): session closed for user root Aug 10 16:14:49 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-12f857f8-3f1b-492e-9dde-10c08925eb80 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c78aa51a-6580-461f-8ae2-f1000468c5fd_5m8vkjrjdevstack@QuobyteHD" returned: 0 in 0.469s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:14:49 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-12f857f8-3f1b-492e-9dde-10c08925eb80 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c78aa51a-6580-461f-8ae2-f1000468c5fd_5m8vkjrjdevstack@QuobyteHD {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:14:49 devstack sudo[107938]: pam_unix(sudo:session): session closed for user root Aug 10 16:14:49 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d69a94b1-ed86-48b6-8cd0-e996f2261006 tempest-CreateVolumesFromSnapshotTest-1045154512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-054e3c13-16a6-4833-85d0-861028d67e1c" returned: 0 in 0.578s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:14:49 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d69a94b1-ed86-48b6-8cd0-e996f2261006 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-054e3c13-16a6-4833-85d0-861028d67e1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-054e3c13-16a6-4833-85d0-861028d67e1c.e9a5f876-5574-481b-a7ee-6efa6321a666 1G {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:14:49 devstack sudo[107951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-054e3c13-16a6-4833-85d0-861028d67e1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-054e3c13-16a6-4833-85d0-861028d67e1c.e9a5f876-5574-481b-a7ee-6efa6321a666 1G Aug 10 16:14:49 devstack sudo[107951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:14:49 devstack sudo[107950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c78aa51a-6580-461f-8ae2-f1000468c5fd_5m8vkjrjdevstack@QuobyteHD Aug 10 16:14:49 devstack sudo[107950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:14:50 devstack sudo[107942]: pam_unix(sudo:session): session closed for user root Aug 10 16:14:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-dfef9358-e7f7-4a1d-96fd-1a9c1cfdf581 tempest-CreateVolumesFromImageTest-582537208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2eac7401-5c00-4788-8e30-c36f381c6bdd" returned: 0 in 0.482s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:14:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-dfef9358-e7f7-4a1d-96fd-1a9c1cfdf581 tempest-CreateVolumesFromImageTest-582537208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2eac7401-5c00-4788-8e30-c36f381c6bdd {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:14:50 devstack sudo[107957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2eac7401-5c00-4788-8e30-c36f381c6bdd Aug 10 16:14:50 devstack sudo[107957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:14:50 devstack sudo[107950]: pam_unix(sudo:session): session closed for user root Aug 10 16:14:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-12f857f8-3f1b-492e-9dde-10c08925eb80 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c78aa51a-6580-461f-8ae2-f1000468c5fd_5m8vkjrjdevstack@QuobyteHD" returned: 1 in 0.372s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:14:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-12f857f8-3f1b-492e-9dde-10c08925eb80 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c78aa51a-6580-461f-8ae2-f1000468c5fd_5m8vkjrjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 10 16:14:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-12f857f8-3f1b-492e-9dde-10c08925eb80 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:14:50 devstack sudo[107957]: pam_unix(sudo:session): session closed for user root Aug 10 16:14:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-dfef9358-e7f7-4a1d-96fd-1a9c1cfdf581 tempest-CreateVolumesFromImageTest-582537208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2eac7401-5c00-4788-8e30-c36f381c6bdd" returned: 0 in 0.280s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:14:50 devstack sudo[107951]: pam_unix(sudo:session): session closed for user root Aug 10 16:14:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d69a94b1-ed86-48b6-8cd0-e996f2261006 tempest-CreateVolumesFromSnapshotTest-1045154512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-054e3c13-16a6-4833-85d0-861028d67e1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-054e3c13-16a6-4833-85d0-861028d67e1c.e9a5f876-5574-481b-a7ee-6efa6321a666 1G" returned: 0 in 0.575s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:14:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d69a94b1-ed86-48b6-8cd0-e996f2261006 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-054e3c13-16a6-4833-85d0-861028d67e1c -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-054e3c13-16a6-4833-85d0-861028d67e1c.e9a5f876-5574-481b-a7ee-6efa6321a666 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:14:50 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-dfef9358-e7f7-4a1d-96fd-1a9c1cfdf581 tempest-CreateVolumesFromImageTest-582537208 None] Lock "cinder-quobyte-2eac7401-5c00-4788-8e30-c36f381c6bdd" released by "delete_volume" :: held 0.833s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:14:50 devstack sudo[107967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-054e3c13-16a6-4833-85d0-861028d67e1c -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-054e3c13-16a6-4833-85d0-861028d67e1c.e9a5f876-5574-481b-a7ee-6efa6321a666 Aug 10 16:14:50 devstack sudo[107967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:14:50 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-dfef9358-e7f7-4a1d-96fd-1a9c1cfdf581 tempest-CreateVolumesFromImageTest-582537208 None] Created reservations ['ed706715-8bd4-4cbb-b8f2-a4f8929991bb', '9ac8d17d-f150-4ee3-b7f6-7d9d52feceae', 'e56095af-2030-4e4e-bc1f-d99866d648ff', '9d89ffea-4e79-4fda-a0a5-9a7b81f1914e'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:14:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-dfef9358-e7f7-4a1d-96fd-1a9c1cfdf581 tempest-CreateVolumesFromImageTest-582537208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:14:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-dfef9358-e7f7-4a1d-96fd-1a9c1cfdf581 tempest-CreateVolumesFromImageTest-582537208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:14:50 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-dfef9358-e7f7-4a1d-96fd-1a9c1cfdf581 tempest-CreateVolumesFromImageTest-582537208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:14:50 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-dfef9358-e7f7-4a1d-96fd-1a9c1cfdf581 tempest-CreateVolumesFromImageTest-582537208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:14:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-dfef9358-e7f7-4a1d-96fd-1a9c1cfdf581 tempest-CreateVolumesFromImageTest-582537208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:14:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-dfef9358-e7f7-4a1d-96fd-1a9c1cfdf581 tempest-CreateVolumesFromImageTest-582537208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:14:50 devstack sudo[107969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:14:50 devstack sudo[107969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:14:50 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-7b902e4a-9feb-45a0-8f3a-e6f6a07b6112 tempest-CreateVolumesFromImageTest-582537208 None] Acquiring lock "cinder-dfeb1a92-87db-4925-9ce4-7ab09265d8fa-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:14:50 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-7b902e4a-9feb-45a0-8f3a-e6f6a07b6112 tempest-CreateVolumesFromImageTest-582537208 None] Lock "cinder-dfeb1a92-87db-4925-9ce4-7ab09265d8fa-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:14:50 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-7b902e4a-9feb-45a0-8f3a-e6f6a07b6112 tempest-CreateVolumesFromImageTest-582537208 None] Acquiring lock "cinder-quobyte-dfeb1a92-87db-4925-9ce4-7ab09265d8fa" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:14:50 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-7b902e4a-9feb-45a0-8f3a-e6f6a07b6112 tempest-CreateVolumesFromImageTest-582537208 None] Lock "cinder-quobyte-dfeb1a92-87db-4925-9ce4-7ab09265d8fa" acquired by "delete_volume" :: waited 0.038s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:14:50 devstack sudo[107967]: pam_unix(sudo:session): session closed for user root Aug 10 16:14:50 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e4311b-b79a-4efb-9256-d73c5018fbc8]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:14:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7b902e4a-9feb-45a0-8f3a-e6f6a07b6112 tempest-CreateVolumesFromImageTest-582537208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-dfeb1a92-87db-4925-9ce4-7ab09265d8fa {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:14:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d69a94b1-ed86-48b6-8cd0-e996f2261006 tempest-CreateVolumesFromSnapshotTest-1045154512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-054e3c13-16a6-4833-85d0-861028d67e1c -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-054e3c13-16a6-4833-85d0-861028d67e1c.e9a5f876-5574-481b-a7ee-6efa6321a666" returned: 0 in 0.433s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:14:50 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-d69a94b1-ed86-48b6-8cd0-e996f2261006 tempest-CreateVolumesFromSnapshotTest-1045154512 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-054e3c13-16a6-4833-85d0-861028d67e1c.e9a5f876-5574-481b-a7ee-6efa6321a666 is being set with open permissions: ugo+rw Aug 10 16:14:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d69a94b1-ed86-48b6-8cd0-e996f2261006 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-054e3c13-16a6-4833-85d0-861028d67e1c.e9a5f876-5574-481b-a7ee-6efa6321a666 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:14:50 devstack sudo[107975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-054e3c13-16a6-4833-85d0-861028d67e1c.e9a5f876-5574-481b-a7ee-6efa6321a666 Aug 10 16:14:50 devstack sudo[107975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:14:50 devstack sudo[107969]: pam_unix(sudo:session): session closed for user root Aug 10 16:14:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-dfef9358-e7f7-4a1d-96fd-1a9c1cfdf581 tempest-CreateVolumesFromImageTest-582537208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.351s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:14:50 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-dfef9358-e7f7-4a1d-96fd-1a9c1cfdf581 tempest-CreateVolumesFromImageTest-582537208 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:14:50 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-dfef9358-e7f7-4a1d-96fd-1a9c1cfdf581 tempest-CreateVolumesFromImageTest-582537208 None] Deleted volume successfully. Aug 10 16:14:50 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-dfef9358-e7f7-4a1d-96fd-1a9c1cfdf581 tempest-CreateVolumesFromImageTest-582537208 None] Lock "cinder-2eac7401-5c00-4788-8e30-c36f381c6bdd-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:14:50 devstack sudo[107974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-dfeb1a92-87db-4925-9ce4-7ab09265d8fa Aug 10 16:14:50 devstack sudo[107974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:14:51 devstack sudo[107975]: pam_unix(sudo:session): session closed for user root Aug 10 16:14:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d69a94b1-ed86-48b6-8cd0-e996f2261006 tempest-CreateVolumesFromSnapshotTest-1045154512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-054e3c13-16a6-4833-85d0-861028d67e1c.e9a5f876-5574-481b-a7ee-6efa6321a666" returned: 0 in 0.281s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:14:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d69a94b1-ed86-48b6-8cd0-e996f2261006 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-054e3c13-16a6-4833-85d0-861028d67e1c.info {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:14:51 devstack sudo[107980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-054e3c13-16a6-4833-85d0-861028d67e1c.info Aug 10 16:14:51 devstack sudo[107980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:14:51 devstack sudo[107974]: pam_unix(sudo:session): session closed for user root Aug 10 16:14:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7b902e4a-9feb-45a0-8f3a-e6f6a07b6112 tempest-CreateVolumesFromImageTest-582537208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-dfeb1a92-87db-4925-9ce4-7ab09265d8fa" returned: 0 in 0.427s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:14:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7b902e4a-9feb-45a0-8f3a-e6f6a07b6112 tempest-CreateVolumesFromImageTest-582537208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-dfeb1a92-87db-4925-9ce4-7ab09265d8fa {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:14:51 devstack sudo[107985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-dfeb1a92-87db-4925-9ce4-7ab09265d8fa Aug 10 16:14:51 devstack sudo[107985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:14:51 devstack sudo[107980]: pam_unix(sudo:session): session closed for user root Aug 10 16:14:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d69a94b1-ed86-48b6-8cd0-e996f2261006 tempest-CreateVolumesFromSnapshotTest-1045154512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-054e3c13-16a6-4833-85d0-861028d67e1c.info" returned: 0 in 0.283s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:14:51 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-d69a94b1-ed86-48b6-8cd0-e996f2261006 tempest-CreateVolumesFromSnapshotTest-1045154512 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-054e3c13-16a6-4833-85d0-861028d67e1c.info is being set with open permissions: ugo+rw Aug 10 16:14:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d69a94b1-ed86-48b6-8cd0-e996f2261006 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-054e3c13-16a6-4833-85d0-861028d67e1c.info {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:14:51 devstack sudo[107988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-054e3c13-16a6-4833-85d0-861028d67e1c.info Aug 10 16:14:51 devstack sudo[107988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:14:51 devstack sudo[107985]: pam_unix(sudo:session): session closed for user root Aug 10 16:14:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7b902e4a-9feb-45a0-8f3a-e6f6a07b6112 tempest-CreateVolumesFromImageTest-582537208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-dfeb1a92-87db-4925-9ce4-7ab09265d8fa" returned: 0 in 0.274s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:14:51 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-7b902e4a-9feb-45a0-8f3a-e6f6a07b6112 tempest-CreateVolumesFromImageTest-582537208 None] Lock "cinder-quobyte-dfeb1a92-87db-4925-9ce4-7ab09265d8fa" released by "delete_volume" :: held 0.755s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:14:51 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-7b902e4a-9feb-45a0-8f3a-e6f6a07b6112 tempest-CreateVolumesFromImageTest-582537208 None] Created reservations ['7b9b8760-5fbe-4055-bb8b-8372954bb4d5', '8ce5b23b-205a-4f2e-9953-d8392815bc4a', '142e2426-1bde-4b59-8cc3-3327f456480b', '28cfbd6e-1075-4e20-bef2-e04bce7ca714'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:14:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-7b902e4a-9feb-45a0-8f3a-e6f6a07b6112 tempest-CreateVolumesFromImageTest-582537208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:14:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-7b902e4a-9feb-45a0-8f3a-e6f6a07b6112 tempest-CreateVolumesFromImageTest-582537208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:14:51 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-7b902e4a-9feb-45a0-8f3a-e6f6a07b6112 tempest-CreateVolumesFromImageTest-582537208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:14:51 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-7b902e4a-9feb-45a0-8f3a-e6f6a07b6112 tempest-CreateVolumesFromImageTest-582537208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:14:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-7b902e4a-9feb-45a0-8f3a-e6f6a07b6112 tempest-CreateVolumesFromImageTest-582537208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:14:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7b902e4a-9feb-45a0-8f3a-e6f6a07b6112 tempest-CreateVolumesFromImageTest-582537208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:14:51 devstack sudo[107988]: pam_unix(sudo:session): session closed for user root Aug 10 16:14:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d69a94b1-ed86-48b6-8cd0-e996f2261006 tempest-CreateVolumesFromSnapshotTest-1045154512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-054e3c13-16a6-4833-85d0-861028d67e1c.info" returned: 0 in 0.277s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:14:51 devstack sudo[107993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:14:51 devstack sudo[107993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:14:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-d69a94b1-ed86-48b6-8cd0-e996f2261006 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.590s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:14:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-12f857f8-3f1b-492e-9dde-10c08925eb80 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.577s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:14:51 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-12f857f8-3f1b-492e-9dde-10c08925eb80 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:14:47Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ce95623-20e8-49bd-bbb8-c53f703f0a16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eca3ac77cd140e9a5f5f80010599108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:14:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:14:47Z,use_quota=True,user_id='82086b027a0344faa5cb5d00231b73e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33ace038-34b5-4518-aea2-a860a697a3e7),volume_type_id=33ace038-34b5-4518-aea2-a860a697a3e7)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:14:51 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-12f857f8-3f1b-492e-9dde-10c08925eb80 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] Creating volume 9ce95623-20e8-49bd-bbb8-c53f703f0a16 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:14:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-12f857f8-3f1b-492e-9dde-10c08925eb80 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:14:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-12f857f8-3f1b-492e-9dde-10c08925eb80 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:14:51 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-12f857f8-3f1b-492e-9dde-10c08925eb80 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:14:51 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-12f857f8-3f1b-492e-9dde-10c08925eb80 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:14:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-12f857f8-3f1b-492e-9dde-10c08925eb80 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:14:51 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-12f857f8-3f1b-492e-9dde-10c08925eb80 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:14:51 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-12f857f8-3f1b-492e-9dde-10c08925eb80 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:14:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-12f857f8-3f1b-492e-9dde-10c08925eb80 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9ce95623-20e8-49bd-bbb8-c53f703f0a16 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:14:51 devstack sudo[107995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9ce95623-20e8-49bd-bbb8-c53f703f0a16 1073741824 Aug 10 16:14:51 devstack sudo[107995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:14:51 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-d69a94b1-ed86-48b6-8cd0-e996f2261006 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Create snapshot completed successfully Aug 10 16:14:51 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-907ca71a-f7b4-44d5-91c5-ed99ff8cf479 tempest-CreateVolumesFromImageTest-582537208 None] Acquiring lock "cinder-9727c05f-7fd7-44b9-b08f-3613aa3f9000-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:14:51 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-907ca71a-f7b4-44d5-91c5-ed99ff8cf479 tempest-CreateVolumesFromImageTest-582537208 None] Lock "cinder-9727c05f-7fd7-44b9-b08f-3613aa3f9000-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:14:52 devstack sudo[107993]: pam_unix(sudo:session): session closed for user root Aug 10 16:14:52 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-907ca71a-f7b4-44d5-91c5-ed99ff8cf479 tempest-CreateVolumesFromImageTest-582537208 None] Acquiring lock "cinder-quobyte-9727c05f-7fd7-44b9-b08f-3613aa3f9000" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:14:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7b902e4a-9feb-45a0-8f3a-e6f6a07b6112 tempest-CreateVolumesFromImageTest-582537208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.430s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:14:52 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-7b902e4a-9feb-45a0-8f3a-e6f6a07b6112 tempest-CreateVolumesFromImageTest-582537208 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:14:52 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-7b902e4a-9feb-45a0-8f3a-e6f6a07b6112 tempest-CreateVolumesFromImageTest-582537208 None] Deleted volume successfully. Aug 10 16:14:52 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-907ca71a-f7b4-44d5-91c5-ed99ff8cf479 tempest-CreateVolumesFromImageTest-582537208 None] Lock "cinder-quobyte-9727c05f-7fd7-44b9-b08f-3613aa3f9000" acquired by "delete_volume" :: waited 0.049s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:14:52 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-7b902e4a-9feb-45a0-8f3a-e6f6a07b6112 tempest-CreateVolumesFromImageTest-582537208 None] Lock "cinder-dfeb1a92-87db-4925-9ce4-7ab09265d8fa-delete_volume" released by "delete_volume" :: held 1.491s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:14:52 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae6234c-2796-4d9e-b555-8ce863afedd8]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:14:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-907ca71a-f7b4-44d5-91c5-ed99ff8cf479 tempest-CreateVolumesFromImageTest-582537208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9727c05f-7fd7-44b9-b08f-3613aa3f9000 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:14:52 devstack sudo[108001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9727c05f-7fd7-44b9-b08f-3613aa3f9000 Aug 10 16:14:52 devstack sudo[108001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:14:52 devstack sudo[107995]: pam_unix(sudo:session): session closed for user root Aug 10 16:14:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-12f857f8-3f1b-492e-9dde-10c08925eb80 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9ce95623-20e8-49bd-bbb8-c53f703f0a16 1073741824" returned: 0 in 0.595s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:14:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-12f857f8-3f1b-492e-9dde-10c08925eb80 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9ce95623-20e8-49bd-bbb8-c53f703f0a16 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:14:52 devstack sudo[108003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9ce95623-20e8-49bd-bbb8-c53f703f0a16 Aug 10 16:14:52 devstack sudo[108003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:14:52 devstack sudo[108001]: pam_unix(sudo:session): session closed for user root Aug 10 16:14:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-907ca71a-f7b4-44d5-91c5-ed99ff8cf479 tempest-CreateVolumesFromImageTest-582537208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9727c05f-7fd7-44b9-b08f-3613aa3f9000" returned: 0 in 0.441s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:14:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-907ca71a-f7b4-44d5-91c5-ed99ff8cf479 tempest-CreateVolumesFromImageTest-582537208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9727c05f-7fd7-44b9-b08f-3613aa3f9000 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:14:52 devstack sudo[108009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9727c05f-7fd7-44b9-b08f-3613aa3f9000 Aug 10 16:14:52 devstack sudo[108009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:14:52 devstack sudo[108003]: pam_unix(sudo:session): session closed for user root Aug 10 16:14:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-12f857f8-3f1b-492e-9dde-10c08925eb80 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9ce95623-20e8-49bd-bbb8-c53f703f0a16" returned: 0 in 0.356s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:14:52 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-12f857f8-3f1b-492e-9dde-10c08925eb80 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:14:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-12f857f8-3f1b-492e-9dde-10c08925eb80 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:14:52 devstack cinder-volume[88641]: DEBUG cinder.volume.volume_utils [None req-12f857f8-3f1b-492e-9dde-10c08925eb80 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] Attempting download of c78aa51a-6580-461f-8ae2-f1000468c5fd ((None, [{'url': 'file:///opt/stack/data/glance/images/c78aa51a-6580-461f-8ae2-f1000468c5fd', 'metadata': {}}])) to volume 9ce95623-20e8-49bd-bbb8-c53f703f0a16. {{(pid=88641) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 10 16:14:52 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab74668a-d6fb-4a89-b9f5-a026c84ce21a]: (4, 'raw') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:14:52 devstack sudo[108009]: pam_unix(sudo:session): session closed for user root Aug 10 16:14:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-12f857f8-3f1b-492e-9dde-10c08925eb80 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c78aa51a-6580-461f-8ae2-f1000468c5fd_xk_kpe8v {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:14:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-907ca71a-f7b4-44d5-91c5-ed99ff8cf479 tempest-CreateVolumesFromImageTest-582537208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9727c05f-7fd7-44b9-b08f-3613aa3f9000" returned: 0 in 0.324s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:14:52 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-907ca71a-f7b4-44d5-91c5-ed99ff8cf479 tempest-CreateVolumesFromImageTest-582537208 None] Lock "cinder-quobyte-9727c05f-7fd7-44b9-b08f-3613aa3f9000" released by "delete_volume" :: held 0.836s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:14:52 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-907ca71a-f7b4-44d5-91c5-ed99ff8cf479 tempest-CreateVolumesFromImageTest-582537208 None] Created reservations ['bb596b74-eb2f-4293-9877-578806521265', '16ee54c8-880a-4fbd-878a-6010c09f73fa', '8a432c01-97c8-4045-b86d-c3b3dc9bded2', '0833d450-6226-4fe5-a2bd-8ce7066add60'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:14:52 devstack sudo[108013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c78aa51a-6580-461f-8ae2-f1000468c5fd_xk_kpe8v Aug 10 16:14:52 devstack sudo[108013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:14:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-907ca71a-f7b4-44d5-91c5-ed99ff8cf479 tempest-CreateVolumesFromImageTest-582537208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:14:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-907ca71a-f7b4-44d5-91c5-ed99ff8cf479 tempest-CreateVolumesFromImageTest-582537208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:14:53 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-907ca71a-f7b4-44d5-91c5-ed99ff8cf479 tempest-CreateVolumesFromImageTest-582537208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:14:53 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-907ca71a-f7b4-44d5-91c5-ed99ff8cf479 tempest-CreateVolumesFromImageTest-582537208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:14:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-907ca71a-f7b4-44d5-91c5-ed99ff8cf479 tempest-CreateVolumesFromImageTest-582537208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:14:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-907ca71a-f7b4-44d5-91c5-ed99ff8cf479 tempest-CreateVolumesFromImageTest-582537208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:14:53 devstack sudo[108015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:14:53 devstack sudo[108015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:14:53 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-d81b70da-6046-4534-b7e5-cf8d471bd2b3 tempest-CreateVolumesFromImageTest-582537208 None] Acquiring lock "cinder-be1a5ac0-ec43-4b46-a898-66851e202572-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:14:53 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-d81b70da-6046-4534-b7e5-cf8d471bd2b3 tempest-CreateVolumesFromImageTest-582537208 None] Lock "cinder-be1a5ac0-ec43-4b46-a898-66851e202572-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:14:53 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-d81b70da-6046-4534-b7e5-cf8d471bd2b3 tempest-CreateVolumesFromImageTest-582537208 None] Acquiring lock "cinder-quobyte-be1a5ac0-ec43-4b46-a898-66851e202572" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:14:53 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-d81b70da-6046-4534-b7e5-cf8d471bd2b3 tempest-CreateVolumesFromImageTest-582537208 None] Lock "cinder-quobyte-be1a5ac0-ec43-4b46-a898-66851e202572" acquired by "delete_volume" :: waited 0.033s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:14:53 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[f10c87db-2947-4686-befe-4a3afe5a03f5]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:14:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d81b70da-6046-4534-b7e5-cf8d471bd2b3 tempest-CreateVolumesFromImageTest-582537208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-be1a5ac0-ec43-4b46-a898-66851e202572 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:14:53 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-54c666ee-04cc-4341-bdce-01aca0fc6c53 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:14:53 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-54c666ee-04cc-4341-bdce-01aca0fc6c53 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Flow 'volume_create_manager' (e1e3579b-cd84-4aaf-8bdb-cd09e7f140b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:14:53 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-54c666ee-04cc-4341-bdce-01aca0fc6c53 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8c56aa7-45fa-4859-86d1-dc5842363841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:14:53 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-54c666ee-04cc-4341-bdce-01aca0fc6c53 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8c56aa7-45fa-4859-86d1-dc5842363841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:14:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1354420744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60667d87-0e01-4a42-a1ba-6fdaae318cf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9968a27b1d64b9ca715ae98e87583dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:14:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:14:53Z,use_quota=True,user_id='b5cabc3b7083421eb2f45121b9ac3836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:14:53 devstack sudo[108013]: pam_unix(sudo:session): session closed for user root Aug 10 16:14:53 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-54c666ee-04cc-4341-bdce-01aca0fc6c53 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ea829d3-1b41-4dc6-9137-63c6b225d80c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:14:53 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-54c666ee-04cc-4341-bdce-01aca0fc6c53 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ea829d3-1b41-4dc6-9137-63c6b225d80c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:14:53 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-54c666ee-04cc-4341-bdce-01aca0fc6c53 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ddc4fc7-e2fa-4843-93fc-d8f0032e58ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:14:53 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-54c666ee-04cc-4341-bdce-01aca0fc6c53 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ddc4fc7-e2fa-4843-93fc-d8f0032e58ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60667d87-0e01-4a42-a1ba-6fdaae318cf2', 'volume_name': 'volume-60667d87-0e01-4a42-a1ba-6fdaae318cf2', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:14:53 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-54c666ee-04cc-4341-bdce-01aca0fc6c53 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e363ca41-aaa7-4bf0-b731-3991cee70ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:14:53 devstack sudo[108015]: pam_unix(sudo:session): session closed for user root Aug 10 16:14:53 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-54c666ee-04cc-4341-bdce-01aca0fc6c53 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e363ca41-aaa7-4bf0-b731-3991cee70ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:14:53 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-54c666ee-04cc-4341-bdce-01aca0fc6c53 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04350d21-9006-4e36-8d37-b75bf37c7ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:14:53 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-54c666ee-04cc-4341-bdce-01aca0fc6c53 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Volume 60667d87-0e01-4a42-a1ba-6fdaae318cf2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60667d87-0e01-4a42-a1ba-6fdaae318cf2', 'volume_size': 1} Aug 10 16:14:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-54c666ee-04cc-4341-bdce-01aca0fc6c53 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:14:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-54c666ee-04cc-4341-bdce-01aca0fc6c53 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:14:53 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-54c666ee-04cc-4341-bdce-01aca0fc6c53 tempest-CreateVolumesFromSnapshotTest-1045154512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:14:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1354420744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60667d87-0e01-4a42-a1ba-6fdaae318cf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9968a27b1d64b9ca715ae98e87583dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:14:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:14:53Z,use_quota=True,user_id='b5cabc3b7083421eb2f45121b9ac3836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:14:53 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-54c666ee-04cc-4341-bdce-01aca0fc6c53 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Creating volume 60667d87-0e01-4a42-a1ba-6fdaae318cf2 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:14:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-54c666ee-04cc-4341-bdce-01aca0fc6c53 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:14:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-54c666ee-04cc-4341-bdce-01aca0fc6c53 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:14:53 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-54c666ee-04cc-4341-bdce-01aca0fc6c53 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:14:53 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-54c666ee-04cc-4341-bdce-01aca0fc6c53 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:14:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-54c666ee-04cc-4341-bdce-01aca0fc6c53 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:14:53 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-54c666ee-04cc-4341-bdce-01aca0fc6c53 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:14:53 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-54c666ee-04cc-4341-bdce-01aca0fc6c53 tempest-CreateVolumesFromSnapshotTest-1045154512 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:14:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-54c666ee-04cc-4341-bdce-01aca0fc6c53 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-60667d87-0e01-4a42-a1ba-6fdaae318cf2 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:14:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-12f857f8-3f1b-492e-9dde-10c08925eb80 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c78aa51a-6580-461f-8ae2-f1000468c5fd_xk_kpe8v" returned: 0 in 0.750s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:14:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-907ca71a-f7b4-44d5-91c5-ed99ff8cf479 tempest-CreateVolumesFromImageTest-582537208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.476s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:14:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-12f857f8-3f1b-492e-9dde-10c08925eb80 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c78aa51a-6580-461f-8ae2-f1000468c5fd_xk_kpe8v {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:14:53 devstack sudo[108018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-be1a5ac0-ec43-4b46-a898-66851e202572 Aug 10 16:14:53 devstack sudo[108018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:14:53 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-907ca71a-f7b4-44d5-91c5-ed99ff8cf479 tempest-CreateVolumesFromImageTest-582537208 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:14:53 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-907ca71a-f7b4-44d5-91c5-ed99ff8cf479 tempest-CreateVolumesFromImageTest-582537208 None] Deleted volume successfully. Aug 10 16:14:53 devstack sudo[108021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-60667d87-0e01-4a42-a1ba-6fdaae318cf2 1073741824 Aug 10 16:14:53 devstack sudo[108021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:14:53 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-907ca71a-f7b4-44d5-91c5-ed99ff8cf479 tempest-CreateVolumesFromImageTest-582537208 None] Lock "cinder-9727c05f-7fd7-44b9-b08f-3613aa3f9000-delete_volume" released by "delete_volume" :: held 1.725s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:14:53 devstack sudo[108022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c78aa51a-6580-461f-8ae2-f1000468c5fd_xk_kpe8v Aug 10 16:14:53 devstack sudo[108022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:14:54 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-868c33bf-e57a-4e53-bd8d-fb93569e18b6 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:14:54 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-868c33bf-e57a-4e53-bd8d-fb93569e18b6 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Flow 'volume_create_manager' (1effd6f1-9a40-4fb1-a2d9-6b72cb524b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:14:54 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-868c33bf-e57a-4e53-bd8d-fb93569e18b6 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc4027b1-bb00-4fe2-b941-7017b0407801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:14:54 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-868c33bf-e57a-4e53-bd8d-fb93569e18b6 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc4027b1-bb00-4fe2-b941-7017b0407801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:14:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1169521996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=585b4ad5-fe99-49c6-82f0-3eb088b49721,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9968a27b1d64b9ca715ae98e87583dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:14:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:14:54Z,use_quota=True,user_id='b5cabc3b7083421eb2f45121b9ac3836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:14:54 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-868c33bf-e57a-4e53-bd8d-fb93569e18b6 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9390a507-e7da-4201-845d-8f7faa60c750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:14:54 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-868c33bf-e57a-4e53-bd8d-fb93569e18b6 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9390a507-e7da-4201-845d-8f7faa60c750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:14:54 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-868c33bf-e57a-4e53-bd8d-fb93569e18b6 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c270782-d5df-4327-b4d1-119f38acd0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:14:54 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-868c33bf-e57a-4e53-bd8d-fb93569e18b6 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c270782-d5df-4327-b4d1-119f38acd0de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '585b4ad5-fe99-49c6-82f0-3eb088b49721', 'volume_name': 'volume-585b4ad5-fe99-49c6-82f0-3eb088b49721', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:14:54 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-868c33bf-e57a-4e53-bd8d-fb93569e18b6 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6298dda-b9ee-4926-8940-e81593110196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:14:54 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-868c33bf-e57a-4e53-bd8d-fb93569e18b6 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6298dda-b9ee-4926-8940-e81593110196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:14:54 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-868c33bf-e57a-4e53-bd8d-fb93569e18b6 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (010d32e8-34ce-4706-9504-655f87ed566a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:14:54 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-868c33bf-e57a-4e53-bd8d-fb93569e18b6 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Volume 585b4ad5-fe99-49c6-82f0-3eb088b49721: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-585b4ad5-fe99-49c6-82f0-3eb088b49721', 'volume_size': 1} Aug 10 16:14:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-868c33bf-e57a-4e53-bd8d-fb93569e18b6 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:14:54 devstack sudo[108018]: pam_unix(sudo:session): session closed for user root Aug 10 16:14:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d81b70da-6046-4534-b7e5-cf8d471bd2b3 tempest-CreateVolumesFromImageTest-582537208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-be1a5ac0-ec43-4b46-a898-66851e202572" returned: 0 in 0.698s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:14:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d81b70da-6046-4534-b7e5-cf8d471bd2b3 tempest-CreateVolumesFromImageTest-582537208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-be1a5ac0-ec43-4b46-a898-66851e202572 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:14:54 devstack sudo[108033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-be1a5ac0-ec43-4b46-a898-66851e202572 Aug 10 16:14:54 devstack sudo[108033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:14:54 devstack sudo[108022]: pam_unix(sudo:session): session closed for user root Aug 10 16:14:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-12f857f8-3f1b-492e-9dde-10c08925eb80 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c78aa51a-6580-461f-8ae2-f1000468c5fd_xk_kpe8v" returned: 1 in 0.647s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:14:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-12f857f8-3f1b-492e-9dde-10c08925eb80 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c78aa51a-6580-461f-8ae2-f1000468c5fd_xk_kpe8v' failed. Not Retrying. {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 10 16:14:54 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0faeda5-3f1c-4d4e-bcb1-b86c2fdecba9]: (4, 'raw') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:14:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-12f857f8-3f1b-492e-9dde-10c08925eb80 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c78aa51a-6580-461f-8ae2-f1000468c5fd_5m8vkjrjdevstack@QuobyteHD {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:14:54 devstack sudo[108038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c78aa51a-6580-461f-8ae2-f1000468c5fd_5m8vkjrjdevstack@QuobyteHD Aug 10 16:14:54 devstack sudo[108038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:14:54 devstack sudo[108021]: pam_unix(sudo:session): session closed for user root Aug 10 16:14:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-54c666ee-04cc-4341-bdce-01aca0fc6c53 tempest-CreateVolumesFromSnapshotTest-1045154512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-60667d87-0e01-4a42-a1ba-6fdaae318cf2 1073741824" returned: 0 in 0.846s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:14:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-54c666ee-04cc-4341-bdce-01aca0fc6c53 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-60667d87-0e01-4a42-a1ba-6fdaae318cf2 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:14:54 devstack sudo[108041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-60667d87-0e01-4a42-a1ba-6fdaae318cf2 Aug 10 16:14:54 devstack sudo[108041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:14:54 devstack sudo[108033]: pam_unix(sudo:session): session closed for user root Aug 10 16:14:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d81b70da-6046-4534-b7e5-cf8d471bd2b3 tempest-CreateVolumesFromImageTest-582537208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-be1a5ac0-ec43-4b46-a898-66851e202572" returned: 0 in 0.472s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:14:54 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-697a0cd1-fc2c-49e4-b502-1ea310004ea8 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:14:54 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-697a0cd1-fc2c-49e4-b502-1ea310004ea8 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Flow 'volume_create_manager' (cd084918-48a1-4bc4-af8c-7c73ad87d3b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:14:54 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-697a0cd1-fc2c-49e4-b502-1ea310004ea8 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b29e6b63-8f10-4032-b8d6-a204e59490be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:14:54 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-d81b70da-6046-4534-b7e5-cf8d471bd2b3 tempest-CreateVolumesFromImageTest-582537208 None] Lock "cinder-quobyte-be1a5ac0-ec43-4b46-a898-66851e202572" released by "delete_volume" :: held 1.294s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:14:54 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-697a0cd1-fc2c-49e4-b502-1ea310004ea8 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b29e6b63-8f10-4032-b8d6-a204e59490be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:14:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1780425494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e44b17e5-9a03-443e-a0f4-d151cd51472a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9968a27b1d64b9ca715ae98e87583dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:14:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:14:55Z,use_quota=True,user_id='b5cabc3b7083421eb2f45121b9ac3836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:14:54 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-697a0cd1-fc2c-49e4-b502-1ea310004ea8 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a347dab7-2dae-4018-923d-a9e34e2de3e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:14:54 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-697a0cd1-fc2c-49e4-b502-1ea310004ea8 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a347dab7-2dae-4018-923d-a9e34e2de3e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:14:54 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-697a0cd1-fc2c-49e4-b502-1ea310004ea8 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3030704d-90cf-424c-80e0-6163e366d637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:14:54 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-697a0cd1-fc2c-49e4-b502-1ea310004ea8 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3030704d-90cf-424c-80e0-6163e366d637) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e44b17e5-9a03-443e-a0f4-d151cd51472a', 'volume_name': 'volume-e44b17e5-9a03-443e-a0f4-d151cd51472a', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:14:54 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-697a0cd1-fc2c-49e4-b502-1ea310004ea8 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c1be706-7685-4f52-8e4c-3021e22ba81c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:14:54 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-697a0cd1-fc2c-49e4-b502-1ea310004ea8 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c1be706-7685-4f52-8e4c-3021e22ba81c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:14:54 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-697a0cd1-fc2c-49e4-b502-1ea310004ea8 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caf957ff-f721-4311-a45e-8c913d8c88e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:14:54 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-697a0cd1-fc2c-49e4-b502-1ea310004ea8 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Volume e44b17e5-9a03-443e-a0f4-d151cd51472a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e44b17e5-9a03-443e-a0f4-d151cd51472a', 'volume_size': 1} Aug 10 16:14:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-697a0cd1-fc2c-49e4-b502-1ea310004ea8 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:14:54 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-d81b70da-6046-4534-b7e5-cf8d471bd2b3 tempest-CreateVolumesFromImageTest-582537208 None] Created reservations ['4185d2aa-b6dc-4f0b-909f-18d4dad9f9a4', '95771175-1ca8-46e3-ae92-8be563d3d116', '07ac9dc4-fffe-43b5-9e54-5f3fa70bcbf4', '878f8400-100f-43d6-89d3-c1172255ca88'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:14:54 devstack sudo[108038]: pam_unix(sudo:session): session closed for user root Aug 10 16:14:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-12f857f8-3f1b-492e-9dde-10c08925eb80 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c78aa51a-6580-461f-8ae2-f1000468c5fd_5m8vkjrjdevstack@QuobyteHD" returned: 0 in 0.566s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:14:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-12f857f8-3f1b-492e-9dde-10c08925eb80 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c78aa51a-6580-461f-8ae2-f1000468c5fd_5m8vkjrjdevstack@QuobyteHD {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:14:54 devstack sudo[108041]: pam_unix(sudo:session): session closed for user root Aug 10 16:14:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-54c666ee-04cc-4341-bdce-01aca0fc6c53 tempest-CreateVolumesFromSnapshotTest-1045154512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-60667d87-0e01-4a42-a1ba-6fdaae318cf2" returned: 0 in 0.379s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:14:54 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-54c666ee-04cc-4341-bdce-01aca0fc6c53 tempest-CreateVolumesFromSnapshotTest-1045154512 None] <== create_volume: return (1330ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:14:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-54c666ee-04cc-4341-bdce-01aca0fc6c53 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.334s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:14:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-868c33bf-e57a-4e53-bd8d-fb93569e18b6 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.797s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:14:54 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-868c33bf-e57a-4e53-bd8d-fb93569e18b6 tempest-CreateVolumesFromSnapshotTest-1045154512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:14:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1169521996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=585b4ad5-fe99-49c6-82f0-3eb088b49721,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9968a27b1d64b9ca715ae98e87583dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:14:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:14:54Z,use_quota=True,user_id='b5cabc3b7083421eb2f45121b9ac3836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:14:54 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-868c33bf-e57a-4e53-bd8d-fb93569e18b6 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Creating volume 585b4ad5-fe99-49c6-82f0-3eb088b49721 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:14:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-868c33bf-e57a-4e53-bd8d-fb93569e18b6 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:14:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-868c33bf-e57a-4e53-bd8d-fb93569e18b6 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:14:54 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-868c33bf-e57a-4e53-bd8d-fb93569e18b6 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:14:54 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-868c33bf-e57a-4e53-bd8d-fb93569e18b6 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:14:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-868c33bf-e57a-4e53-bd8d-fb93569e18b6 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:14:54 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-868c33bf-e57a-4e53-bd8d-fb93569e18b6 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:14:54 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-868c33bf-e57a-4e53-bd8d-fb93569e18b6 tempest-CreateVolumesFromSnapshotTest-1045154512 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:14:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-868c33bf-e57a-4e53-bd8d-fb93569e18b6 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-585b4ad5-fe99-49c6-82f0-3eb088b49721 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:14:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-d81b70da-6046-4534-b7e5-cf8d471bd2b3 tempest-CreateVolumesFromImageTest-582537208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:14:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-d81b70da-6046-4534-b7e5-cf8d471bd2b3 tempest-CreateVolumesFromImageTest-582537208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:14:54 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-d81b70da-6046-4534-b7e5-cf8d471bd2b3 tempest-CreateVolumesFromImageTest-582537208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:14:54 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-d81b70da-6046-4534-b7e5-cf8d471bd2b3 tempest-CreateVolumesFromImageTest-582537208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:14:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-d81b70da-6046-4534-b7e5-cf8d471bd2b3 tempest-CreateVolumesFromImageTest-582537208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:14:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d81b70da-6046-4534-b7e5-cf8d471bd2b3 tempest-CreateVolumesFromImageTest-582537208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:14:54 devstack sudo[108047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-585b4ad5-fe99-49c6-82f0-3eb088b49721 1073741824 Aug 10 16:14:54 devstack sudo[108047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:14:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-54c666ee-04cc-4341-bdce-01aca0fc6c53 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04350d21-9006-4e36-8d37-b75bf37c7ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60667d87-0e01-4a42-a1ba-6fdaae318cf2', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:14:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-54c666ee-04cc-4341-bdce-01aca0fc6c53 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c6a1610-0338-4409-8c6e-62204defbcec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:14:55 devstack sudo[108046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c78aa51a-6580-461f-8ae2-f1000468c5fd_5m8vkjrjdevstack@QuobyteHD Aug 10 16:14:55 devstack sudo[108046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:14:55 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-54c666ee-04cc-4341-bdce-01aca0fc6c53 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Volume volume-60667d87-0e01-4a42-a1ba-6fdaae318cf2 (60667d87-0e01-4a42-a1ba-6fdaae318cf2): created successfully Aug 10 16:14:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-54c666ee-04cc-4341-bdce-01aca0fc6c53 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c6a1610-0338-4409-8c6e-62204defbcec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:14:55 devstack sudo[108048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:14:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-54c666ee-04cc-4341-bdce-01aca0fc6c53 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Flow 'volume_create_manager' (e1e3579b-cd84-4aaf-8bdb-cd09e7f140b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:14:55 devstack sudo[108048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:14:55 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-54c666ee-04cc-4341-bdce-01aca0fc6c53 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Created volume successfully. Aug 10 16:14:55 devstack sudo[108046]: pam_unix(sudo:session): session closed for user root Aug 10 16:14:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-12f857f8-3f1b-492e-9dde-10c08925eb80 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c78aa51a-6580-461f-8ae2-f1000468c5fd_5m8vkjrjdevstack@QuobyteHD" returned: 1 in 0.495s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:14:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-12f857f8-3f1b-492e-9dde-10c08925eb80 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c78aa51a-6580-461f-8ae2-f1000468c5fd_5m8vkjrjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 10 16:14:55 devstack cinder-volume[88641]: DEBUG cinder.image.image_utils [None req-12f857f8-3f1b-492e-9dde-10c08925eb80 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] c78aa51a-6580-461f-8ae2-f1000468c5fd was raw, converting to qcow2 {{(pid=88641) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 10 16:14:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-12f857f8-3f1b-492e-9dde-10c08925eb80 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c78aa51a-6580-461f-8ae2-f1000468c5fd_5m8vkjrjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9ce95623-20e8-49bd-bbb8-c53f703f0a16 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:14:55 devstack sudo[108059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c78aa51a-6580-461f-8ae2-f1000468c5fd_5m8vkjrjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9ce95623-20e8-49bd-bbb8-c53f703f0a16 Aug 10 16:14:55 devstack sudo[108059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:14:55 devstack sudo[108048]: pam_unix(sudo:session): session closed for user root Aug 10 16:14:55 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb624bb7-d7f2-4cd1-b62d-7e179b9d1099 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:14:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-cb624bb7-d7f2-4cd1-b62d-7e179b9d1099 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Flow 'volume_create_manager' (0ae8095f-5b2a-40c4-b33b-d140c6ec989d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:14:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-cb624bb7-d7f2-4cd1-b62d-7e179b9d1099 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5ff3bcd-8372-4e90-a42e-c527f0eea0bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:14:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d81b70da-6046-4534-b7e5-cf8d471bd2b3 tempest-CreateVolumesFromImageTest-582537208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.526s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:14:55 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-d81b70da-6046-4534-b7e5-cf8d471bd2b3 tempest-CreateVolumesFromImageTest-582537208 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:14:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-cb624bb7-d7f2-4cd1-b62d-7e179b9d1099 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5ff3bcd-8372-4e90-a42e-c527f0eea0bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:14:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1148736405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dd6c758-3ca8-44cf-acfa-989ce801d3cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9968a27b1d64b9ca715ae98e87583dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:14:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:14:55Z,use_quota=True,user_id='b5cabc3b7083421eb2f45121b9ac3836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:14:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-cb624bb7-d7f2-4cd1-b62d-7e179b9d1099 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aa28efd-5241-4437-ae01-defc44d55198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:14:55 devstack sudo[108047]: pam_unix(sudo:session): session closed for user root Aug 10 16:14:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-cb624bb7-d7f2-4cd1-b62d-7e179b9d1099 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aa28efd-5241-4437-ae01-defc44d55198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:14:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-cb624bb7-d7f2-4cd1-b62d-7e179b9d1099 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30ff127d-1ec5-4e75-8a36-17bade171c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:14:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-cb624bb7-d7f2-4cd1-b62d-7e179b9d1099 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30ff127d-1ec5-4e75-8a36-17bade171c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3dd6c758-3ca8-44cf-acfa-989ce801d3cd', 'volume_name': 'volume-3dd6c758-3ca8-44cf-acfa-989ce801d3cd', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:14:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-cb624bb7-d7f2-4cd1-b62d-7e179b9d1099 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b26a856-264d-4d2b-ae10-f4898dcc2b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:14:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-cb624bb7-d7f2-4cd1-b62d-7e179b9d1099 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b26a856-264d-4d2b-ae10-f4898dcc2b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:14:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-cb624bb7-d7f2-4cd1-b62d-7e179b9d1099 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80960d81-0fdd-4549-bcf0-235ea3bf7090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:14:55 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-cb624bb7-d7f2-4cd1-b62d-7e179b9d1099 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Volume 3dd6c758-3ca8-44cf-acfa-989ce801d3cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3dd6c758-3ca8-44cf-acfa-989ce801d3cd', 'volume_size': 1} Aug 10 16:14:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-cb624bb7-d7f2-4cd1-b62d-7e179b9d1099 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:14:55 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-d81b70da-6046-4534-b7e5-cf8d471bd2b3 tempest-CreateVolumesFromImageTest-582537208 None] Deleted volume successfully. Aug 10 16:14:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-868c33bf-e57a-4e53-bd8d-fb93569e18b6 tempest-CreateVolumesFromSnapshotTest-1045154512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-585b4ad5-fe99-49c6-82f0-3eb088b49721 1073741824" returned: 0 in 0.656s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:14:55 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-d81b70da-6046-4534-b7e5-cf8d471bd2b3 tempest-CreateVolumesFromImageTest-582537208 None] Lock "cinder-be1a5ac0-ec43-4b46-a898-66851e202572-delete_volume" released by "delete_volume" :: held 2.353s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:14:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-868c33bf-e57a-4e53-bd8d-fb93569e18b6 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-585b4ad5-fe99-49c6-82f0-3eb088b49721 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:14:55 devstack sudo[108062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-585b4ad5-fe99-49c6-82f0-3eb088b49721 Aug 10 16:14:55 devstack sudo[108062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:14:55 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-4b7889bf-24a0-488b-a0a3-9b1255f5a24e tempest-CreateVolumesFromImageTest-582537208 None] Acquiring lock "cinder-153bb157-ed53-4ddf-bbb8-f116ad1d0e63-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:14:55 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-4b7889bf-24a0-488b-a0a3-9b1255f5a24e tempest-CreateVolumesFromImageTest-582537208 None] Lock "cinder-153bb157-ed53-4ddf-bbb8-f116ad1d0e63-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:14:56 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-4b7889bf-24a0-488b-a0a3-9b1255f5a24e tempest-CreateVolumesFromImageTest-582537208 None] Acquiring lock "cinder-quobyte-153bb157-ed53-4ddf-bbb8-f116ad1d0e63" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:14:56 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-4b7889bf-24a0-488b-a0a3-9b1255f5a24e tempest-CreateVolumesFromImageTest-582537208 None] Lock "cinder-quobyte-153bb157-ed53-4ddf-bbb8-f116ad1d0e63" acquired by "delete_volume" :: waited 0.025s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:14:56 devstack sudo[108062]: pam_unix(sudo:session): session closed for user root Aug 10 16:14:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-868c33bf-e57a-4e53-bd8d-fb93569e18b6 tempest-CreateVolumesFromSnapshotTest-1045154512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-585b4ad5-fe99-49c6-82f0-3eb088b49721" returned: 0 in 0.426s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:14:56 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-868c33bf-e57a-4e53-bd8d-fb93569e18b6 tempest-CreateVolumesFromSnapshotTest-1045154512 None] <== create_volume: return (1142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:14:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-868c33bf-e57a-4e53-bd8d-fb93569e18b6 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.149s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:14:56 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[26cd1904-5af1-41c3-8774-3fd5c20990cb]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:14:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-697a0cd1-fc2c-49e4-b502-1ea310004ea8 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.318s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:14:56 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-697a0cd1-fc2c-49e4-b502-1ea310004ea8 tempest-CreateVolumesFromSnapshotTest-1045154512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:14:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1780425494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e44b17e5-9a03-443e-a0f4-d151cd51472a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9968a27b1d64b9ca715ae98e87583dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:14:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:14:55Z,use_quota=True,user_id='b5cabc3b7083421eb2f45121b9ac3836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:14:56 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-697a0cd1-fc2c-49e4-b502-1ea310004ea8 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Creating volume e44b17e5-9a03-443e-a0f4-d151cd51472a {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:14:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-697a0cd1-fc2c-49e4-b502-1ea310004ea8 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:14:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-697a0cd1-fc2c-49e4-b502-1ea310004ea8 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:14:56 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-697a0cd1-fc2c-49e4-b502-1ea310004ea8 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:14:56 devstack sudo[108059]: pam_unix(sudo:session): session closed for user root Aug 10 16:14:56 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-697a0cd1-fc2c-49e4-b502-1ea310004ea8 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:14:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-697a0cd1-fc2c-49e4-b502-1ea310004ea8 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:14:56 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-697a0cd1-fc2c-49e4-b502-1ea310004ea8 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:14:56 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-697a0cd1-fc2c-49e4-b502-1ea310004ea8 tempest-CreateVolumesFromSnapshotTest-1045154512 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:14:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-697a0cd1-fc2c-49e4-b502-1ea310004ea8 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-e44b17e5-9a03-443e-a0f4-d151cd51472a 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:14:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4b7889bf-24a0-488b-a0a3-9b1255f5a24e tempest-CreateVolumesFromImageTest-582537208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-153bb157-ed53-4ddf-bbb8-f116ad1d0e63 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:14:56 devstack sudo[108069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-e44b17e5-9a03-443e-a0f4-d151cd51472a 1073741824 Aug 10 16:14:56 devstack sudo[108069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:14:56 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-c80c4a1e-f75d-4b3d-8686-8db490d5b7a3 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:14:56 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c80c4a1e-f75d-4b3d-8686-8db490d5b7a3 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Flow 'volume_create_manager' (db3c6996-74b8-448f-be4c-5ec4332efec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:14:56 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c80c4a1e-f75d-4b3d-8686-8db490d5b7a3 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e1d1798-2bb7-4945-8dce-51760206b8ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:14:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-12f857f8-3f1b-492e-9dde-10c08925eb80 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c78aa51a-6580-461f-8ae2-f1000468c5fd_5m8vkjrjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9ce95623-20e8-49bd-bbb8-c53f703f0a16" returned: 0 in 0.865s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:14:56 devstack cinder-volume[88641]: DEBUG cinder.image.image_utils [None req-12f857f8-3f1b-492e-9dde-10c08925eb80 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c78aa51a-6580-461f-8ae2-f1000468c5fd_5m8vkjrjdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9ce95623-20e8-49bd-bbb8-c53f703f0a16 {{(pid=88641) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 10 16:14:56 devstack cinder-volume[88641]: INFO cinder.image.image_utils [None req-12f857f8-3f1b-492e-9dde-10c08925eb80 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] Converted 0.00 MB image at 0.00 MB/s Aug 10 16:14:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-12f857f8-3f1b-492e-9dde-10c08925eb80 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9ce95623-20e8-49bd-bbb8-c53f703f0a16 1G {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:14:56 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-868c33bf-e57a-4e53-bd8d-fb93569e18b6 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (010d32e8-34ce-4706-9504-655f87ed566a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-585b4ad5-fe99-49c6-82f0-3eb088b49721', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:14:56 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-868c33bf-e57a-4e53-bd8d-fb93569e18b6 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e4fa264-b059-49a7-8641-c97251145c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:14:56 devstack sudo[108072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9ce95623-20e8-49bd-bbb8-c53f703f0a16 1G Aug 10 16:14:56 devstack sudo[108072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:14:56 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c80c4a1e-f75d-4b3d-8686-8db490d5b7a3 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e1d1798-2bb7-4945-8dce-51760206b8ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:14:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1227804795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=612e7f08-2c55-41bd-aeee-ef60a7a9b3ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9968a27b1d64b9ca715ae98e87583dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:14:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:14:56Z,use_quota=True,user_id='b5cabc3b7083421eb2f45121b9ac3836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:14:56 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c80c4a1e-f75d-4b3d-8686-8db490d5b7a3 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8be39356-38f9-4b8c-a574-cec06b687f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:14:56 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c80c4a1e-f75d-4b3d-8686-8db490d5b7a3 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8be39356-38f9-4b8c-a574-cec06b687f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:14:56 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c80c4a1e-f75d-4b3d-8686-8db490d5b7a3 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (325c4aec-d3cf-4fa4-9be0-dae27ca61e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:14:56 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c80c4a1e-f75d-4b3d-8686-8db490d5b7a3 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (325c4aec-d3cf-4fa4-9be0-dae27ca61e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '612e7f08-2c55-41bd-aeee-ef60a7a9b3ce', 'volume_name': 'volume-612e7f08-2c55-41bd-aeee-ef60a7a9b3ce', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:14:56 devstack sudo[108070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-153bb157-ed53-4ddf-bbb8-f116ad1d0e63 Aug 10 16:14:56 devstack sudo[108070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:14:56 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c80c4a1e-f75d-4b3d-8686-8db490d5b7a3 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (545d442f-af88-469a-9579-b5626e271ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:14:56 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c80c4a1e-f75d-4b3d-8686-8db490d5b7a3 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (545d442f-af88-469a-9579-b5626e271ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:14:56 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c80c4a1e-f75d-4b3d-8686-8db490d5b7a3 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90e81cbe-9f97-45a7-8b73-a16b9db4ee1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:14:56 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-c80c4a1e-f75d-4b3d-8686-8db490d5b7a3 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Volume 612e7f08-2c55-41bd-aeee-ef60a7a9b3ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-612e7f08-2c55-41bd-aeee-ef60a7a9b3ce', 'volume_size': 1} Aug 10 16:14:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-c80c4a1e-f75d-4b3d-8686-8db490d5b7a3 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:14:56 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-868c33bf-e57a-4e53-bd8d-fb93569e18b6 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Volume volume-585b4ad5-fe99-49c6-82f0-3eb088b49721 (585b4ad5-fe99-49c6-82f0-3eb088b49721): created successfully Aug 10 16:14:56 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-868c33bf-e57a-4e53-bd8d-fb93569e18b6 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e4fa264-b059-49a7-8641-c97251145c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:14:56 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-868c33bf-e57a-4e53-bd8d-fb93569e18b6 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Flow 'volume_create_manager' (1effd6f1-9a40-4fb1-a2d9-6b72cb524b27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:14:56 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-868c33bf-e57a-4e53-bd8d-fb93569e18b6 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Created volume successfully. Aug 10 16:14:56 devstack sudo[108072]: pam_unix(sudo:session): session closed for user root Aug 10 16:14:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-12f857f8-3f1b-492e-9dde-10c08925eb80 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9ce95623-20e8-49bd-bbb8-c53f703f0a16 1G" returned: 0 in 0.413s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:14:56 devstack cinder-volume[88641]: DEBUG cinder.volume.volume_utils [None req-12f857f8-3f1b-492e-9dde-10c08925eb80 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] Downloaded image c78aa51a-6580-461f-8ae2-f1000468c5fd ((None, [{'url': 'file:///opt/stack/data/glance/images/c78aa51a-6580-461f-8ae2-f1000468c5fd', 'metadata': {}}])) to volume 9ce95623-20e8-49bd-bbb8-c53f703f0a16 successfully. {{(pid=88641) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 10 16:14:56 devstack cinder-volume[88641]: DEBUG cinder.image.image_utils [None req-12f857f8-3f1b-492e-9dde-10c08925eb80 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] Temporary image c78aa51a-6580-461f-8ae2-f1000468c5fd for user 82086b027a0344faa5cb5d00231b73e3 is deleted. {{(pid=88641) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 10 16:14:56 devstack cinder-volume[88641]: DEBUG cinder.volume.volume_utils [None req-12f857f8-3f1b-492e-9dde-10c08925eb80 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] Marking volume 9ce95623-20e8-49bd-bbb8-c53f703f0a16 as bootable. {{(pid=88641) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 10 16:14:56 devstack sudo[108069]: pam_unix(sudo:session): session closed for user root Aug 10 16:14:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-697a0cd1-fc2c-49e4-b502-1ea310004ea8 tempest-CreateVolumesFromSnapshotTest-1045154512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-e44b17e5-9a03-443e-a0f4-d151cd51472a 1073741824" returned: 0 in 0.544s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:14:56 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-12f857f8-3f1b-492e-9dde-10c08925eb80 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] Copying metadata from image c78aa51a-6580-461f-8ae2-f1000468c5fd to 9ce95623-20e8-49bd-bbb8-c53f703f0a16. {{(pid=88641) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 10 16:14:56 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-12f857f8-3f1b-492e-9dde-10c08925eb80 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] Creating volume glance metadata for volume 9ce95623-20e8-49bd-bbb8-c53f703f0a16 backed by image c78aa51a-6580-461f-8ae2-f1000468c5fd with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'c78aa51a-6580-461f-8ae2-f1000468c5fd', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '79bbaa20c1bb48f1a01c191114d69611', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88641) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 10 16:14:56 devstack sudo[108070]: pam_unix(sudo:session): session closed for user root Aug 10 16:14:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4b7889bf-24a0-488b-a0a3-9b1255f5a24e tempest-CreateVolumesFromImageTest-582537208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-153bb157-ed53-4ddf-bbb8-f116ad1d0e63" returned: 0 in 0.566s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:14:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4b7889bf-24a0-488b-a0a3-9b1255f5a24e tempest-CreateVolumesFromImageTest-582537208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-153bb157-ed53-4ddf-bbb8-f116ad1d0e63 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:14:56 devstack sudo[108086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-153bb157-ed53-4ddf-bbb8-f116ad1d0e63 Aug 10 16:14:56 devstack sudo[108086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:14:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-697a0cd1-fc2c-49e4-b502-1ea310004ea8 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-e44b17e5-9a03-443e-a0f4-d151cd51472a {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:14:56 devstack sudo[108088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-e44b17e5-9a03-443e-a0f4-d151cd51472a Aug 10 16:14:56 devstack sudo[108088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:14:56 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-12f857f8-3f1b-492e-9dde-10c08925eb80 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8b732bc-feff-4047-a6ce-cb4d9d1fe936) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ce95623-20e8-49bd-bbb8-c53f703f0a16', 'volume_size': 1, 'image_id': 'c78aa51a-6580-461f-8ae2-f1000468c5fd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c78aa51a-6580-461f-8ae2-f1000468c5fd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '79bbaa20c1bb48f1a01c191114d69611', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6eca3ac77cd140e9a5f5f80010599108', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4ae2f35bb2a885323dbcf63ba53fc201a965b72a3e85e4a369c4359370e71a7d4e6e0f10e2132a68a0ea8cbab2f9bbd2aba50d76075b95e339b73e2bea4e9cdf', 'id': 'c78aa51a-6580-461f-8ae2-f1000468c5fd', 'created_at': datetime.datetime(2026, 8, 10, 14, 14, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 10, 14, 14, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c78aa51a-6580-461f-8ae2-f1000468c5fd/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:14:56 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-12f857f8-3f1b-492e-9dde-10c08925eb80 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5803c375-ae65-46db-a58e-7c12a5b4d92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:14:56 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-12f857f8-3f1b-492e-9dde-10c08925eb80 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] Volume volume-9ce95623-20e8-49bd-bbb8-c53f703f0a16 (9ce95623-20e8-49bd-bbb8-c53f703f0a16): created successfully Aug 10 16:14:56 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-12f857f8-3f1b-492e-9dde-10c08925eb80 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5803c375-ae65-46db-a58e-7c12a5b4d92c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:14:56 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-12f857f8-3f1b-492e-9dde-10c08925eb80 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] Flow 'volume_create_manager' (a3ddfb9d-f3c9-4798-a16f-dba7821aa205) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:14:56 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-12f857f8-3f1b-492e-9dde-10c08925eb80 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] Created volume successfully. Aug 10 16:14:56 devstack sudo[108086]: pam_unix(sudo:session): session closed for user root Aug 10 16:14:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4b7889bf-24a0-488b-a0a3-9b1255f5a24e tempest-CreateVolumesFromImageTest-582537208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-153bb157-ed53-4ddf-bbb8-f116ad1d0e63" returned: 0 in 0.323s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:14:57 devstack sudo[108088]: pam_unix(sudo:session): session closed for user root Aug 10 16:14:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-697a0cd1-fc2c-49e4-b502-1ea310004ea8 tempest-CreateVolumesFromSnapshotTest-1045154512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-e44b17e5-9a03-443e-a0f4-d151cd51472a" returned: 0 in 0.306s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:14:57 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-697a0cd1-fc2c-49e4-b502-1ea310004ea8 tempest-CreateVolumesFromSnapshotTest-1045154512 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:14:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-697a0cd1-fc2c-49e4-b502-1ea310004ea8 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:14:57 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-4b7889bf-24a0-488b-a0a3-9b1255f5a24e tempest-CreateVolumesFromImageTest-582537208 None] Lock "cinder-quobyte-153bb157-ed53-4ddf-bbb8-f116ad1d0e63" released by "delete_volume" :: held 0.986s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:14:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-cb624bb7-d7f2-4cd1-b62d-7e179b9d1099 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.446s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:14:57 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-cb624bb7-d7f2-4cd1-b62d-7e179b9d1099 tempest-CreateVolumesFromSnapshotTest-1045154512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:14:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1148736405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dd6c758-3ca8-44cf-acfa-989ce801d3cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9968a27b1d64b9ca715ae98e87583dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:14:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:14:55Z,use_quota=True,user_id='b5cabc3b7083421eb2f45121b9ac3836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:14:57 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-cb624bb7-d7f2-4cd1-b62d-7e179b9d1099 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Creating volume 3dd6c758-3ca8-44cf-acfa-989ce801d3cd {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:14:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-cb624bb7-d7f2-4cd1-b62d-7e179b9d1099 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:14:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-cb624bb7-d7f2-4cd1-b62d-7e179b9d1099 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:14:57 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-cb624bb7-d7f2-4cd1-b62d-7e179b9d1099 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:14:57 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-cb624bb7-d7f2-4cd1-b62d-7e179b9d1099 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:14:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-cb624bb7-d7f2-4cd1-b62d-7e179b9d1099 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:14:57 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-cb624bb7-d7f2-4cd1-b62d-7e179b9d1099 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:14:57 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-cb624bb7-d7f2-4cd1-b62d-7e179b9d1099 tempest-CreateVolumesFromSnapshotTest-1045154512 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:14:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-cb624bb7-d7f2-4cd1-b62d-7e179b9d1099 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3dd6c758-3ca8-44cf-acfa-989ce801d3cd 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:14:57 devstack sudo[108092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3dd6c758-3ca8-44cf-acfa-989ce801d3cd 1073741824 Aug 10 16:14:57 devstack sudo[108092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:14:57 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-697a0cd1-fc2c-49e4-b502-1ea310004ea8 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caf957ff-f721-4311-a45e-8c913d8c88e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e44b17e5-9a03-443e-a0f4-d151cd51472a', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:14:57 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-697a0cd1-fc2c-49e4-b502-1ea310004ea8 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b036e3f-6323-4ee7-a1da-ebfb1341005a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:14:57 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-697a0cd1-fc2c-49e4-b502-1ea310004ea8 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Volume volume-e44b17e5-9a03-443e-a0f4-d151cd51472a (e44b17e5-9a03-443e-a0f4-d151cd51472a): created successfully Aug 10 16:14:57 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-697a0cd1-fc2c-49e4-b502-1ea310004ea8 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b036e3f-6323-4ee7-a1da-ebfb1341005a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:14:57 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-697a0cd1-fc2c-49e4-b502-1ea310004ea8 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Flow 'volume_create_manager' (cd084918-48a1-4bc4-af8c-7c73ad87d3b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:14:57 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-697a0cd1-fc2c-49e4-b502-1ea310004ea8 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Created volume successfully. Aug 10 16:14:57 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-4b7889bf-24a0-488b-a0a3-9b1255f5a24e tempest-CreateVolumesFromImageTest-582537208 None] Created reservations ['36652ad8-06d1-42b1-8951-56a639d93389', '40cf8119-2a9f-4391-9d3d-cadaa4e60314', 'c79e8a23-d439-4b50-a4f7-db194eab2699', '371b6ba6-451b-4aca-9e56-4d21fdfa3666'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:14:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-4b7889bf-24a0-488b-a0a3-9b1255f5a24e tempest-CreateVolumesFromImageTest-582537208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:14:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-4b7889bf-24a0-488b-a0a3-9b1255f5a24e tempest-CreateVolumesFromImageTest-582537208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:14:57 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-4b7889bf-24a0-488b-a0a3-9b1255f5a24e tempest-CreateVolumesFromImageTest-582537208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:14:57 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-4b7889bf-24a0-488b-a0a3-9b1255f5a24e tempest-CreateVolumesFromImageTest-582537208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:14:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-4b7889bf-24a0-488b-a0a3-9b1255f5a24e tempest-CreateVolumesFromImageTest-582537208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:14:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4b7889bf-24a0-488b-a0a3-9b1255f5a24e tempest-CreateVolumesFromImageTest-582537208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:14:57 devstack sudo[108094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:14:57 devstack sudo[108094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:14:57 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-047ecfed-eb70-47a7-8260-64c27b0c6902 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] Acquiring lock "cinder-9ce95623-20e8-49bd-bbb8-c53f703f0a16-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:14:57 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-047ecfed-eb70-47a7-8260-64c27b0c6902 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] Lock "cinder-9ce95623-20e8-49bd-bbb8-c53f703f0a16-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:14:57 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-047ecfed-eb70-47a7-8260-64c27b0c6902 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] Acquiring lock "cinder-quobyte-9ce95623-20e8-49bd-bbb8-c53f703f0a16" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:14:57 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-047ecfed-eb70-47a7-8260-64c27b0c6902 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] Lock "cinder-quobyte-9ce95623-20e8-49bd-bbb8-c53f703f0a16" acquired by "delete_volume" :: waited 0.023s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:14:57 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[f87f4275-956b-400e-8e71-2cbd6bc2cf6e]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:14:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-047ecfed-eb70-47a7-8260-64c27b0c6902 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9ce95623-20e8-49bd-bbb8-c53f703f0a16 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:14:57 devstack sudo[108092]: pam_unix(sudo:session): session closed for user root Aug 10 16:14:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-cb624bb7-d7f2-4cd1-b62d-7e179b9d1099 tempest-CreateVolumesFromSnapshotTest-1045154512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3dd6c758-3ca8-44cf-acfa-989ce801d3cd 1073741824" returned: 0 in 0.556s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:14:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-cb624bb7-d7f2-4cd1-b62d-7e179b9d1099 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3dd6c758-3ca8-44cf-acfa-989ce801d3cd {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:14:57 devstack sudo[108094]: pam_unix(sudo:session): session closed for user root Aug 10 16:14:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4b7889bf-24a0-488b-a0a3-9b1255f5a24e tempest-CreateVolumesFromImageTest-582537208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.380s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:14:57 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-4b7889bf-24a0-488b-a0a3-9b1255f5a24e tempest-CreateVolumesFromImageTest-582537208 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:14:57 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-4b7889bf-24a0-488b-a0a3-9b1255f5a24e tempest-CreateVolumesFromImageTest-582537208 None] Deleted volume successfully. Aug 10 16:14:57 devstack sudo[108100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9ce95623-20e8-49bd-bbb8-c53f703f0a16 Aug 10 16:14:57 devstack sudo[108102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3dd6c758-3ca8-44cf-acfa-989ce801d3cd Aug 10 16:14:57 devstack sudo[108100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:14:57 devstack sudo[108102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:14:57 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-4b7889bf-24a0-488b-a0a3-9b1255f5a24e tempest-CreateVolumesFromImageTest-582537208 None] Lock "cinder-153bb157-ed53-4ddf-bbb8-f116ad1d0e63-delete_volume" released by "delete_volume" :: held 1.790s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:14:57 devstack sudo[108102]: pam_unix(sudo:session): session closed for user root Aug 10 16:14:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-cb624bb7-d7f2-4cd1-b62d-7e179b9d1099 tempest-CreateVolumesFromSnapshotTest-1045154512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3dd6c758-3ca8-44cf-acfa-989ce801d3cd" returned: 0 in 0.292s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:14:57 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-cb624bb7-d7f2-4cd1-b62d-7e179b9d1099 tempest-CreateVolumesFromSnapshotTest-1045154512 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:14:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-cb624bb7-d7f2-4cd1-b62d-7e179b9d1099 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:14:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-c80c4a1e-f75d-4b3d-8686-8db490d5b7a3 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.600s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:14:57 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-c80c4a1e-f75d-4b3d-8686-8db490d5b7a3 tempest-CreateVolumesFromSnapshotTest-1045154512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:14:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1227804795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=612e7f08-2c55-41bd-aeee-ef60a7a9b3ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9968a27b1d64b9ca715ae98e87583dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:14:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:14:56Z,use_quota=True,user_id='b5cabc3b7083421eb2f45121b9ac3836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:14:57 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-c80c4a1e-f75d-4b3d-8686-8db490d5b7a3 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Creating volume 612e7f08-2c55-41bd-aeee-ef60a7a9b3ce {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:14:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-c80c4a1e-f75d-4b3d-8686-8db490d5b7a3 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:14:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-c80c4a1e-f75d-4b3d-8686-8db490d5b7a3 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:14:57 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-c80c4a1e-f75d-4b3d-8686-8db490d5b7a3 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:14:57 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-c80c4a1e-f75d-4b3d-8686-8db490d5b7a3 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:14:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-c80c4a1e-f75d-4b3d-8686-8db490d5b7a3 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:14:57 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-c80c4a1e-f75d-4b3d-8686-8db490d5b7a3 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:14:57 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-c80c4a1e-f75d-4b3d-8686-8db490d5b7a3 tempest-CreateVolumesFromSnapshotTest-1045154512 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:14:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c80c4a1e-f75d-4b3d-8686-8db490d5b7a3 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-612e7f08-2c55-41bd-aeee-ef60a7a9b3ce 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:14:57 devstack sudo[108100]: pam_unix(sudo:session): session closed for user root Aug 10 16:14:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-047ecfed-eb70-47a7-8260-64c27b0c6902 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9ce95623-20e8-49bd-bbb8-c53f703f0a16" returned: 0 in 0.412s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:14:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-047ecfed-eb70-47a7-8260-64c27b0c6902 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9ce95623-20e8-49bd-bbb8-c53f703f0a16 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:14:57 devstack sudo[108109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-612e7f08-2c55-41bd-aeee-ef60a7a9b3ce 1073741824 Aug 10 16:14:57 devstack sudo[108109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:14:57 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-cb624bb7-d7f2-4cd1-b62d-7e179b9d1099 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80960d81-0fdd-4549-bcf0-235ea3bf7090) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3dd6c758-3ca8-44cf-acfa-989ce801d3cd', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:14:57 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-cb624bb7-d7f2-4cd1-b62d-7e179b9d1099 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (984a458b-038c-49b1-9691-bc4637eaad85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:14:57 devstack sudo[108110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9ce95623-20e8-49bd-bbb8-c53f703f0a16 Aug 10 16:14:57 devstack sudo[108110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:14:58 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-cb624bb7-d7f2-4cd1-b62d-7e179b9d1099 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Volume volume-3dd6c758-3ca8-44cf-acfa-989ce801d3cd (3dd6c758-3ca8-44cf-acfa-989ce801d3cd): created successfully Aug 10 16:14:58 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-cb624bb7-d7f2-4cd1-b62d-7e179b9d1099 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (984a458b-038c-49b1-9691-bc4637eaad85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:14:58 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-cb624bb7-d7f2-4cd1-b62d-7e179b9d1099 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Flow 'volume_create_manager' (0ae8095f-5b2a-40c4-b33b-d140c6ec989d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:14:58 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-cb624bb7-d7f2-4cd1-b62d-7e179b9d1099 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Created volume successfully. Aug 10 16:14:58 devstack sudo[108110]: pam_unix(sudo:session): session closed for user root Aug 10 16:14:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-047ecfed-eb70-47a7-8260-64c27b0c6902 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9ce95623-20e8-49bd-bbb8-c53f703f0a16" returned: 0 in 0.314s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:14:58 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-047ecfed-eb70-47a7-8260-64c27b0c6902 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] Lock "cinder-quobyte-9ce95623-20e8-49bd-bbb8-c53f703f0a16" released by "delete_volume" :: held 0.783s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:14:58 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-047ecfed-eb70-47a7-8260-64c27b0c6902 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] Created reservations ['d88c4e3f-b3d8-46dc-aa60-cabc85ad0b8a', '206f4354-6bf6-4ac6-b700-3d8b7bb42833', 'cc21a266-82ea-4e28-bc9f-c64550b79a27', '6c2f7749-5b50-41d8-9b83-94b8a04f252e'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:14:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-047ecfed-eb70-47a7-8260-64c27b0c6902 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:14:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-047ecfed-eb70-47a7-8260-64c27b0c6902 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:14:58 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-047ecfed-eb70-47a7-8260-64c27b0c6902 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:14:58 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-047ecfed-eb70-47a7-8260-64c27b0c6902 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:14:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-047ecfed-eb70-47a7-8260-64c27b0c6902 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:14:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-047ecfed-eb70-47a7-8260-64c27b0c6902 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:14:58 devstack sudo[108151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:14:58 devstack sudo[108151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:14:58 devstack sudo[108109]: pam_unix(sudo:session): session closed for user root Aug 10 16:14:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c80c4a1e-f75d-4b3d-8686-8db490d5b7a3 tempest-CreateVolumesFromSnapshotTest-1045154512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-612e7f08-2c55-41bd-aeee-ef60a7a9b3ce 1073741824" returned: 0 in 0.622s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:14:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c80c4a1e-f75d-4b3d-8686-8db490d5b7a3 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-612e7f08-2c55-41bd-aeee-ef60a7a9b3ce {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:14:58 devstack sudo[108153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-612e7f08-2c55-41bd-aeee-ef60a7a9b3ce Aug 10 16:14:58 devstack sudo[108153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:14:58 devstack sudo[108151]: pam_unix(sudo:session): session closed for user root Aug 10 16:14:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-047ecfed-eb70-47a7-8260-64c27b0c6902 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.464s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:14:58 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-047ecfed-eb70-47a7-8260-64c27b0c6902 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:14:58 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-047ecfed-eb70-47a7-8260-64c27b0c6902 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] Deleted volume successfully. Aug 10 16:14:59 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-047ecfed-eb70-47a7-8260-64c27b0c6902 tempest-VolumeAndVolumeTypeFromImageTest-1165060628 None] Lock "cinder-9ce95623-20e8-49bd-bbb8-c53f703f0a16-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:14:59 devstack sudo[108153]: pam_unix(sudo:session): session closed for user root Aug 10 16:14:59 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c80c4a1e-f75d-4b3d-8686-8db490d5b7a3 tempest-CreateVolumesFromSnapshotTest-1045154512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-612e7f08-2c55-41bd-aeee-ef60a7a9b3ce" returned: 0 in 0.548s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:14:59 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-c80c4a1e-f75d-4b3d-8686-8db490d5b7a3 tempest-CreateVolumesFromSnapshotTest-1045154512 None] <== create_volume: return (1249ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:14:59 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-c80c4a1e-f75d-4b3d-8686-8db490d5b7a3 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.251s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:14:59 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c80c4a1e-f75d-4b3d-8686-8db490d5b7a3 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90e81cbe-9f97-45a7-8b73-a16b9db4ee1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-612e7f08-2c55-41bd-aeee-ef60a7a9b3ce', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:14:59 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c80c4a1e-f75d-4b3d-8686-8db490d5b7a3 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (707a787c-d2b0-4809-a592-6e79d31872f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:14:59 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-c80c4a1e-f75d-4b3d-8686-8db490d5b7a3 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Volume volume-612e7f08-2c55-41bd-aeee-ef60a7a9b3ce (612e7f08-2c55-41bd-aeee-ef60a7a9b3ce): created successfully Aug 10 16:14:59 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c80c4a1e-f75d-4b3d-8686-8db490d5b7a3 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (707a787c-d2b0-4809-a592-6e79d31872f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:14:59 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c80c4a1e-f75d-4b3d-8686-8db490d5b7a3 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Flow 'volume_create_manager' (db3c6996-74b8-448f-be4c-5ec4332efec2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:14:59 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-c80c4a1e-f75d-4b3d-8686-8db490d5b7a3 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Created volume successfully. Aug 10 16:14:59 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-9d3d6eef-bae5-48d6-ac43-3f6f3fa1361d tempest-CreateVolumesFromSnapshotTest-1045154512 None] Acquiring lock "cinder-612e7f08-2c55-41bd-aeee-ef60a7a9b3ce-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:14:59 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-9d3d6eef-bae5-48d6-ac43-3f6f3fa1361d tempest-CreateVolumesFromSnapshotTest-1045154512 None] Lock "cinder-612e7f08-2c55-41bd-aeee-ef60a7a9b3ce-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:14:59 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-9d3d6eef-bae5-48d6-ac43-3f6f3fa1361d tempest-CreateVolumesFromSnapshotTest-1045154512 None] Acquiring lock "cinder-quobyte-612e7f08-2c55-41bd-aeee-ef60a7a9b3ce" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:14:59 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-9d3d6eef-bae5-48d6-ac43-3f6f3fa1361d tempest-CreateVolumesFromSnapshotTest-1045154512 None] Lock "cinder-quobyte-612e7f08-2c55-41bd-aeee-ef60a7a9b3ce" acquired by "delete_volume" :: waited 0.041s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:14:59 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[67160f5c-9ace-4561-b04b-eceef339ce70]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:14:59 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9d3d6eef-bae5-48d6-ac43-3f6f3fa1361d tempest-CreateVolumesFromSnapshotTest-1045154512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-612e7f08-2c55-41bd-aeee-ef60a7a9b3ce {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:14:59 devstack sudo[108159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-612e7f08-2c55-41bd-aeee-ef60a7a9b3ce Aug 10 16:14:59 devstack sudo[108159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:00 devstack sudo[108159]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9d3d6eef-bae5-48d6-ac43-3f6f3fa1361d tempest-CreateVolumesFromSnapshotTest-1045154512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-612e7f08-2c55-41bd-aeee-ef60a7a9b3ce" returned: 0 in 0.485s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9d3d6eef-bae5-48d6-ac43-3f6f3fa1361d tempest-CreateVolumesFromSnapshotTest-1045154512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-612e7f08-2c55-41bd-aeee-ef60a7a9b3ce {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:00 devstack sudo[108164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-612e7f08-2c55-41bd-aeee-ef60a7a9b3ce Aug 10 16:15:00 devstack sudo[108164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:00 devstack sudo[108164]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9d3d6eef-bae5-48d6-ac43-3f6f3fa1361d tempest-CreateVolumesFromSnapshotTest-1045154512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-612e7f08-2c55-41bd-aeee-ef60a7a9b3ce" returned: 0 in 0.360s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:00 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-9d3d6eef-bae5-48d6-ac43-3f6f3fa1361d tempest-CreateVolumesFromSnapshotTest-1045154512 None] Lock "cinder-quobyte-612e7f08-2c55-41bd-aeee-ef60a7a9b3ce" released by "delete_volume" :: held 0.905s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:15:00 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-9d3d6eef-bae5-48d6-ac43-3f6f3fa1361d tempest-CreateVolumesFromSnapshotTest-1045154512 None] Created reservations ['464ee215-5c35-4b79-bbf6-406964faefaa', '33f019f7-a9fd-4f97-bde5-ac7c534c02e8', 'a8ca5b55-5a72-48b8-8516-69c3fb5831b9', 'e15a0b66-b74e-4f37-b95f-700a2abad524'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:15:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-9d3d6eef-bae5-48d6-ac43-3f6f3fa1361d tempest-CreateVolumesFromSnapshotTest-1045154512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:15:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-9d3d6eef-bae5-48d6-ac43-3f6f3fa1361d tempest-CreateVolumesFromSnapshotTest-1045154512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:15:00 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-9d3d6eef-bae5-48d6-ac43-3f6f3fa1361d tempest-CreateVolumesFromSnapshotTest-1045154512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:15:00 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-9d3d6eef-bae5-48d6-ac43-3f6f3fa1361d tempest-CreateVolumesFromSnapshotTest-1045154512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:15:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-9d3d6eef-bae5-48d6-ac43-3f6f3fa1361d tempest-CreateVolumesFromSnapshotTest-1045154512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:15:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9d3d6eef-bae5-48d6-ac43-3f6f3fa1361d tempest-CreateVolumesFromSnapshotTest-1045154512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:00 devstack sudo[108167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:15:00 devstack sudo[108167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:01 devstack sudo[108167]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:01 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9d3d6eef-bae5-48d6-ac43-3f6f3fa1361d tempest-CreateVolumesFromSnapshotTest-1045154512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.326s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:01 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-9d3d6eef-bae5-48d6-ac43-3f6f3fa1361d tempest-CreateVolumesFromSnapshotTest-1045154512 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:15:01 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-9d3d6eef-bae5-48d6-ac43-3f6f3fa1361d tempest-CreateVolumesFromSnapshotTest-1045154512 None] Deleted volume successfully. Aug 10 16:15:01 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-9d3d6eef-bae5-48d6-ac43-3f6f3fa1361d tempest-CreateVolumesFromSnapshotTest-1045154512 None] Lock "cinder-612e7f08-2c55-41bd-aeee-ef60a7a9b3ce-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:15:01 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-4c94d99c-b6da-43b0-81ca-4c1686e3d617 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Acquiring lock "cinder-3dd6c758-3ca8-44cf-acfa-989ce801d3cd-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:15:01 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-4c94d99c-b6da-43b0-81ca-4c1686e3d617 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Lock "cinder-3dd6c758-3ca8-44cf-acfa-989ce801d3cd-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:15:01 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-4c94d99c-b6da-43b0-81ca-4c1686e3d617 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Acquiring lock "cinder-quobyte-3dd6c758-3ca8-44cf-acfa-989ce801d3cd" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:15:01 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-4c94d99c-b6da-43b0-81ca-4c1686e3d617 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Lock "cinder-quobyte-3dd6c758-3ca8-44cf-acfa-989ce801d3cd" acquired by "delete_volume" :: waited 0.019s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:15:01 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d650c20-3310-4e20-afdf-d7a00eb89923]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:15:01 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4c94d99c-b6da-43b0-81ca-4c1686e3d617 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3dd6c758-3ca8-44cf-acfa-989ce801d3cd {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:02 devstack sudo[108173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3dd6c758-3ca8-44cf-acfa-989ce801d3cd Aug 10 16:15:02 devstack sudo[108173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:02 devstack sudo[108173]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4c94d99c-b6da-43b0-81ca-4c1686e3d617 tempest-CreateVolumesFromSnapshotTest-1045154512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3dd6c758-3ca8-44cf-acfa-989ce801d3cd" returned: 0 in 0.459s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4c94d99c-b6da-43b0-81ca-4c1686e3d617 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3dd6c758-3ca8-44cf-acfa-989ce801d3cd {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:02 devstack sudo[108179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3dd6c758-3ca8-44cf-acfa-989ce801d3cd Aug 10 16:15:02 devstack sudo[108179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:02 devstack sudo[108179]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4c94d99c-b6da-43b0-81ca-4c1686e3d617 tempest-CreateVolumesFromSnapshotTest-1045154512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3dd6c758-3ca8-44cf-acfa-989ce801d3cd" returned: 0 in 0.343s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:02 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-4c94d99c-b6da-43b0-81ca-4c1686e3d617 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Lock "cinder-quobyte-3dd6c758-3ca8-44cf-acfa-989ce801d3cd" released by "delete_volume" :: held 0.875s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:15:02 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-4c94d99c-b6da-43b0-81ca-4c1686e3d617 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Created reservations ['9f3a1ee9-0102-47b0-8db7-2333e8614091', '8bf7a33d-715c-489f-b295-02792074e177', 'a33c1f6e-aa91-4a93-8c8b-eb8a11ff0f70', '484ae34f-f623-488d-8934-f2b1b1565976'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:15:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-4c94d99c-b6da-43b0-81ca-4c1686e3d617 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:15:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-4c94d99c-b6da-43b0-81ca-4c1686e3d617 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:15:03 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-4c94d99c-b6da-43b0-81ca-4c1686e3d617 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:15:03 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-4c94d99c-b6da-43b0-81ca-4c1686e3d617 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:15:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-4c94d99c-b6da-43b0-81ca-4c1686e3d617 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:15:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4c94d99c-b6da-43b0-81ca-4c1686e3d617 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:03 devstack sudo[108182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:15:03 devstack sudo[108182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:03 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-99545d6e-30fe-4239-b43e-5de4823d51e0 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Acquiring lock "cinder-e44b17e5-9a03-443e-a0f4-d151cd51472a-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:15:03 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-99545d6e-30fe-4239-b43e-5de4823d51e0 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Lock "cinder-e44b17e5-9a03-443e-a0f4-d151cd51472a-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:15:03 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-99545d6e-30fe-4239-b43e-5de4823d51e0 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Acquiring lock "cinder-quobyte-e44b17e5-9a03-443e-a0f4-d151cd51472a" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:15:03 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-99545d6e-30fe-4239-b43e-5de4823d51e0 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Lock "cinder-quobyte-e44b17e5-9a03-443e-a0f4-d151cd51472a" acquired by "delete_volume" :: waited 0.015s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:15:03 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[497d083f-a44a-4842-a55b-c278ecf0f5e5]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:15:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-99545d6e-30fe-4239-b43e-5de4823d51e0 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-e44b17e5-9a03-443e-a0f4-d151cd51472a {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:03 devstack sudo[108184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-e44b17e5-9a03-443e-a0f4-d151cd51472a Aug 10 16:15:03 devstack sudo[108184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:03 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-02d50571-41e4-4841-8ab2-b2b3fd8afe8f tempest-ProjectReaderTests-845927054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:15:03 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-02d50571-41e4-4841-8ab2-b2b3fd8afe8f tempest-ProjectReaderTests-845927054 None] Flow 'volume_create_manager' (bf65cd01-ec65-4685-816e-2c8df9ffab45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:15:03 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-02d50571-41e4-4841-8ab2-b2b3fd8afe8f tempest-ProjectReaderTests-845927054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61b3c309-7c59-4de9-8226-fe9dade25db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:03 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-02d50571-41e4-4841-8ab2-b2b3fd8afe8f tempest-ProjectReaderTests-845927054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61b3c309-7c59-4de9-8226-fe9dade25db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:15:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1486186069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e38e578c-31a9-4768-a9f8-bd4ca94c7744,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='facb635ed4174975915b23b03172230d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:15:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:15:03Z,use_quota=True,user_id='4e3477f77fae4ce3a793c4908c365497',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:03 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-02d50571-41e4-4841-8ab2-b2b3fd8afe8f tempest-ProjectReaderTests-845927054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc4b2bf7-a499-4c5b-940d-c1414ce32f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:03 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-02d50571-41e4-4841-8ab2-b2b3fd8afe8f tempest-ProjectReaderTests-845927054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc4b2bf7-a499-4c5b-940d-c1414ce32f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:03 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-02d50571-41e4-4841-8ab2-b2b3fd8afe8f tempest-ProjectReaderTests-845927054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc4f02d7-3d15-4458-a897-3c73d528695f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:03 devstack sudo[108182]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:03 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-02d50571-41e4-4841-8ab2-b2b3fd8afe8f tempest-ProjectReaderTests-845927054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc4f02d7-3d15-4458-a897-3c73d528695f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e38e578c-31a9-4768-a9f8-bd4ca94c7744', 'volume_name': 'volume-e38e578c-31a9-4768-a9f8-bd4ca94c7744', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:03 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-02d50571-41e4-4841-8ab2-b2b3fd8afe8f tempest-ProjectReaderTests-845927054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3191e47-3815-4f79-af26-eb7f646159d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:03 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-02d50571-41e4-4841-8ab2-b2b3fd8afe8f tempest-ProjectReaderTests-845927054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3191e47-3815-4f79-af26-eb7f646159d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:03 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-02d50571-41e4-4841-8ab2-b2b3fd8afe8f tempest-ProjectReaderTests-845927054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2755d2d6-5392-47f0-9f10-85283259ae1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:03 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-02d50571-41e4-4841-8ab2-b2b3fd8afe8f tempest-ProjectReaderTests-845927054 None] Volume e38e578c-31a9-4768-a9f8-bd4ca94c7744: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e38e578c-31a9-4768-a9f8-bd4ca94c7744', 'volume_size': 1} Aug 10 16:15:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-02d50571-41e4-4841-8ab2-b2b3fd8afe8f tempest-ProjectReaderTests-845927054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:15:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-02d50571-41e4-4841-8ab2-b2b3fd8afe8f tempest-ProjectReaderTests-845927054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:15:03 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-02d50571-41e4-4841-8ab2-b2b3fd8afe8f tempest-ProjectReaderTests-845927054 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:15:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1486186069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e38e578c-31a9-4768-a9f8-bd4ca94c7744,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='facb635ed4174975915b23b03172230d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:15:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:15:03Z,use_quota=True,user_id='4e3477f77fae4ce3a793c4908c365497',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:15:03 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-02d50571-41e4-4841-8ab2-b2b3fd8afe8f tempest-ProjectReaderTests-845927054 None] Creating volume e38e578c-31a9-4768-a9f8-bd4ca94c7744 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:15:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-02d50571-41e4-4841-8ab2-b2b3fd8afe8f tempest-ProjectReaderTests-845927054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:15:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-02d50571-41e4-4841-8ab2-b2b3fd8afe8f tempest-ProjectReaderTests-845927054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:15:03 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-02d50571-41e4-4841-8ab2-b2b3fd8afe8f tempest-ProjectReaderTests-845927054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:15:03 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-02d50571-41e4-4841-8ab2-b2b3fd8afe8f tempest-ProjectReaderTests-845927054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:15:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-02d50571-41e4-4841-8ab2-b2b3fd8afe8f tempest-ProjectReaderTests-845927054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:15:03 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-02d50571-41e4-4841-8ab2-b2b3fd8afe8f tempest-ProjectReaderTests-845927054 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:15:03 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-02d50571-41e4-4841-8ab2-b2b3fd8afe8f tempest-ProjectReaderTests-845927054 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:15:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-02d50571-41e4-4841-8ab2-b2b3fd8afe8f tempest-ProjectReaderTests-845927054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-e38e578c-31a9-4768-a9f8-bd4ca94c7744 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4c94d99c-b6da-43b0-81ca-4c1686e3d617 tempest-CreateVolumesFromSnapshotTest-1045154512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.467s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:03 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-4c94d99c-b6da-43b0-81ca-4c1686e3d617 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:15:03 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-4c94d99c-b6da-43b0-81ca-4c1686e3d617 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Deleted volume successfully. Aug 10 16:15:03 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-4c94d99c-b6da-43b0-81ca-4c1686e3d617 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Lock "cinder-3dd6c758-3ca8-44cf-acfa-989ce801d3cd-delete_volume" released by "delete_volume" :: held 1.702s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:15:03 devstack sudo[108187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-e38e578c-31a9-4768-a9f8-bd4ca94c7744 1073741824 Aug 10 16:15:03 devstack sudo[108187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:03 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-478e296d-c382-4407-892f-ca3a2e2716d5 tempest-VolumeDependencyTests-509891231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:15:03 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-478e296d-c382-4407-892f-ca3a2e2716d5 tempest-VolumeDependencyTests-509891231 None] Flow 'volume_create_manager' (9a8ae78c-7600-499d-b2cc-3cc7904f8f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:15:03 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-478e296d-c382-4407-892f-ca3a2e2716d5 tempest-VolumeDependencyTests-509891231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0fdf9b9-99e5-4dbb-93e3-9f9637ac8678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:03 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-478e296d-c382-4407-892f-ca3a2e2716d5 tempest-VolumeDependencyTests-509891231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0fdf9b9-99e5-4dbb-93e3-9f9637ac8678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:15:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1976170580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=022bbfc3-45aa-4a33-9003-5b308b6784cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='612eafeb8ee5422fafdc21fd8f14006c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:15:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:15:04Z,use_quota=True,user_id='1480289a908f45158ddad909dbf52124',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:03 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-478e296d-c382-4407-892f-ca3a2e2716d5 tempest-VolumeDependencyTests-509891231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3206117d-a642-44ba-856f-0fcb7a28bb01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:03 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-478e296d-c382-4407-892f-ca3a2e2716d5 tempest-VolumeDependencyTests-509891231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3206117d-a642-44ba-856f-0fcb7a28bb01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:03 devstack sudo[108184]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:03 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-478e296d-c382-4407-892f-ca3a2e2716d5 tempest-VolumeDependencyTests-509891231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (005284bf-b742-441e-a722-9f245770bc97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:03 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-478e296d-c382-4407-892f-ca3a2e2716d5 tempest-VolumeDependencyTests-509891231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (005284bf-b742-441e-a722-9f245770bc97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '022bbfc3-45aa-4a33-9003-5b308b6784cd', 'volume_name': 'volume-022bbfc3-45aa-4a33-9003-5b308b6784cd', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:03 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-478e296d-c382-4407-892f-ca3a2e2716d5 tempest-VolumeDependencyTests-509891231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0083a96-a5c3-4ed3-9e34-cf2c8ce7353c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:03 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-478e296d-c382-4407-892f-ca3a2e2716d5 tempest-VolumeDependencyTests-509891231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0083a96-a5c3-4ed3-9e34-cf2c8ce7353c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:03 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-478e296d-c382-4407-892f-ca3a2e2716d5 tempest-VolumeDependencyTests-509891231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc3210f2-b0f9-490f-a43c-80975377f330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:03 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-478e296d-c382-4407-892f-ca3a2e2716d5 tempest-VolumeDependencyTests-509891231 None] Volume 022bbfc3-45aa-4a33-9003-5b308b6784cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-022bbfc3-45aa-4a33-9003-5b308b6784cd', 'volume_size': 1} Aug 10 16:15:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-478e296d-c382-4407-892f-ca3a2e2716d5 tempest-VolumeDependencyTests-509891231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:15:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-99545d6e-30fe-4239-b43e-5de4823d51e0 tempest-CreateVolumesFromSnapshotTest-1045154512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-e44b17e5-9a03-443e-a0f4-d151cd51472a" returned: 0 in 0.509s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-99545d6e-30fe-4239-b43e-5de4823d51e0 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-e44b17e5-9a03-443e-a0f4-d151cd51472a {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:03 devstack sudo[108192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-e44b17e5-9a03-443e-a0f4-d151cd51472a Aug 10 16:15:03 devstack sudo[108192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:04 devstack sudo[108192]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-99545d6e-30fe-4239-b43e-5de4823d51e0 tempest-CreateVolumesFromSnapshotTest-1045154512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-e44b17e5-9a03-443e-a0f4-d151cd51472a" returned: 0 in 0.263s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:04 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-99545d6e-30fe-4239-b43e-5de4823d51e0 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Lock "cinder-quobyte-e44b17e5-9a03-443e-a0f4-d151cd51472a" released by "delete_volume" :: held 0.821s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:15:04 devstack sudo[108187]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-02d50571-41e4-4841-8ab2-b2b3fd8afe8f tempest-ProjectReaderTests-845927054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-e38e578c-31a9-4768-a9f8-bd4ca94c7744 1073741824" returned: 0 in 0.541s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-02d50571-41e4-4841-8ab2-b2b3fd8afe8f tempest-ProjectReaderTests-845927054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-e38e578c-31a9-4768-a9f8-bd4ca94c7744 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:04 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-99545d6e-30fe-4239-b43e-5de4823d51e0 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Created reservations ['b1e36931-dd18-4fe4-9e73-55f7aff1426d', '34e8c0a8-4f13-4371-8ce7-1e98a0a6d829', '50cd6331-4e1e-4620-8e63-49d9ad14351a', 'eeae7a13-096d-47ae-832c-aa0bc8a235f7'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:15:04 devstack sudo[108199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-e38e578c-31a9-4768-a9f8-bd4ca94c7744 Aug 10 16:15:04 devstack sudo[108199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-99545d6e-30fe-4239-b43e-5de4823d51e0 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:15:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-99545d6e-30fe-4239-b43e-5de4823d51e0 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:15:04 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-99545d6e-30fe-4239-b43e-5de4823d51e0 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:15:04 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-99545d6e-30fe-4239-b43e-5de4823d51e0 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:15:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-99545d6e-30fe-4239-b43e-5de4823d51e0 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:15:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-99545d6e-30fe-4239-b43e-5de4823d51e0 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:04 devstack sudo[108201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:15:04 devstack sudo[108201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:04 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-3ba415c4-fbf3-4d4b-878b-d45c44ef9e98 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Acquiring lock "cinder-585b4ad5-fe99-49c6-82f0-3eb088b49721-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:15:04 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-3ba415c4-fbf3-4d4b-878b-d45c44ef9e98 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Lock "cinder-585b4ad5-fe99-49c6-82f0-3eb088b49721-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:15:04 devstack sudo[108199]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-02d50571-41e4-4841-8ab2-b2b3fd8afe8f tempest-ProjectReaderTests-845927054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-e38e578c-31a9-4768-a9f8-bd4ca94c7744" returned: 0 in 0.305s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:04 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-02d50571-41e4-4841-8ab2-b2b3fd8afe8f tempest-ProjectReaderTests-845927054 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:15:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-02d50571-41e4-4841-8ab2-b2b3fd8afe8f tempest-ProjectReaderTests-845927054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:15:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-478e296d-c382-4407-892f-ca3a2e2716d5 tempest-VolumeDependencyTests-509891231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.659s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:15:04 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-478e296d-c382-4407-892f-ca3a2e2716d5 tempest-VolumeDependencyTests-509891231 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:15:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1976170580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=022bbfc3-45aa-4a33-9003-5b308b6784cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='612eafeb8ee5422fafdc21fd8f14006c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:15:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:15:04Z,use_quota=True,user_id='1480289a908f45158ddad909dbf52124',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:15:04 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-478e296d-c382-4407-892f-ca3a2e2716d5 tempest-VolumeDependencyTests-509891231 None] Creating volume 022bbfc3-45aa-4a33-9003-5b308b6784cd {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:15:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-478e296d-c382-4407-892f-ca3a2e2716d5 tempest-VolumeDependencyTests-509891231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:15:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-478e296d-c382-4407-892f-ca3a2e2716d5 tempest-VolumeDependencyTests-509891231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:15:04 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-478e296d-c382-4407-892f-ca3a2e2716d5 tempest-VolumeDependencyTests-509891231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:15:04 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-478e296d-c382-4407-892f-ca3a2e2716d5 tempest-VolumeDependencyTests-509891231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:15:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-478e296d-c382-4407-892f-ca3a2e2716d5 tempest-VolumeDependencyTests-509891231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:15:04 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-478e296d-c382-4407-892f-ca3a2e2716d5 tempest-VolumeDependencyTests-509891231 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:15:04 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-478e296d-c382-4407-892f-ca3a2e2716d5 tempest-VolumeDependencyTests-509891231 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:15:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-478e296d-c382-4407-892f-ca3a2e2716d5 tempest-VolumeDependencyTests-509891231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-022bbfc3-45aa-4a33-9003-5b308b6784cd 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:04 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-02d50571-41e4-4841-8ab2-b2b3fd8afe8f tempest-ProjectReaderTests-845927054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2755d2d6-5392-47f0-9f10-85283259ae1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e38e578c-31a9-4768-a9f8-bd4ca94c7744', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:04 devstack sudo[108204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-022bbfc3-45aa-4a33-9003-5b308b6784cd 1073741824 Aug 10 16:15:04 devstack sudo[108204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:04 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-02d50571-41e4-4841-8ab2-b2b3fd8afe8f tempest-ProjectReaderTests-845927054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8955ab0d-a2a7-4f69-a643-6122fe4348b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:04 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-02d50571-41e4-4841-8ab2-b2b3fd8afe8f tempest-ProjectReaderTests-845927054 None] Volume volume-e38e578c-31a9-4768-a9f8-bd4ca94c7744 (e38e578c-31a9-4768-a9f8-bd4ca94c7744): created successfully Aug 10 16:15:04 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-02d50571-41e4-4841-8ab2-b2b3fd8afe8f tempest-ProjectReaderTests-845927054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8955ab0d-a2a7-4f69-a643-6122fe4348b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:04 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-02d50571-41e4-4841-8ab2-b2b3fd8afe8f tempest-ProjectReaderTests-845927054 None] Flow 'volume_create_manager' (bf65cd01-ec65-4685-816e-2c8df9ffab45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:15:04 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-3ba415c4-fbf3-4d4b-878b-d45c44ef9e98 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Acquiring lock "cinder-quobyte-585b4ad5-fe99-49c6-82f0-3eb088b49721" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:15:04 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-02d50571-41e4-4841-8ab2-b2b3fd8afe8f tempest-ProjectReaderTests-845927054 None] Created volume successfully. Aug 10 16:15:04 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-3ba415c4-fbf3-4d4b-878b-d45c44ef9e98 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Lock "cinder-quobyte-585b4ad5-fe99-49c6-82f0-3eb088b49721" acquired by "delete_volume" :: waited 0.024s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:15:04 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5aebfdc-1673-492d-8253-a312780d3cc0]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:15:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-3ba415c4-fbf3-4d4b-878b-d45c44ef9e98 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-585b4ad5-fe99-49c6-82f0-3eb088b49721 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:04 devstack sudo[108201]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-99545d6e-30fe-4239-b43e-5de4823d51e0 tempest-CreateVolumesFromSnapshotTest-1045154512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.347s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:04 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-99545d6e-30fe-4239-b43e-5de4823d51e0 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:15:04 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-99545d6e-30fe-4239-b43e-5de4823d51e0 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Deleted volume successfully. Aug 10 16:15:04 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-99545d6e-30fe-4239-b43e-5de4823d51e0 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Lock "cinder-e44b17e5-9a03-443e-a0f4-d151cd51472a-delete_volume" released by "delete_volume" :: held 1.477s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:15:04 devstack sudo[108207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-585b4ad5-fe99-49c6-82f0-3eb088b49721 Aug 10 16:15:04 devstack sudo[108207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:05 devstack sudo[108207]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:05 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-3ba415c4-fbf3-4d4b-878b-d45c44ef9e98 tempest-CreateVolumesFromSnapshotTest-1045154512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-585b4ad5-fe99-49c6-82f0-3eb088b49721" returned: 0 in 0.405s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:05 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-3ba415c4-fbf3-4d4b-878b-d45c44ef9e98 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-585b4ad5-fe99-49c6-82f0-3eb088b49721 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:05 devstack sudo[108204]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:05 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-478e296d-c382-4407-892f-ca3a2e2716d5 tempest-VolumeDependencyTests-509891231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-022bbfc3-45aa-4a33-9003-5b308b6784cd 1073741824" returned: 0 in 0.568s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:05 devstack sudo[108215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-585b4ad5-fe99-49c6-82f0-3eb088b49721 Aug 10 16:15:05 devstack sudo[108215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:05 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-478e296d-c382-4407-892f-ca3a2e2716d5 tempest-VolumeDependencyTests-509891231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-022bbfc3-45aa-4a33-9003-5b308b6784cd {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:05 devstack sudo[108217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-022bbfc3-45aa-4a33-9003-5b308b6784cd Aug 10 16:15:05 devstack sudo[108217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:05 devstack sudo[108215]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:05 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-3ba415c4-fbf3-4d4b-878b-d45c44ef9e98 tempest-CreateVolumesFromSnapshotTest-1045154512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-585b4ad5-fe99-49c6-82f0-3eb088b49721" returned: 0 in 0.286s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:05 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-3ba415c4-fbf3-4d4b-878b-d45c44ef9e98 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Lock "cinder-quobyte-585b4ad5-fe99-49c6-82f0-3eb088b49721" released by "delete_volume" :: held 0.757s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:15:05 devstack sudo[108217]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:05 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-478e296d-c382-4407-892f-ca3a2e2716d5 tempest-VolumeDependencyTests-509891231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-022bbfc3-45aa-4a33-9003-5b308b6784cd" returned: 0 in 0.281s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:05 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-478e296d-c382-4407-892f-ca3a2e2716d5 tempest-VolumeDependencyTests-509891231 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:15:05 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-478e296d-c382-4407-892f-ca3a2e2716d5 tempest-VolumeDependencyTests-509891231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:15:05 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-478e296d-c382-4407-892f-ca3a2e2716d5 tempest-VolumeDependencyTests-509891231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc3210f2-b0f9-490f-a43c-80975377f330) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-022bbfc3-45aa-4a33-9003-5b308b6784cd', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:05 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-478e296d-c382-4407-892f-ca3a2e2716d5 tempest-VolumeDependencyTests-509891231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (174e89d9-0be2-4e74-a595-8f39a5ad317e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:05 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-478e296d-c382-4407-892f-ca3a2e2716d5 tempest-VolumeDependencyTests-509891231 None] Volume volume-022bbfc3-45aa-4a33-9003-5b308b6784cd (022bbfc3-45aa-4a33-9003-5b308b6784cd): created successfully Aug 10 16:15:05 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-478e296d-c382-4407-892f-ca3a2e2716d5 tempest-VolumeDependencyTests-509891231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (174e89d9-0be2-4e74-a595-8f39a5ad317e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:05 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-478e296d-c382-4407-892f-ca3a2e2716d5 tempest-VolumeDependencyTests-509891231 None] Flow 'volume_create_manager' (9a8ae78c-7600-499d-b2cc-3cc7904f8f2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:15:05 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-3ba415c4-fbf3-4d4b-878b-d45c44ef9e98 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Created reservations ['e9254875-f280-44c6-b629-1476c17eb173', '3d8402ef-f484-4488-a8c2-21e5cb2c4f4b', 'c4893f6f-29a9-4c99-9428-57b68f8235df', 'ebd04814-e08d-4724-8ffc-607e1c160e85'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:15:05 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-478e296d-c382-4407-892f-ca3a2e2716d5 tempest-VolumeDependencyTests-509891231 None] Created volume successfully. Aug 10 16:15:05 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-3ba415c4-fbf3-4d4b-878b-d45c44ef9e98 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:15:05 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-3ba415c4-fbf3-4d4b-878b-d45c44ef9e98 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:15:05 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-3ba415c4-fbf3-4d4b-878b-d45c44ef9e98 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:15:05 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-3ba415c4-fbf3-4d4b-878b-d45c44ef9e98 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:15:05 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-3ba415c4-fbf3-4d4b-878b-d45c44ef9e98 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:15:05 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-3ba415c4-fbf3-4d4b-878b-d45c44ef9e98 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:05 devstack sudo[108221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:15:05 devstack sudo[108221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:05 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-9d4f9966-a58b-4bb3-9d09-a313797f385c tempest-ProjectReaderTests-845927054 None] Acquiring lock "cinder-e38e578c-31a9-4768-a9f8-bd4ca94c7744-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:15:05 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-9d4f9966-a58b-4bb3-9d09-a313797f385c tempest-ProjectReaderTests-845927054 None] Lock "cinder-e38e578c-31a9-4768-a9f8-bd4ca94c7744-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:15:05 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-f4edcaee-c564-45d6-b5ec-43dff590e055 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Acquiring lock "cinder-60667d87-0e01-4a42-a1ba-6fdaae318cf2-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:15:05 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-f4edcaee-c564-45d6-b5ec-43dff590e055 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Lock "cinder-60667d87-0e01-4a42-a1ba-6fdaae318cf2-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:15:05 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-9d4f9966-a58b-4bb3-9d09-a313797f385c tempest-ProjectReaderTests-845927054 None] Acquiring lock "cinder-quobyte-e38e578c-31a9-4768-a9f8-bd4ca94c7744" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:15:05 devstack sudo[108221]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:05 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-9d4f9966-a58b-4bb3-9d09-a313797f385c tempest-ProjectReaderTests-845927054 None] Lock "cinder-quobyte-e38e578c-31a9-4768-a9f8-bd4ca94c7744" acquired by "delete_volume" :: waited 0.041s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:15:05 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-3ba415c4-fbf3-4d4b-878b-d45c44ef9e98 tempest-CreateVolumesFromSnapshotTest-1045154512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.368s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:05 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-3ba415c4-fbf3-4d4b-878b-d45c44ef9e98 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:15:05 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-3ba415c4-fbf3-4d4b-878b-d45c44ef9e98 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Deleted volume successfully. Aug 10 16:15:05 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[edae8ccd-2820-4fbd-8af9-223be1a9f34f]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:15:05 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9d4f9966-a58b-4bb3-9d09-a313797f385c tempest-ProjectReaderTests-845927054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-e38e578c-31a9-4768-a9f8-bd4ca94c7744 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:05 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-f4edcaee-c564-45d6-b5ec-43dff590e055 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Acquiring lock "cinder-quobyte-60667d87-0e01-4a42-a1ba-6fdaae318cf2" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:15:05 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-3ba415c4-fbf3-4d4b-878b-d45c44ef9e98 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Lock "cinder-585b4ad5-fe99-49c6-82f0-3eb088b49721-delete_volume" released by "delete_volume" :: held 1.544s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:15:05 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-f4edcaee-c564-45d6-b5ec-43dff590e055 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Lock "cinder-quobyte-60667d87-0e01-4a42-a1ba-6fdaae318cf2" acquired by "delete_volume" :: waited 0.040s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:15:05 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[804d8aba-5649-4b39-918d-712eb3c9463b]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:15:05 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-f4edcaee-c564-45d6-b5ec-43dff590e055 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-60667d87-0e01-4a42-a1ba-6fdaae318cf2 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:06 devstack sudo[108224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-e38e578c-31a9-4768-a9f8-bd4ca94c7744 Aug 10 16:15:06 devstack sudo[108224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:06 devstack sudo[108225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-60667d87-0e01-4a42-a1ba-6fdaae318cf2 Aug 10 16:15:06 devstack sudo[108225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:06 devstack sudo[108224]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:06 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9d4f9966-a58b-4bb3-9d09-a313797f385c tempest-ProjectReaderTests-845927054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-e38e578c-31a9-4768-a9f8-bd4ca94c7744" returned: 0 in 0.422s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:06 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9d4f9966-a58b-4bb3-9d09-a313797f385c tempest-ProjectReaderTests-845927054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-e38e578c-31a9-4768-a9f8-bd4ca94c7744 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:06 devstack sudo[108240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-e38e578c-31a9-4768-a9f8-bd4ca94c7744 Aug 10 16:15:06 devstack sudo[108240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:06 devstack sudo[108225]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:06 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-f4edcaee-c564-45d6-b5ec-43dff590e055 tempest-CreateVolumesFromSnapshotTest-1045154512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-60667d87-0e01-4a42-a1ba-6fdaae318cf2" returned: 0 in 0.439s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:06 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-f4edcaee-c564-45d6-b5ec-43dff590e055 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-60667d87-0e01-4a42-a1ba-6fdaae318cf2 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:06 devstack sudo[108243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-60667d87-0e01-4a42-a1ba-6fdaae318cf2 Aug 10 16:15:06 devstack sudo[108243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:06 devstack sudo[108240]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:06 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9d4f9966-a58b-4bb3-9d09-a313797f385c tempest-ProjectReaderTests-845927054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-e38e578c-31a9-4768-a9f8-bd4ca94c7744" returned: 0 in 0.309s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:06 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-9d4f9966-a58b-4bb3-9d09-a313797f385c tempest-ProjectReaderTests-845927054 None] Lock "cinder-quobyte-e38e578c-31a9-4768-a9f8-bd4ca94c7744" released by "delete_volume" :: held 0.806s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:15:06 devstack sudo[108243]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:06 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-9d4f9966-a58b-4bb3-9d09-a313797f385c tempest-ProjectReaderTests-845927054 None] Created reservations ['1cec36f0-b4aa-41d5-82ba-4417f26012de', 'd8b1aac6-4df5-4ad6-bbd4-4e9dfbc5d020', '9fdeca44-c7f6-46b4-b997-5221397524d5', '707174a1-30d6-467d-a344-1bbed12b5900'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:15:06 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-f4edcaee-c564-45d6-b5ec-43dff590e055 tempest-CreateVolumesFromSnapshotTest-1045154512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-60667d87-0e01-4a42-a1ba-6fdaae318cf2" returned: 0 in 0.303s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:06 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-f4edcaee-c564-45d6-b5ec-43dff590e055 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Lock "cinder-quobyte-60667d87-0e01-4a42-a1ba-6fdaae318cf2" released by "delete_volume" :: held 0.805s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:15:06 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-fb2a3db5-bced-428a-9229-94eb63098c1e tempest-VolumeDependencyTests-509891231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:15:06 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-fb2a3db5-bced-428a-9229-94eb63098c1e tempest-VolumeDependencyTests-509891231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:15:06 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-fb2a3db5-bced-428a-9229-94eb63098c1e tempest-VolumeDependencyTests-509891231 None] Creating offline snapshot d61220b4-85b3-4076-9441-5e2f7f7c6984 of volume 022bbfc3-45aa-4a33-9003-5b308b6784cd {{(pid=88641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 16:15:06 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-9d4f9966-a58b-4bb3-9d09-a313797f385c tempest-ProjectReaderTests-845927054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:15:06 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-9d4f9966-a58b-4bb3-9d09-a313797f385c tempest-ProjectReaderTests-845927054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:15:06 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-9d4f9966-a58b-4bb3-9d09-a313797f385c tempest-ProjectReaderTests-845927054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:15:06 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-9d4f9966-a58b-4bb3-9d09-a313797f385c tempest-ProjectReaderTests-845927054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:15:06 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-9d4f9966-a58b-4bb3-9d09-a313797f385c tempest-ProjectReaderTests-845927054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:15:06 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9d4f9966-a58b-4bb3-9d09-a313797f385c tempest-ProjectReaderTests-845927054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:06 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9cc0513-3d43-46b6-b897-e41b84ed45d3]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:15:06 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fb2a3db5-bced-428a-9229-94eb63098c1e tempest-VolumeDependencyTests-509891231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-022bbfc3-45aa-4a33-9003-5b308b6784cd {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:06 devstack sudo[108247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:15:06 devstack sudo[108247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:07 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-f4edcaee-c564-45d6-b5ec-43dff590e055 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Created reservations ['258c943c-7e6f-4f12-91dd-7b66b140f1b2', '352042b2-615e-4750-9783-4c0a6ec4ebd8', '2fd6a4aa-a43f-4138-b397-4b60d8d9d50b', 'a97a5cf7-90ab-45ed-9750-56ba403be14b'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:15:07 devstack sudo[108249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-022bbfc3-45aa-4a33-9003-5b308b6784cd Aug 10 16:15:07 devstack sudo[108249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-f4edcaee-c564-45d6-b5ec-43dff590e055 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:15:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-f4edcaee-c564-45d6-b5ec-43dff590e055 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:15:07 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-f4edcaee-c564-45d6-b5ec-43dff590e055 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:15:07 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-f4edcaee-c564-45d6-b5ec-43dff590e055 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:15:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-f4edcaee-c564-45d6-b5ec-43dff590e055 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:15:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-f4edcaee-c564-45d6-b5ec-43dff590e055 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:07 devstack sudo[108251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:15:07 devstack sudo[108251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:07 devstack sudo[108247]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9d4f9966-a58b-4bb3-9d09-a313797f385c tempest-ProjectReaderTests-845927054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.433s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:07 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-9d4f9966-a58b-4bb3-9d09-a313797f385c tempest-ProjectReaderTests-845927054 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:15:07 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-9d4f9966-a58b-4bb3-9d09-a313797f385c tempest-ProjectReaderTests-845927054 None] Deleted volume successfully. Aug 10 16:15:07 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-9d4f9966-a58b-4bb3-9d09-a313797f385c tempest-ProjectReaderTests-845927054 None] Lock "cinder-e38e578c-31a9-4768-a9f8-bd4ca94c7744-delete_volume" released by "delete_volume" :: held 1.679s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:15:07 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-603f05bf-bf2c-443c-8734-57bb7598efc6 tempest-ProjectReaderTests-845927054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:15:07 devstack sudo[108249]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:07 devstack sudo[108251]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:07 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-603f05bf-bf2c-443c-8734-57bb7598efc6 tempest-ProjectReaderTests-845927054 None] Flow 'volume_create_manager' (aefb1c80-564c-4a01-92cd-0942dff3dd66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:15:07 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-603f05bf-bf2c-443c-8734-57bb7598efc6 tempest-ProjectReaderTests-845927054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (807b7755-dab8-4759-ba48-a7cdfd531515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fb2a3db5-bced-428a-9229-94eb63098c1e tempest-VolumeDependencyTests-509891231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-022bbfc3-45aa-4a33-9003-5b308b6784cd" returned: 0 in 0.586s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-f4edcaee-c564-45d6-b5ec-43dff590e055 tempest-CreateVolumesFromSnapshotTest-1045154512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.401s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fb2a3db5-bced-428a-9229-94eb63098c1e tempest-VolumeDependencyTests-509891231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-022bbfc3-45aa-4a33-9003-5b308b6784cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-022bbfc3-45aa-4a33-9003-5b308b6784cd.d61220b4-85b3-4076-9441-5e2f7f7c6984 1G {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:07 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-f4edcaee-c564-45d6-b5ec-43dff590e055 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:15:07 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-f4edcaee-c564-45d6-b5ec-43dff590e055 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Deleted volume successfully. Aug 10 16:15:07 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-603f05bf-bf2c-443c-8734-57bb7598efc6 tempest-ProjectReaderTests-845927054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (807b7755-dab8-4759-ba48-a7cdfd531515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:15:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1963794894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e948267-3b99-42d8-894e-0cfd177008e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='facb635ed4174975915b23b03172230d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:15:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:15:07Z,use_quota=True,user_id='4e3477f77fae4ce3a793c4908c365497',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:07 devstack sudo[108259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-022bbfc3-45aa-4a33-9003-5b308b6784cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-022bbfc3-45aa-4a33-9003-5b308b6784cd.d61220b4-85b3-4076-9441-5e2f7f7c6984 1G Aug 10 16:15:07 devstack sudo[108259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:07 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-603f05bf-bf2c-443c-8734-57bb7598efc6 tempest-ProjectReaderTests-845927054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3096300f-dd18-4470-b431-6c2457912b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:07 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-603f05bf-bf2c-443c-8734-57bb7598efc6 tempest-ProjectReaderTests-845927054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3096300f-dd18-4470-b431-6c2457912b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:07 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-603f05bf-bf2c-443c-8734-57bb7598efc6 tempest-ProjectReaderTests-845927054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0ee6f82-84b1-4102-a479-b2dac99cf6e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:07 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-603f05bf-bf2c-443c-8734-57bb7598efc6 tempest-ProjectReaderTests-845927054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0ee6f82-84b1-4102-a479-b2dac99cf6e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e948267-3b99-42d8-894e-0cfd177008e0', 'volume_name': 'volume-9e948267-3b99-42d8-894e-0cfd177008e0', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:07 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-603f05bf-bf2c-443c-8734-57bb7598efc6 tempest-ProjectReaderTests-845927054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d063c925-d05b-4c78-81d4-80cb80a5b7d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:07 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-603f05bf-bf2c-443c-8734-57bb7598efc6 tempest-ProjectReaderTests-845927054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d063c925-d05b-4c78-81d4-80cb80a5b7d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:07 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-603f05bf-bf2c-443c-8734-57bb7598efc6 tempest-ProjectReaderTests-845927054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4d33b6d-d6fd-4c80-8730-0a2418ab176f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:07 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-603f05bf-bf2c-443c-8734-57bb7598efc6 tempest-ProjectReaderTests-845927054 None] Volume 9e948267-3b99-42d8-894e-0cfd177008e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e948267-3b99-42d8-894e-0cfd177008e0', 'volume_size': 1} Aug 10 16:15:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-603f05bf-bf2c-443c-8734-57bb7598efc6 tempest-ProjectReaderTests-845927054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:15:07 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-f4edcaee-c564-45d6-b5ec-43dff590e055 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Lock "cinder-60667d87-0e01-4a42-a1ba-6fdaae318cf2-delete_volume" released by "delete_volume" :: held 1.858s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:15:08 devstack sudo[108259]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fb2a3db5-bced-428a-9229-94eb63098c1e tempest-VolumeDependencyTests-509891231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-022bbfc3-45aa-4a33-9003-5b308b6784cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-022bbfc3-45aa-4a33-9003-5b308b6784cd.d61220b4-85b3-4076-9441-5e2f7f7c6984 1G" returned: 0 in 0.475s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fb2a3db5-bced-428a-9229-94eb63098c1e tempest-VolumeDependencyTests-509891231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-022bbfc3-45aa-4a33-9003-5b308b6784cd -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-022bbfc3-45aa-4a33-9003-5b308b6784cd.d61220b4-85b3-4076-9441-5e2f7f7c6984 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:08 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-8470fec9-ddf3-4be7-8513-1f317222cc93 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Acquiring lock "cinder-e9a5f876-5574-481b-a7ee-6efa6321a666-delete_snapshot" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:15:08 devstack sudo[108265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-022bbfc3-45aa-4a33-9003-5b308b6784cd -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-022bbfc3-45aa-4a33-9003-5b308b6784cd.d61220b4-85b3-4076-9441-5e2f7f7c6984 Aug 10 16:15:08 devstack sudo[108265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:08 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-8470fec9-ddf3-4be7-8513-1f317222cc93 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Lock "cinder-e9a5f876-5574-481b-a7ee-6efa6321a666-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:15:08 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-8470fec9-ddf3-4be7-8513-1f317222cc93 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Acquiring lock "cinder-quobyte-054e3c13-16a6-4833-85d0-861028d67e1c" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:15:08 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-8470fec9-ddf3-4be7-8513-1f317222cc93 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Lock "cinder-quobyte-054e3c13-16a6-4833-85d0-861028d67e1c" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:15:08 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-8470fec9-ddf3-4be7-8513-1f317222cc93 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Acquiring lock "cinder-quobyte-e9a5f876-5574-481b-a7ee-6efa6321a666" by "_delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:15:08 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-8470fec9-ddf3-4be7-8513-1f317222cc93 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Lock "cinder-quobyte-e9a5f876-5574-481b-a7ee-6efa6321a666" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:15:08 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-8470fec9-ddf3-4be7-8513-1f317222cc93 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Deleting offline snapshot e9a5f876-5574-481b-a7ee-6efa6321a666 of volume 054e3c13-16a6-4833-85d0-861028d67e1c {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 16:15:08 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-8470fec9-ddf3-4be7-8513-1f317222cc93 tempest-CreateVolumesFromSnapshotTest-1045154512 None] snapshot_file for this snap is: volume-054e3c13-16a6-4833-85d0-861028d67e1c.e9a5f876-5574-481b-a7ee-6efa6321a666 {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 16:15:08 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[23fa19e9-7400-45d2-a630-28cb765de978]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:15:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-8470fec9-ddf3-4be7-8513-1f317222cc93 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-054e3c13-16a6-4833-85d0-861028d67e1c.e9a5f876-5574-481b-a7ee-6efa6321a666 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:08 devstack sudo[108267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-054e3c13-16a6-4833-85d0-861028d67e1c.e9a5f876-5574-481b-a7ee-6efa6321a666 Aug 10 16:15:08 devstack sudo[108267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:08 devstack sudo[108265]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fb2a3db5-bced-428a-9229-94eb63098c1e tempest-VolumeDependencyTests-509891231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-022bbfc3-45aa-4a33-9003-5b308b6784cd -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-022bbfc3-45aa-4a33-9003-5b308b6784cd.d61220b4-85b3-4076-9441-5e2f7f7c6984" returned: 0 in 0.379s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:08 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-fb2a3db5-bced-428a-9229-94eb63098c1e tempest-VolumeDependencyTests-509891231 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-022bbfc3-45aa-4a33-9003-5b308b6784cd.d61220b4-85b3-4076-9441-5e2f7f7c6984 is being set with open permissions: ugo+rw Aug 10 16:15:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fb2a3db5-bced-428a-9229-94eb63098c1e tempest-VolumeDependencyTests-509891231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-022bbfc3-45aa-4a33-9003-5b308b6784cd.d61220b4-85b3-4076-9441-5e2f7f7c6984 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:08 devstack sudo[108272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-022bbfc3-45aa-4a33-9003-5b308b6784cd.d61220b4-85b3-4076-9441-5e2f7f7c6984 Aug 10 16:15:08 devstack sudo[108272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:08 devstack sudo[108267]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-8470fec9-ddf3-4be7-8513-1f317222cc93 tempest-CreateVolumesFromSnapshotTest-1045154512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-054e3c13-16a6-4833-85d0-861028d67e1c.e9a5f876-5574-481b-a7ee-6efa6321a666" returned: 0 in 0.408s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:08 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-8470fec9-ddf3-4be7-8513-1f317222cc93 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-054e3c13-16a6-4833-85d0-861028d67e1c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 16:15:08 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f5cada-57d8-4064-a004-a1f2cb80d9b5]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:15:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-8470fec9-ddf3-4be7-8513-1f317222cc93 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-054e3c13-16a6-4833-85d0-861028d67e1c {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:08 devstack sudo[108272]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fb2a3db5-bced-428a-9229-94eb63098c1e tempest-VolumeDependencyTests-509891231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-022bbfc3-45aa-4a33-9003-5b308b6784cd.d61220b4-85b3-4076-9441-5e2f7f7c6984" returned: 0 in 0.289s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fb2a3db5-bced-428a-9229-94eb63098c1e tempest-VolumeDependencyTests-509891231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-022bbfc3-45aa-4a33-9003-5b308b6784cd.info {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:08 devstack sudo[108277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-054e3c13-16a6-4833-85d0-861028d67e1c Aug 10 16:15:08 devstack sudo[108277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:08 devstack sudo[108279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-022bbfc3-45aa-4a33-9003-5b308b6784cd.info Aug 10 16:15:08 devstack sudo[108279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:09 devstack sudo[108279]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:09 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fb2a3db5-bced-428a-9229-94eb63098c1e tempest-VolumeDependencyTests-509891231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-022bbfc3-45aa-4a33-9003-5b308b6784cd.info" returned: 0 in 0.282s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:09 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-fb2a3db5-bced-428a-9229-94eb63098c1e tempest-VolumeDependencyTests-509891231 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-022bbfc3-45aa-4a33-9003-5b308b6784cd.info is being set with open permissions: ugo+rw Aug 10 16:15:09 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fb2a3db5-bced-428a-9229-94eb63098c1e tempest-VolumeDependencyTests-509891231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-022bbfc3-45aa-4a33-9003-5b308b6784cd.info {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:09 devstack sudo[108286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-022bbfc3-45aa-4a33-9003-5b308b6784cd.info Aug 10 16:15:09 devstack sudo[108286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:09 devstack sudo[108277]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:09 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-8470fec9-ddf3-4be7-8513-1f317222cc93 tempest-CreateVolumesFromSnapshotTest-1045154512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-054e3c13-16a6-4833-85d0-861028d67e1c" returned: 0 in 0.426s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:09 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-8470fec9-ddf3-4be7-8513-1f317222cc93 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-054e3c13-16a6-4833-85d0-861028d67e1c.e9a5f876-5574-481b-a7ee-6efa6321a666 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:09 devstack sudo[108288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-054e3c13-16a6-4833-85d0-861028d67e1c.e9a5f876-5574-481b-a7ee-6efa6321a666 Aug 10 16:15:09 devstack sudo[108288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:09 devstack sudo[108286]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:09 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fb2a3db5-bced-428a-9229-94eb63098c1e tempest-VolumeDependencyTests-509891231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-022bbfc3-45aa-4a33-9003-5b308b6784cd.info" returned: 0 in 0.273s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:09 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-fb2a3db5-bced-428a-9229-94eb63098c1e tempest-VolumeDependencyTests-509891231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.491s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:15:09 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-603f05bf-bf2c-443c-8734-57bb7598efc6 tempest-ProjectReaderTests-845927054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.682s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:15:09 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-603f05bf-bf2c-443c-8734-57bb7598efc6 tempest-ProjectReaderTests-845927054 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:15:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1963794894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e948267-3b99-42d8-894e-0cfd177008e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='facb635ed4174975915b23b03172230d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:15:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:15:07Z,use_quota=True,user_id='4e3477f77fae4ce3a793c4908c365497',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:15:09 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-603f05bf-bf2c-443c-8734-57bb7598efc6 tempest-ProjectReaderTests-845927054 None] Creating volume 9e948267-3b99-42d8-894e-0cfd177008e0 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:15:09 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-603f05bf-bf2c-443c-8734-57bb7598efc6 tempest-ProjectReaderTests-845927054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:15:09 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-603f05bf-bf2c-443c-8734-57bb7598efc6 tempest-ProjectReaderTests-845927054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:15:09 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-603f05bf-bf2c-443c-8734-57bb7598efc6 tempest-ProjectReaderTests-845927054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:15:09 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-603f05bf-bf2c-443c-8734-57bb7598efc6 tempest-ProjectReaderTests-845927054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:15:09 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-603f05bf-bf2c-443c-8734-57bb7598efc6 tempest-ProjectReaderTests-845927054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:15:09 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-603f05bf-bf2c-443c-8734-57bb7598efc6 tempest-ProjectReaderTests-845927054 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:15:09 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-603f05bf-bf2c-443c-8734-57bb7598efc6 tempest-ProjectReaderTests-845927054 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:15:09 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-603f05bf-bf2c-443c-8734-57bb7598efc6 tempest-ProjectReaderTests-845927054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9e948267-3b99-42d8-894e-0cfd177008e0 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:09 devstack sudo[108295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9e948267-3b99-42d8-894e-0cfd177008e0 1073741824 Aug 10 16:15:09 devstack sudo[108295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:09 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-fb2a3db5-bced-428a-9229-94eb63098c1e tempest-VolumeDependencyTests-509891231 None] Create snapshot completed successfully Aug 10 16:15:09 devstack sudo[108288]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:09 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-8470fec9-ddf3-4be7-8513-1f317222cc93 tempest-CreateVolumesFromSnapshotTest-1045154512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-054e3c13-16a6-4833-85d0-861028d67e1c.e9a5f876-5574-481b-a7ee-6efa6321a666" returned: 0 in 0.391s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:09 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-8470fec9-ddf3-4be7-8513-1f317222cc93 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-054e3c13-16a6-4833-85d0-861028d67e1c.e9a5f876-5574-481b-a7ee-6efa6321a666 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:09 devstack sudo[108297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-054e3c13-16a6-4833-85d0-861028d67e1c.e9a5f876-5574-481b-a7ee-6efa6321a666 Aug 10 16:15:09 devstack sudo[108297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:09 devstack sudo[108297]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:09 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-8470fec9-ddf3-4be7-8513-1f317222cc93 tempest-CreateVolumesFromSnapshotTest-1045154512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-054e3c13-16a6-4833-85d0-861028d67e1c.e9a5f876-5574-481b-a7ee-6efa6321a666" returned: 0 in 0.298s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:09 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-8470fec9-ddf3-4be7-8513-1f317222cc93 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Lock "cinder-quobyte-e9a5f876-5574-481b-a7ee-6efa6321a666" released by "_delete_snapshot" :: held 1.649s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:15:09 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-8470fec9-ddf3-4be7-8513-1f317222cc93 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Lock "cinder-quobyte-054e3c13-16a6-4833-85d0-861028d67e1c" released by "delete_snapshot" :: held 1.677s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:15:09 devstack sudo[108295]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:09 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-603f05bf-bf2c-443c-8734-57bb7598efc6 tempest-ProjectReaderTests-845927054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9e948267-3b99-42d8-894e-0cfd177008e0 1073741824" returned: 0 in 0.486s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:09 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-603f05bf-bf2c-443c-8734-57bb7598efc6 tempest-ProjectReaderTests-845927054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9e948267-3b99-42d8-894e-0cfd177008e0 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:09 devstack sudo[108304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9e948267-3b99-42d8-894e-0cfd177008e0 Aug 10 16:15:09 devstack sudo[108304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:09 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-8470fec9-ddf3-4be7-8513-1f317222cc93 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Created reservations ['4ca74736-45fa-4b6c-90ef-e25df3128215', 'ac814e4b-73bd-42f0-a0e3-37ebc5d51580', 'c8a83b83-bf65-41db-aedb-622743a527bf', '726d4a85-0916-4cb7-a488-279327d2ef64'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:15:10 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-8470fec9-ddf3-4be7-8513-1f317222cc93 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Delete snapshot completed successfully. Aug 10 16:15:10 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-8470fec9-ddf3-4be7-8513-1f317222cc93 tempest-CreateVolumesFromSnapshotTest-1045154512 None] Lock "cinder-e9a5f876-5574-481b-a7ee-6efa6321a666-delete_snapshot" released by "delete_snapshot" :: held 1.947s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:15:10 devstack sudo[108304]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:10 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-603f05bf-bf2c-443c-8734-57bb7598efc6 tempest-ProjectReaderTests-845927054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9e948267-3b99-42d8-894e-0cfd177008e0" returned: 0 in 0.324s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:10 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-603f05bf-bf2c-443c-8734-57bb7598efc6 tempest-ProjectReaderTests-845927054 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:15:10 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-603f05bf-bf2c-443c-8734-57bb7598efc6 tempest-ProjectReaderTests-845927054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:15:10 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-603f05bf-bf2c-443c-8734-57bb7598efc6 tempest-ProjectReaderTests-845927054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4d33b6d-d6fd-4c80-8730-0a2418ab176f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e948267-3b99-42d8-894e-0cfd177008e0', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:10 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-603f05bf-bf2c-443c-8734-57bb7598efc6 tempest-ProjectReaderTests-845927054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (771e9643-c19a-493b-8d10-f19bc1d90b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:10 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-603f05bf-bf2c-443c-8734-57bb7598efc6 tempest-ProjectReaderTests-845927054 None] Volume volume-9e948267-3b99-42d8-894e-0cfd177008e0 (9e948267-3b99-42d8-894e-0cfd177008e0): created successfully Aug 10 16:15:10 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-603f05bf-bf2c-443c-8734-57bb7598efc6 tempest-ProjectReaderTests-845927054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (771e9643-c19a-493b-8d10-f19bc1d90b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:10 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-603f05bf-bf2c-443c-8734-57bb7598efc6 tempest-ProjectReaderTests-845927054 None] Flow 'volume_create_manager' (aefb1c80-564c-4a01-92cd-0942dff3dd66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:15:10 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-603f05bf-bf2c-443c-8734-57bb7598efc6 tempest-ProjectReaderTests-845927054 None] Created volume successfully. Aug 10 16:15:10 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-0572d21a-ebac-4c83-9eb7-724ee7887a1a tempest-CreateVolumesFromSnapshotTest-1045154512 None] Acquiring lock "cinder-054e3c13-16a6-4833-85d0-861028d67e1c-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:15:10 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-0572d21a-ebac-4c83-9eb7-724ee7887a1a tempest-CreateVolumesFromSnapshotTest-1045154512 None] Lock "cinder-054e3c13-16a6-4833-85d0-861028d67e1c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:15:10 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e1d9050-61fb-4cb2-b65a-1efbaac47746 tempest-VolumeDependencyTests-509891231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:15:10 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-0572d21a-ebac-4c83-9eb7-724ee7887a1a tempest-CreateVolumesFromSnapshotTest-1045154512 None] Acquiring lock "cinder-quobyte-054e3c13-16a6-4833-85d0-861028d67e1c" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:15:10 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-4e1d9050-61fb-4cb2-b65a-1efbaac47746 tempest-VolumeDependencyTests-509891231 None] Flow 'volume_create_manager' (2d9b8595-58ff-4c26-a553-79ee8899b972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:15:10 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-4e1d9050-61fb-4cb2-b65a-1efbaac47746 tempest-VolumeDependencyTests-509891231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ef79cb9-8d5a-42b8-99b9-27c14dda07a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:10 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-0572d21a-ebac-4c83-9eb7-724ee7887a1a tempest-CreateVolumesFromSnapshotTest-1045154512 None] Lock "cinder-quobyte-054e3c13-16a6-4833-85d0-861028d67e1c" acquired by "delete_volume" :: waited 0.049s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:15:10 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-4e1d9050-61fb-4cb2-b65a-1efbaac47746 tempest-VolumeDependencyTests-509891231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ef79cb9-8d5a-42b8-99b9-27c14dda07a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:15:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-397251572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b4a5c38-6e18-4592-a5c2-2016d09fdde9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='612eafeb8ee5422fafdc21fd8f14006c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:15:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d61220b4-85b3-4076-9441-5e2f7f7c6984,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:15:10Z,use_quota=True,user_id='1480289a908f45158ddad909dbf52124',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:10 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-4e1d9050-61fb-4cb2-b65a-1efbaac47746 tempest-VolumeDependencyTests-509891231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63417810-9f55-4621-9465-1f5e53d39bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:10 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-4e1d9050-61fb-4cb2-b65a-1efbaac47746 tempest-VolumeDependencyTests-509891231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63417810-9f55-4621-9465-1f5e53d39bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:10 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-4e1d9050-61fb-4cb2-b65a-1efbaac47746 tempest-VolumeDependencyTests-509891231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (846e0ea0-23bc-4420-97e4-09d9a1851e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:10 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-4e1d9050-61fb-4cb2-b65a-1efbaac47746 tempest-VolumeDependencyTests-509891231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (846e0ea0-23bc-4420-97e4-09d9a1851e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3b4a5c38-6e18-4592-a5c2-2016d09fdde9', 'volume_name': 'volume-3b4a5c38-6e18-4592-a5c2-2016d09fdde9', 'volume_size': 1, 'snapshot_id': 'd61220b4-85b3-4076-9441-5e2f7f7c6984'}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:10 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-4e1d9050-61fb-4cb2-b65a-1efbaac47746 tempest-VolumeDependencyTests-509891231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27e04398-3319-40d5-b5eb-3bd228335afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:10 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-4e1d9050-61fb-4cb2-b65a-1efbaac47746 tempest-VolumeDependencyTests-509891231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27e04398-3319-40d5-b5eb-3bd228335afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:10 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-4e1d9050-61fb-4cb2-b65a-1efbaac47746 tempest-VolumeDependencyTests-509891231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a92f0046-4ddb-4eea-8bee-f0558c9307d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:10 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-4e1d9050-61fb-4cb2-b65a-1efbaac47746 tempest-VolumeDependencyTests-509891231 None] Volume 3b4a5c38-6e18-4592-a5c2-2016d09fdde9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3b4a5c38-6e18-4592-a5c2-2016d09fdde9', 'volume_size': 1, 'snapshot_id': 'd61220b4-85b3-4076-9441-5e2f7f7c6984'} Aug 10 16:15:10 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69b58cd-f7df-456a-9c5c-80712bcb9c3b]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:15:10 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0572d21a-ebac-4c83-9eb7-724ee7887a1a tempest-CreateVolumesFromSnapshotTest-1045154512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-054e3c13-16a6-4833-85d0-861028d67e1c {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:10 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-49ac65d2-d903-4adc-a1d8-8948d8a55920 tempest-ProjectReaderTests-845927054 None] Acquiring lock "cinder-9e948267-3b99-42d8-894e-0cfd177008e0-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:15:10 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-4e1d9050-61fb-4cb2-b65a-1efbaac47746 tempest-VolumeDependencyTests-509891231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:15:10 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-4e1d9050-61fb-4cb2-b65a-1efbaac47746 tempest-VolumeDependencyTests-509891231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:15:10 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-4e1d9050-61fb-4cb2-b65a-1efbaac47746 tempest-VolumeDependencyTests-509891231 None] Acquiring lock "cinder-quobyte-d61220b4-85b3-4076-9441-5e2f7f7c6984-3b4a5c38-6e18-4592-a5c2-2016d09fdde9" by "_create_volume_from_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:15:10 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-49ac65d2-d903-4adc-a1d8-8948d8a55920 tempest-ProjectReaderTests-845927054 None] Lock "cinder-9e948267-3b99-42d8-894e-0cfd177008e0-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:15:10 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-4e1d9050-61fb-4cb2-b65a-1efbaac47746 tempest-VolumeDependencyTests-509891231 None] Lock "cinder-quobyte-d61220b4-85b3-4076-9441-5e2f7f7c6984-3b4a5c38-6e18-4592-a5c2-2016d09fdde9" acquired by "_create_volume_from_snapshot" :: waited 0.043s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:15:10 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-4e1d9050-61fb-4cb2-b65a-1efbaac47746 tempest-VolumeDependencyTests-509891231 None] Creating volume 3b4a5c38-6e18-4592-a5c2-2016d09fdde9 from snapshot d61220b4-85b3-4076-9441-5e2f7f7c6984 {{(pid=88641) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 10 16:15:10 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-4e1d9050-61fb-4cb2-b65a-1efbaac47746 tempest-VolumeDependencyTests-509891231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:15:10 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-4e1d9050-61fb-4cb2-b65a-1efbaac47746 tempest-VolumeDependencyTests-509891231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:15:10 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-4e1d9050-61fb-4cb2-b65a-1efbaac47746 tempest-VolumeDependencyTests-509891231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:15:10 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-4e1d9050-61fb-4cb2-b65a-1efbaac47746 tempest-VolumeDependencyTests-509891231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:15:10 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-4e1d9050-61fb-4cb2-b65a-1efbaac47746 tempest-VolumeDependencyTests-509891231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:15:10 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-4e1d9050-61fb-4cb2-b65a-1efbaac47746 tempest-VolumeDependencyTests-509891231 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:15:10 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-4e1d9050-61fb-4cb2-b65a-1efbaac47746 tempest-VolumeDependencyTests-509891231 None] Acquiring lock "cinder-quobyte-3b4a5c38-6e18-4592-a5c2-2016d09fdde9" by "_copy_volume_from_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:15:10 devstack sudo[108307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-054e3c13-16a6-4833-85d0-861028d67e1c Aug 10 16:15:10 devstack sudo[108307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:10 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-4e1d9050-61fb-4cb2-b65a-1efbaac47746 tempest-VolumeDependencyTests-509891231 None] Lock "cinder-quobyte-3b4a5c38-6e18-4592-a5c2-2016d09fdde9" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:15:10 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-4e1d9050-61fb-4cb2-b65a-1efbaac47746 tempest-VolumeDependencyTests-509891231 None] snapshot: d61220b4-85b3-4076-9441-5e2f7f7c6984, volume: 3b4a5c38-6e18-4592-a5c2-2016d09fdde9, {{(pid=88641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 10 16:15:10 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-49ac65d2-d903-4adc-a1d8-8948d8a55920 tempest-ProjectReaderTests-845927054 None] Acquiring lock "cinder-quobyte-9e948267-3b99-42d8-894e-0cfd177008e0" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:15:10 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-4e1d9050-61fb-4cb2-b65a-1efbaac47746 tempest-VolumeDependencyTests-509891231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:15:10 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-4e1d9050-61fb-4cb2-b65a-1efbaac47746 tempest-VolumeDependencyTests-509891231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:15:10 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-4e1d9050-61fb-4cb2-b65a-1efbaac47746 tempest-VolumeDependencyTests-509891231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:15:10 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-4e1d9050-61fb-4cb2-b65a-1efbaac47746 tempest-VolumeDependencyTests-509891231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:15:10 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-4e1d9050-61fb-4cb2-b65a-1efbaac47746 tempest-VolumeDependencyTests-509891231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:15:10 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-49ac65d2-d903-4adc-a1d8-8948d8a55920 tempest-ProjectReaderTests-845927054 None] Lock "cinder-quobyte-9e948267-3b99-42d8-894e-0cfd177008e0" acquired by "delete_volume" :: waited 0.069s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:15:10 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b60908-0d61-479d-a651-bccc3ec1ac79]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:15:10 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4e1d9050-61fb-4cb2-b65a-1efbaac47746 tempest-VolumeDependencyTests-509891231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-022bbfc3-45aa-4a33-9003-5b308b6784cd.d61220b4-85b3-4076-9441-5e2f7f7c6984 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:10 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a0f762d-e126-4eaa-92ad-ccc0b441b9d0]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:15:10 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-49ac65d2-d903-4adc-a1d8-8948d8a55920 tempest-ProjectReaderTests-845927054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9e948267-3b99-42d8-894e-0cfd177008e0 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:11 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a5ae43e-dc9f-4e8f-aaeb-a27bc5cc6921 tempest-ProjectReaderTests-1092271699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:15:11 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-1a5ae43e-dc9f-4e8f-aaeb-a27bc5cc6921 tempest-ProjectReaderTests-1092271699 None] Flow 'volume_create_manager' (3e48a668-26e8-449d-9bd2-d97c44318642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:15:11 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-1a5ae43e-dc9f-4e8f-aaeb-a27bc5cc6921 tempest-ProjectReaderTests-1092271699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51c29eb2-fd65-40b9-bc5f-d1e634a6687e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:11 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-1a5ae43e-dc9f-4e8f-aaeb-a27bc5cc6921 tempest-ProjectReaderTests-1092271699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51c29eb2-fd65-40b9-bc5f-d1e634a6687e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:15:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1516927008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de19e987-b2f2-408b-9e68-22510e74a925,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8da6b8cdad34ff69416120b23e9a25c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:15:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:15:11Z,use_quota=True,user_id='4e50367bdb2c40639a24a8a70eaa2b15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:11 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-1a5ae43e-dc9f-4e8f-aaeb-a27bc5cc6921 tempest-ProjectReaderTests-1092271699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c376552-840f-4b24-aff6-fda75ae5e82d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:11 devstack sudo[108309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-022bbfc3-45aa-4a33-9003-5b308b6784cd.d61220b4-85b3-4076-9441-5e2f7f7c6984 Aug 10 16:15:11 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-1a5ae43e-dc9f-4e8f-aaeb-a27bc5cc6921 tempest-ProjectReaderTests-1092271699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c376552-840f-4b24-aff6-fda75ae5e82d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:11 devstack sudo[108309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:11 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-1a5ae43e-dc9f-4e8f-aaeb-a27bc5cc6921 tempest-ProjectReaderTests-1092271699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae568a98-fdd6-44e5-acf8-7903dadadfee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:11 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-1a5ae43e-dc9f-4e8f-aaeb-a27bc5cc6921 tempest-ProjectReaderTests-1092271699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae568a98-fdd6-44e5-acf8-7903dadadfee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de19e987-b2f2-408b-9e68-22510e74a925', 'volume_name': 'volume-de19e987-b2f2-408b-9e68-22510e74a925', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:11 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-1a5ae43e-dc9f-4e8f-aaeb-a27bc5cc6921 tempest-ProjectReaderTests-1092271699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (256e3173-924a-4083-835f-24091483fab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:11 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-1a5ae43e-dc9f-4e8f-aaeb-a27bc5cc6921 tempest-ProjectReaderTests-1092271699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (256e3173-924a-4083-835f-24091483fab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:11 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-1a5ae43e-dc9f-4e8f-aaeb-a27bc5cc6921 tempest-ProjectReaderTests-1092271699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abdd6a4e-0322-46f2-9ad6-e1de267d4ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:11 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-1a5ae43e-dc9f-4e8f-aaeb-a27bc5cc6921 tempest-ProjectReaderTests-1092271699 None] Volume de19e987-b2f2-408b-9e68-22510e74a925: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de19e987-b2f2-408b-9e68-22510e74a925', 'volume_size': 1} Aug 10 16:15:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-1a5ae43e-dc9f-4e8f-aaeb-a27bc5cc6921 tempest-ProjectReaderTests-1092271699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:15:11 devstack sudo[108310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9e948267-3b99-42d8-894e-0cfd177008e0 Aug 10 16:15:11 devstack sudo[108310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:11 devstack sudo[108307]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0572d21a-ebac-4c83-9eb7-724ee7887a1a tempest-CreateVolumesFromSnapshotTest-1045154512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-054e3c13-16a6-4833-85d0-861028d67e1c" returned: 0 in 0.462s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0572d21a-ebac-4c83-9eb7-724ee7887a1a tempest-CreateVolumesFromSnapshotTest-1045154512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-054e3c13-16a6-4833-85d0-861028d67e1c {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:11 devstack sudo[108317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-054e3c13-16a6-4833-85d0-861028d67e1c Aug 10 16:15:11 devstack sudo[108317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:11 devstack sudo[108309]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4e1d9050-61fb-4cb2-b65a-1efbaac47746 tempest-VolumeDependencyTests-509891231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-022bbfc3-45aa-4a33-9003-5b308b6784cd.d61220b4-85b3-4076-9441-5e2f7f7c6984" returned: 0 in 0.432s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:11 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-4e1d9050-61fb-4cb2-b65a-1efbaac47746 tempest-VolumeDependencyTests-509891231 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-022bbfc3-45aa-4a33-9003-5b308b6784cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 16:15:11 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b1aabb-b343-41ba-8cb1-3faafa9533b5]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:15:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4e1d9050-61fb-4cb2-b65a-1efbaac47746 tempest-VolumeDependencyTests-509891231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-022bbfc3-45aa-4a33-9003-5b308b6784cd {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:11 devstack sudo[108310]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-49ac65d2-d903-4adc-a1d8-8948d8a55920 tempest-ProjectReaderTests-845927054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9e948267-3b99-42d8-894e-0cfd177008e0" returned: 0 in 0.443s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-49ac65d2-d903-4adc-a1d8-8948d8a55920 tempest-ProjectReaderTests-845927054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9e948267-3b99-42d8-894e-0cfd177008e0 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:11 devstack sudo[108317]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:11 devstack sudo[108327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9e948267-3b99-42d8-894e-0cfd177008e0 Aug 10 16:15:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0572d21a-ebac-4c83-9eb7-724ee7887a1a tempest-CreateVolumesFromSnapshotTest-1045154512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-054e3c13-16a6-4833-85d0-861028d67e1c" returned: 0 in 0.278s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:11 devstack sudo[108327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:11 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-0572d21a-ebac-4c83-9eb7-724ee7887a1a tempest-CreateVolumesFromSnapshotTest-1045154512 None] Lock "cinder-quobyte-054e3c13-16a6-4833-85d0-861028d67e1c" released by "delete_volume" :: held 0.879s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:15:11 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-0572d21a-ebac-4c83-9eb7-724ee7887a1a tempest-CreateVolumesFromSnapshotTest-1045154512 None] Created reservations ['256ebc74-1545-4b19-82ed-c21a545a9b19', '44e7ea6e-1e20-4cc3-a2e2-808fb412d2f8', '19c81372-18c6-415c-8c18-38a230fac07c', '5b504b7d-c2db-409d-a8af-0a302edd3181'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:15:11 devstack sudo[108326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-022bbfc3-45aa-4a33-9003-5b308b6784cd Aug 10 16:15:11 devstack sudo[108326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-0572d21a-ebac-4c83-9eb7-724ee7887a1a tempest-CreateVolumesFromSnapshotTest-1045154512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:15:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-0572d21a-ebac-4c83-9eb7-724ee7887a1a tempest-CreateVolumesFromSnapshotTest-1045154512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:15:11 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-0572d21a-ebac-4c83-9eb7-724ee7887a1a tempest-CreateVolumesFromSnapshotTest-1045154512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:15:11 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-0572d21a-ebac-4c83-9eb7-724ee7887a1a tempest-CreateVolumesFromSnapshotTest-1045154512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:15:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-0572d21a-ebac-4c83-9eb7-724ee7887a1a tempest-CreateVolumesFromSnapshotTest-1045154512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:15:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0572d21a-ebac-4c83-9eb7-724ee7887a1a tempest-CreateVolumesFromSnapshotTest-1045154512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:11 devstack sudo[108330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:15:11 devstack sudo[108330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:11 devstack sudo[108327]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-49ac65d2-d903-4adc-a1d8-8948d8a55920 tempest-ProjectReaderTests-845927054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-9e948267-3b99-42d8-894e-0cfd177008e0" returned: 0 in 0.299s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:11 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-49ac65d2-d903-4adc-a1d8-8948d8a55920 tempest-ProjectReaderTests-845927054 None] Lock "cinder-quobyte-9e948267-3b99-42d8-894e-0cfd177008e0" released by "delete_volume" :: held 0.797s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:15:11 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-49ac65d2-d903-4adc-a1d8-8948d8a55920 tempest-ProjectReaderTests-845927054 None] Created reservations ['5959ce12-c207-455a-acfc-e3c5ce419156', '2c9c4d2a-faea-47b4-8ea1-d00db93cded5', 'd9a39ac4-9fbf-4bd5-b15f-633f34c303ab', '75db7f12-43c1-4463-ae6d-4e81d134ed5b'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:15:11 devstack sudo[108326]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4e1d9050-61fb-4cb2-b65a-1efbaac47746 tempest-VolumeDependencyTests-509891231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-022bbfc3-45aa-4a33-9003-5b308b6784cd" returned: 0 in 0.450s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:11 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-4e1d9050-61fb-4cb2-b65a-1efbaac47746 tempest-VolumeDependencyTests-509891231 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-022bbfc3-45aa-4a33-9003-5b308b6784cd {{(pid=88641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 10 16:15:11 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-4e1d9050-61fb-4cb2-b65a-1efbaac47746 tempest-VolumeDependencyTests-509891231 None] Creating direct copy from snapshot {{(pid=88641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 10 16:15:11 devstack cinder-volume[88641]: DEBUG cinder.utils [None req-4e1d9050-61fb-4cb2-b65a-1efbaac47746 tempest-VolumeDependencyTests-509891231 None] Path /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3b4a5c38-6e18-4592-a5c2-2016d09fdde9 not found in is_blk_device check {{(pid=88641) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 10 16:15:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4e1d9050-61fb-4cb2-b65a-1efbaac47746 tempest-VolumeDependencyTests-509891231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-022bbfc3-45aa-4a33-9003-5b308b6784cd /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3b4a5c38-6e18-4592-a5c2-2016d09fdde9 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:11 devstack sudo[108337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-022bbfc3-45aa-4a33-9003-5b308b6784cd /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3b4a5c38-6e18-4592-a5c2-2016d09fdde9 Aug 10 16:15:11 devstack sudo[108337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-49ac65d2-d903-4adc-a1d8-8948d8a55920 tempest-ProjectReaderTests-845927054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:15:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-49ac65d2-d903-4adc-a1d8-8948d8a55920 tempest-ProjectReaderTests-845927054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:15:11 devstack sudo[108330]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:11 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-49ac65d2-d903-4adc-a1d8-8948d8a55920 tempest-ProjectReaderTests-845927054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:15:11 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-49ac65d2-d903-4adc-a1d8-8948d8a55920 tempest-ProjectReaderTests-845927054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:15:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-49ac65d2-d903-4adc-a1d8-8948d8a55920 tempest-ProjectReaderTests-845927054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:15:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-49ac65d2-d903-4adc-a1d8-8948d8a55920 tempest-ProjectReaderTests-845927054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0572d21a-ebac-4c83-9eb7-724ee7887a1a tempest-CreateVolumesFromSnapshotTest-1045154512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.312s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:11 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-0572d21a-ebac-4c83-9eb7-724ee7887a1a tempest-CreateVolumesFromSnapshotTest-1045154512 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:15:11 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-0572d21a-ebac-4c83-9eb7-724ee7887a1a tempest-CreateVolumesFromSnapshotTest-1045154512 None] Deleted volume successfully. Aug 10 16:15:11 devstack sudo[108339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:15:11 devstack sudo[108339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:11 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-0572d21a-ebac-4c83-9eb7-724ee7887a1a tempest-CreateVolumesFromSnapshotTest-1045154512 None] Lock "cinder-054e3c13-16a6-4833-85d0-861028d67e1c-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:15:12 devstack sudo[108339]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:12 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-49ac65d2-d903-4adc-a1d8-8948d8a55920 tempest-ProjectReaderTests-845927054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.301s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:12 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-49ac65d2-d903-4adc-a1d8-8948d8a55920 tempest-ProjectReaderTests-845927054 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:15:12 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-49ac65d2-d903-4adc-a1d8-8948d8a55920 tempest-ProjectReaderTests-845927054 None] Deleted volume successfully. Aug 10 16:15:12 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-49ac65d2-d903-4adc-a1d8-8948d8a55920 tempest-ProjectReaderTests-845927054 None] Lock "cinder-9e948267-3b99-42d8-894e-0cfd177008e0-delete_volume" released by "delete_volume" :: held 1.470s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:15:12 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a9980ef-346d-4cc0-ba85-c2e66a91c3e8 tempest-ProjectReaderTests-845927054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:15:12 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-0a9980ef-346d-4cc0-ba85-c2e66a91c3e8 tempest-ProjectReaderTests-845927054 None] Flow 'volume_create_manager' (74caa7e5-01eb-4a30-a9c7-8fc5e8a0d661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:15:12 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-0a9980ef-346d-4cc0-ba85-c2e66a91c3e8 tempest-ProjectReaderTests-845927054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (033f745d-5459-455a-a083-e642f962cd25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:12 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-0a9980ef-346d-4cc0-ba85-c2e66a91c3e8 tempest-ProjectReaderTests-845927054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (033f745d-5459-455a-a083-e642f962cd25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:15:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-9946977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70410b55-d5b4-4038-804a-1bce1976bdd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='facb635ed4174975915b23b03172230d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:15:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:15:12Z,use_quota=True,user_id='4e3477f77fae4ce3a793c4908c365497',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:12 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-0a9980ef-346d-4cc0-ba85-c2e66a91c3e8 tempest-ProjectReaderTests-845927054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b8e546c-3f54-4526-99b4-c1d26d779fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:12 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-0a9980ef-346d-4cc0-ba85-c2e66a91c3e8 tempest-ProjectReaderTests-845927054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b8e546c-3f54-4526-99b4-c1d26d779fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:12 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-0a9980ef-346d-4cc0-ba85-c2e66a91c3e8 tempest-ProjectReaderTests-845927054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e26f1ccc-e04a-4ce8-864c-a81ba9a58875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:12 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-0a9980ef-346d-4cc0-ba85-c2e66a91c3e8 tempest-ProjectReaderTests-845927054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e26f1ccc-e04a-4ce8-864c-a81ba9a58875) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70410b55-d5b4-4038-804a-1bce1976bdd9', 'volume_name': 'volume-70410b55-d5b4-4038-804a-1bce1976bdd9', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:12 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-0a9980ef-346d-4cc0-ba85-c2e66a91c3e8 tempest-ProjectReaderTests-845927054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a260844-3022-4b52-a05c-5e57bcd9f3c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:12 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-0a9980ef-346d-4cc0-ba85-c2e66a91c3e8 tempest-ProjectReaderTests-845927054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a260844-3022-4b52-a05c-5e57bcd9f3c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:12 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-0a9980ef-346d-4cc0-ba85-c2e66a91c3e8 tempest-ProjectReaderTests-845927054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (584f37cd-95ec-43d7-9d66-7f7f6b8975dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:12 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-0a9980ef-346d-4cc0-ba85-c2e66a91c3e8 tempest-ProjectReaderTests-845927054 None] Volume 70410b55-d5b4-4038-804a-1bce1976bdd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70410b55-d5b4-4038-804a-1bce1976bdd9', 'volume_size': 1} Aug 10 16:15:12 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-0a9980ef-346d-4cc0-ba85-c2e66a91c3e8 tempest-ProjectReaderTests-845927054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:15:17 devstack sudo[108337]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4e1d9050-61fb-4cb2-b65a-1efbaac47746 tempest-VolumeDependencyTests-509891231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-022bbfc3-45aa-4a33-9003-5b308b6784cd /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3b4a5c38-6e18-4592-a5c2-2016d09fdde9" returned: 0 in 5.300s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:17 devstack cinder-volume[88641]: DEBUG cinder.image.image_utils [None req-4e1d9050-61fb-4cb2-b65a-1efbaac47746 tempest-VolumeDependencyTests-509891231 None] Image conversion details: src /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-022bbfc3-45aa-4a33-9003-5b308b6784cd, size 1024.00 MB, duration 5.30 sec, destination /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3b4a5c38-6e18-4592-a5c2-2016d09fdde9 {{(pid=88641) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 10 16:15:17 devstack cinder-volume[88641]: INFO cinder.image.image_utils [None req-4e1d9050-61fb-4cb2-b65a-1efbaac47746 tempest-VolumeDependencyTests-509891231 None] Converted 1024.00 MB image at 193.12 MB/s Aug 10 16:15:17 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-4e1d9050-61fb-4cb2-b65a-1efbaac47746 tempest-VolumeDependencyTests-509891231 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3b4a5c38-6e18-4592-a5c2-2016d09fdde9 is being set with open permissions: ugo+rw Aug 10 16:15:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4e1d9050-61fb-4cb2-b65a-1efbaac47746 tempest-VolumeDependencyTests-509891231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3b4a5c38-6e18-4592-a5c2-2016d09fdde9 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:17 devstack sudo[108354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3b4a5c38-6e18-4592-a5c2-2016d09fdde9 Aug 10 16:15:17 devstack sudo[108354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:17 devstack sudo[108354]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4e1d9050-61fb-4cb2-b65a-1efbaac47746 tempest-VolumeDependencyTests-509891231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3b4a5c38-6e18-4592-a5c2-2016d09fdde9" returned: 0 in 0.252s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:17 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-4e1d9050-61fb-4cb2-b65a-1efbaac47746 tempest-VolumeDependencyTests-509891231 None] Lock "cinder-quobyte-3b4a5c38-6e18-4592-a5c2-2016d09fdde9" released by "_copy_volume_from_snapshot" :: held 6.577s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:15:17 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-4e1d9050-61fb-4cb2-b65a-1efbaac47746 tempest-VolumeDependencyTests-509891231 None] Lock "cinder-quobyte-d61220b4-85b3-4076-9441-5e2f7f7c6984-3b4a5c38-6e18-4592-a5c2-2016d09fdde9" released by "_create_volume_from_snapshot" :: held 6.657s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:15:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-4e1d9050-61fb-4cb2-b65a-1efbaac47746 tempest-VolumeDependencyTests-509891231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.701s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:15:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-1a5ae43e-dc9f-4e8f-aaeb-a27bc5cc6921 tempest-ProjectReaderTests-1092271699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.345s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:15:17 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-1a5ae43e-dc9f-4e8f-aaeb-a27bc5cc6921 tempest-ProjectReaderTests-1092271699 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:15:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1516927008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de19e987-b2f2-408b-9e68-22510e74a925,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8da6b8cdad34ff69416120b23e9a25c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:15:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:15:11Z,use_quota=True,user_id='4e50367bdb2c40639a24a8a70eaa2b15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:15:17 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-1a5ae43e-dc9f-4e8f-aaeb-a27bc5cc6921 tempest-ProjectReaderTests-1092271699 None] Creating volume de19e987-b2f2-408b-9e68-22510e74a925 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:15:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-1a5ae43e-dc9f-4e8f-aaeb-a27bc5cc6921 tempest-ProjectReaderTests-1092271699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:15:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-1a5ae43e-dc9f-4e8f-aaeb-a27bc5cc6921 tempest-ProjectReaderTests-1092271699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:15:17 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-1a5ae43e-dc9f-4e8f-aaeb-a27bc5cc6921 tempest-ProjectReaderTests-1092271699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:15:17 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-1a5ae43e-dc9f-4e8f-aaeb-a27bc5cc6921 tempest-ProjectReaderTests-1092271699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:15:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-1a5ae43e-dc9f-4e8f-aaeb-a27bc5cc6921 tempest-ProjectReaderTests-1092271699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:15:17 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-1a5ae43e-dc9f-4e8f-aaeb-a27bc5cc6921 tempest-ProjectReaderTests-1092271699 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:15:17 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-1a5ae43e-dc9f-4e8f-aaeb-a27bc5cc6921 tempest-ProjectReaderTests-1092271699 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:15:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-1a5ae43e-dc9f-4e8f-aaeb-a27bc5cc6921 tempest-ProjectReaderTests-1092271699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-de19e987-b2f2-408b-9e68-22510e74a925 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:17 devstack sudo[108357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-de19e987-b2f2-408b-9e68-22510e74a925 1073741824 Aug 10 16:15:17 devstack sudo[108357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:17 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-4e1d9050-61fb-4cb2-b65a-1efbaac47746 tempest-VolumeDependencyTests-509891231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a92f0046-4ddb-4eea-8bee-f0558c9307d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b4a5c38-6e18-4592-a5c2-2016d09fdde9', 'volume_size': 1, 'snapshot_id': 'd61220b4-85b3-4076-9441-5e2f7f7c6984'}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:17 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-4e1d9050-61fb-4cb2-b65a-1efbaac47746 tempest-VolumeDependencyTests-509891231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98b13fd0-d6f9-4995-b723-f2269914d82d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:17 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-4e1d9050-61fb-4cb2-b65a-1efbaac47746 tempest-VolumeDependencyTests-509891231 None] Volume volume-3b4a5c38-6e18-4592-a5c2-2016d09fdde9 (3b4a5c38-6e18-4592-a5c2-2016d09fdde9): created successfully Aug 10 16:15:17 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-4e1d9050-61fb-4cb2-b65a-1efbaac47746 tempest-VolumeDependencyTests-509891231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98b13fd0-d6f9-4995-b723-f2269914d82d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:17 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-4e1d9050-61fb-4cb2-b65a-1efbaac47746 tempest-VolumeDependencyTests-509891231 None] Flow 'volume_create_manager' (2d9b8595-58ff-4c26-a553-79ee8899b972) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:15:17 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-4e1d9050-61fb-4cb2-b65a-1efbaac47746 tempest-VolumeDependencyTests-509891231 None] Created volume successfully. Aug 10 16:15:18 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2207d3f-d3bf-41b8-9b0b-40177b979c71 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:15:18 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b2207d3f-d3bf-41b8-9b0b-40177b979c71 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Flow 'volume_create_manager' (1c514050-a8e6-4677-a43b-0b99ca1bf4b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:15:18 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b2207d3f-d3bf-41b8-9b0b-40177b979c71 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8730d84-c30f-4503-841a-71f9b6a9fb16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:18 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b2207d3f-d3bf-41b8-9b0b-40177b979c71 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8730d84-c30f-4503-841a-71f9b6a9fb16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:15:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-411624764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f76d20f0-0ec5-4846-96f4-5b24643e27e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccf5be2b44e0412686562e3b1a2f3ddb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:15:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:15:18Z,use_quota=True,user_id='fa422d25b7c64f18b45e7eea99148691',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:18 devstack sudo[108357]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:18 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b2207d3f-d3bf-41b8-9b0b-40177b979c71 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a3fb5b3-f432-467d-a3c3-26847c38eb0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:18 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b2207d3f-d3bf-41b8-9b0b-40177b979c71 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a3fb5b3-f432-467d-a3c3-26847c38eb0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:18 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b2207d3f-d3bf-41b8-9b0b-40177b979c71 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5fc3998-0629-4c1f-997c-92ed047d9425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:18 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b2207d3f-d3bf-41b8-9b0b-40177b979c71 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5fc3998-0629-4c1f-997c-92ed047d9425) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f76d20f0-0ec5-4846-96f4-5b24643e27e7', 'volume_name': 'volume-f76d20f0-0ec5-4846-96f4-5b24643e27e7', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:18 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b2207d3f-d3bf-41b8-9b0b-40177b979c71 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0b5b340-f923-4bf9-9502-7956dabb54ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:18 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b2207d3f-d3bf-41b8-9b0b-40177b979c71 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0b5b340-f923-4bf9-9502-7956dabb54ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:18 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b2207d3f-d3bf-41b8-9b0b-40177b979c71 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6a9ed12-0b46-4fe4-96d4-60a777091343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:18 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-b2207d3f-d3bf-41b8-9b0b-40177b979c71 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Volume f76d20f0-0ec5-4846-96f4-5b24643e27e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f76d20f0-0ec5-4846-96f4-5b24643e27e7', 'volume_size': 1} Aug 10 16:15:18 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-b2207d3f-d3bf-41b8-9b0b-40177b979c71 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:15:18 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-1a5ae43e-dc9f-4e8f-aaeb-a27bc5cc6921 tempest-ProjectReaderTests-1092271699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-de19e987-b2f2-408b-9e68-22510e74a925 1073741824" returned: 0 in 0.601s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:18 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-1a5ae43e-dc9f-4e8f-aaeb-a27bc5cc6921 tempest-ProjectReaderTests-1092271699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-de19e987-b2f2-408b-9e68-22510e74a925 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:18 devstack sudo[108363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-de19e987-b2f2-408b-9e68-22510e74a925 Aug 10 16:15:18 devstack sudo[108363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:18 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-2e40db9a-92c2-4816-9e49-40e072aa94a7 tempest-VolumeDependencyTests-509891231 None] Acquiring lock "cinder-d61220b4-85b3-4076-9441-5e2f7f7c6984-delete_snapshot" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:15:18 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-2e40db9a-92c2-4816-9e49-40e072aa94a7 tempest-VolumeDependencyTests-509891231 None] Lock "cinder-d61220b4-85b3-4076-9441-5e2f7f7c6984-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:15:18 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-2e40db9a-92c2-4816-9e49-40e072aa94a7 tempest-VolumeDependencyTests-509891231 None] Acquiring lock "cinder-quobyte-022bbfc3-45aa-4a33-9003-5b308b6784cd" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:15:18 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-2e40db9a-92c2-4816-9e49-40e072aa94a7 tempest-VolumeDependencyTests-509891231 None] Lock "cinder-quobyte-022bbfc3-45aa-4a33-9003-5b308b6784cd" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:15:18 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-2e40db9a-92c2-4816-9e49-40e072aa94a7 tempest-VolumeDependencyTests-509891231 None] Acquiring lock "cinder-quobyte-d61220b4-85b3-4076-9441-5e2f7f7c6984" by "_delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:15:18 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-2e40db9a-92c2-4816-9e49-40e072aa94a7 tempest-VolumeDependencyTests-509891231 None] Lock "cinder-quobyte-d61220b4-85b3-4076-9441-5e2f7f7c6984" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:15:18 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-2e40db9a-92c2-4816-9e49-40e072aa94a7 tempest-VolumeDependencyTests-509891231 None] Deleting offline snapshot d61220b4-85b3-4076-9441-5e2f7f7c6984 of volume 022bbfc3-45aa-4a33-9003-5b308b6784cd {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 16:15:18 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-2e40db9a-92c2-4816-9e49-40e072aa94a7 tempest-VolumeDependencyTests-509891231 None] snapshot_file for this snap is: volume-022bbfc3-45aa-4a33-9003-5b308b6784cd.d61220b4-85b3-4076-9441-5e2f7f7c6984 {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 16:15:18 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ff9946-ecd8-4d66-9ac2-b5fcea608f35]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:15:18 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-2e40db9a-92c2-4816-9e49-40e072aa94a7 tempest-VolumeDependencyTests-509891231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-022bbfc3-45aa-4a33-9003-5b308b6784cd.d61220b4-85b3-4076-9441-5e2f7f7c6984 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:18 devstack sudo[108363]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:18 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-1a5ae43e-dc9f-4e8f-aaeb-a27bc5cc6921 tempest-ProjectReaderTests-1092271699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-de19e987-b2f2-408b-9e68-22510e74a925" returned: 0 in 0.271s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:18 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-1a5ae43e-dc9f-4e8f-aaeb-a27bc5cc6921 tempest-ProjectReaderTests-1092271699 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:15:18 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-1a5ae43e-dc9f-4e8f-aaeb-a27bc5cc6921 tempest-ProjectReaderTests-1092271699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:15:18 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-0a9980ef-346d-4cc0-ba85-c2e66a91c3e8 tempest-ProjectReaderTests-845927054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.655s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:15:18 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-0a9980ef-346d-4cc0-ba85-c2e66a91c3e8 tempest-ProjectReaderTests-845927054 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:15:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-9946977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70410b55-d5b4-4038-804a-1bce1976bdd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='facb635ed4174975915b23b03172230d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:15:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:15:12Z,use_quota=True,user_id='4e3477f77fae4ce3a793c4908c365497',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:15:18 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-0a9980ef-346d-4cc0-ba85-c2e66a91c3e8 tempest-ProjectReaderTests-845927054 None] Creating volume 70410b55-d5b4-4038-804a-1bce1976bdd9 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:15:18 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-0a9980ef-346d-4cc0-ba85-c2e66a91c3e8 tempest-ProjectReaderTests-845927054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:15:18 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-0a9980ef-346d-4cc0-ba85-c2e66a91c3e8 tempest-ProjectReaderTests-845927054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:15:18 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-0a9980ef-346d-4cc0-ba85-c2e66a91c3e8 tempest-ProjectReaderTests-845927054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:15:18 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-0a9980ef-346d-4cc0-ba85-c2e66a91c3e8 tempest-ProjectReaderTests-845927054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:15:18 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-0a9980ef-346d-4cc0-ba85-c2e66a91c3e8 tempest-ProjectReaderTests-845927054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:15:18 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-0a9980ef-346d-4cc0-ba85-c2e66a91c3e8 tempest-ProjectReaderTests-845927054 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:15:18 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-0a9980ef-346d-4cc0-ba85-c2e66a91c3e8 tempest-ProjectReaderTests-845927054 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:15:18 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0a9980ef-346d-4cc0-ba85-c2e66a91c3e8 tempest-ProjectReaderTests-845927054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-70410b55-d5b4-4038-804a-1bce1976bdd9 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:18 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-1a5ae43e-dc9f-4e8f-aaeb-a27bc5cc6921 tempest-ProjectReaderTests-1092271699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abdd6a4e-0322-46f2-9ad6-e1de267d4ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de19e987-b2f2-408b-9e68-22510e74a925', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:18 devstack sudo[108367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-70410b55-d5b4-4038-804a-1bce1976bdd9 1073741824 Aug 10 16:15:18 devstack sudo[108367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:18 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-1a5ae43e-dc9f-4e8f-aaeb-a27bc5cc6921 tempest-ProjectReaderTests-1092271699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa22a104-8c57-4ee8-a69a-1b024ca403e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:18 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-1a5ae43e-dc9f-4e8f-aaeb-a27bc5cc6921 tempest-ProjectReaderTests-1092271699 None] Volume volume-de19e987-b2f2-408b-9e68-22510e74a925 (de19e987-b2f2-408b-9e68-22510e74a925): created successfully Aug 10 16:15:18 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-1a5ae43e-dc9f-4e8f-aaeb-a27bc5cc6921 tempest-ProjectReaderTests-1092271699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa22a104-8c57-4ee8-a69a-1b024ca403e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:18 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-1a5ae43e-dc9f-4e8f-aaeb-a27bc5cc6921 tempest-ProjectReaderTests-1092271699 None] Flow 'volume_create_manager' (3e48a668-26e8-449d-9bd2-d97c44318642) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:15:18 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-1a5ae43e-dc9f-4e8f-aaeb-a27bc5cc6921 tempest-ProjectReaderTests-1092271699 None] Created volume successfully. Aug 10 16:15:18 devstack sudo[108366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-022bbfc3-45aa-4a33-9003-5b308b6784cd.d61220b4-85b3-4076-9441-5e2f7f7c6984 Aug 10 16:15:18 devstack sudo[108366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:18 devstack sudo[108366]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:18 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-2e40db9a-92c2-4816-9e49-40e072aa94a7 tempest-VolumeDependencyTests-509891231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-022bbfc3-45aa-4a33-9003-5b308b6784cd.d61220b4-85b3-4076-9441-5e2f7f7c6984" returned: 0 in 0.410s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:18 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-2e40db9a-92c2-4816-9e49-40e072aa94a7 tempest-VolumeDependencyTests-509891231 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-022bbfc3-45aa-4a33-9003-5b308b6784cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 16:15:18 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[c977cc65-0b94-4314-b947-559063fa1012]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:15:18 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-2e40db9a-92c2-4816-9e49-40e072aa94a7 tempest-VolumeDependencyTests-509891231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-022bbfc3-45aa-4a33-9003-5b308b6784cd {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-5e8d088d-609e-482e-a463-5b14aa29daaf tempest-ProjectReaderTests-1092271699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:15:19 devstack sudo[108367]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0a9980ef-346d-4cc0-ba85-c2e66a91c3e8 tempest-ProjectReaderTests-845927054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-70410b55-d5b4-4038-804a-1bce1976bdd9 1073741824" returned: 0 in 0.580s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:19 devstack sudo[108377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-022bbfc3-45aa-4a33-9003-5b308b6784cd Aug 10 16:15:19 devstack sudo[108377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0a9980ef-346d-4cc0-ba85-c2e66a91c3e8 tempest-ProjectReaderTests-845927054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-70410b55-d5b4-4038-804a-1bce1976bdd9 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:19 devstack sudo[108380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-70410b55-d5b4-4038-804a-1bce1976bdd9 Aug 10 16:15:19 devstack sudo[108380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:19 devstack sudo[108380]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0a9980ef-346d-4cc0-ba85-c2e66a91c3e8 tempest-ProjectReaderTests-845927054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-70410b55-d5b4-4038-804a-1bce1976bdd9" returned: 0 in 0.278s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:19 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-0a9980ef-346d-4cc0-ba85-c2e66a91c3e8 tempest-ProjectReaderTests-845927054 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:15:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-0a9980ef-346d-4cc0-ba85-c2e66a91c3e8 tempest-ProjectReaderTests-845927054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:15:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-b2207d3f-d3bf-41b8-9b0b-40177b979c71 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.325s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:15:19 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-b2207d3f-d3bf-41b8-9b0b-40177b979c71 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:15:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-411624764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f76d20f0-0ec5-4846-96f4-5b24643e27e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccf5be2b44e0412686562e3b1a2f3ddb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:15:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:15:18Z,use_quota=True,user_id='fa422d25b7c64f18b45e7eea99148691',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:15:19 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-b2207d3f-d3bf-41b8-9b0b-40177b979c71 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Creating volume f76d20f0-0ec5-4846-96f4-5b24643e27e7 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:15:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-b2207d3f-d3bf-41b8-9b0b-40177b979c71 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:15:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-b2207d3f-d3bf-41b8-9b0b-40177b979c71 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:15:19 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-b2207d3f-d3bf-41b8-9b0b-40177b979c71 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:15:19 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-b2207d3f-d3bf-41b8-9b0b-40177b979c71 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:15:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-b2207d3f-d3bf-41b8-9b0b-40177b979c71 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:15:19 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-b2207d3f-d3bf-41b8-9b0b-40177b979c71 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:15:19 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-b2207d3f-d3bf-41b8-9b0b-40177b979c71 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:15:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b2207d3f-d3bf-41b8-9b0b-40177b979c71 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f76d20f0-0ec5-4846-96f4-5b24643e27e7 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:19 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-0a9980ef-346d-4cc0-ba85-c2e66a91c3e8 tempest-ProjectReaderTests-845927054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (584f37cd-95ec-43d7-9d66-7f7f6b8975dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70410b55-d5b4-4038-804a-1bce1976bdd9', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:19 devstack sudo[108385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f76d20f0-0ec5-4846-96f4-5b24643e27e7 1073741824 Aug 10 16:15:19 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-0a9980ef-346d-4cc0-ba85-c2e66a91c3e8 tempest-ProjectReaderTests-845927054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d40305e-92bc-4c08-838a-28281688519a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:19 devstack sudo[108385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:19 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-0a9980ef-346d-4cc0-ba85-c2e66a91c3e8 tempest-ProjectReaderTests-845927054 None] Volume volume-70410b55-d5b4-4038-804a-1bce1976bdd9 (70410b55-d5b4-4038-804a-1bce1976bdd9): created successfully Aug 10 16:15:19 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-0a9980ef-346d-4cc0-ba85-c2e66a91c3e8 tempest-ProjectReaderTests-845927054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d40305e-92bc-4c08-838a-28281688519a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:19 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-0a9980ef-346d-4cc0-ba85-c2e66a91c3e8 tempest-ProjectReaderTests-845927054 None] Flow 'volume_create_manager' (74caa7e5-01eb-4a30-a9c7-8fc5e8a0d661) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:15:19 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-0a9980ef-346d-4cc0-ba85-c2e66a91c3e8 tempest-ProjectReaderTests-845927054 None] Created volume successfully. Aug 10 16:15:19 devstack sudo[108377]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-2e40db9a-92c2-4816-9e49-40e072aa94a7 tempest-VolumeDependencyTests-509891231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-022bbfc3-45aa-4a33-9003-5b308b6784cd" returned: 0 in 0.617s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-2e40db9a-92c2-4816-9e49-40e072aa94a7 tempest-VolumeDependencyTests-509891231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-022bbfc3-45aa-4a33-9003-5b308b6784cd.d61220b4-85b3-4076-9441-5e2f7f7c6984 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:19 devstack sudo[108388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-022bbfc3-45aa-4a33-9003-5b308b6784cd.d61220b4-85b3-4076-9441-5e2f7f7c6984 Aug 10 16:15:19 devstack sudo[108388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:19 devstack sudo[108385]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b2207d3f-d3bf-41b8-9b0b-40177b979c71 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f76d20f0-0ec5-4846-96f4-5b24643e27e7 1073741824" returned: 0 in 0.448s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:19 devstack sudo[108388]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-2e40db9a-92c2-4816-9e49-40e072aa94a7 tempest-VolumeDependencyTests-509891231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-022bbfc3-45aa-4a33-9003-5b308b6784cd.d61220b4-85b3-4076-9441-5e2f7f7c6984" returned: 0 in 0.350s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-2e40db9a-92c2-4816-9e49-40e072aa94a7 tempest-VolumeDependencyTests-509891231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-022bbfc3-45aa-4a33-9003-5b308b6784cd.d61220b4-85b3-4076-9441-5e2f7f7c6984 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:19 devstack sudo[108397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-022bbfc3-45aa-4a33-9003-5b308b6784cd.d61220b4-85b3-4076-9441-5e2f7f7c6984 Aug 10 16:15:19 devstack sudo[108397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b2207d3f-d3bf-41b8-9b0b-40177b979c71 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f76d20f0-0ec5-4846-96f4-5b24643e27e7 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:19 devstack sudo[108399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f76d20f0-0ec5-4846-96f4-5b24643e27e7 Aug 10 16:15:19 devstack sudo[108399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:20 devstack sudo[108397]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:20 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-2e40db9a-92c2-4816-9e49-40e072aa94a7 tempest-VolumeDependencyTests-509891231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-022bbfc3-45aa-4a33-9003-5b308b6784cd.d61220b4-85b3-4076-9441-5e2f7f7c6984" returned: 0 in 0.255s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:20 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-2e40db9a-92c2-4816-9e49-40e072aa94a7 tempest-VolumeDependencyTests-509891231 None] Lock "cinder-quobyte-d61220b4-85b3-4076-9441-5e2f7f7c6984" released by "_delete_snapshot" :: held 1.792s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:15:20 devstack sudo[108399]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:20 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-2e40db9a-92c2-4816-9e49-40e072aa94a7 tempest-VolumeDependencyTests-509891231 None] Lock "cinder-quobyte-022bbfc3-45aa-4a33-9003-5b308b6784cd" released by "delete_snapshot" :: held 1.817s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:15:20 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b2207d3f-d3bf-41b8-9b0b-40177b979c71 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f76d20f0-0ec5-4846-96f4-5b24643e27e7" returned: 0 in 0.273s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:20 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-b2207d3f-d3bf-41b8-9b0b-40177b979c71 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:15:20 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-b2207d3f-d3bf-41b8-9b0b-40177b979c71 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:15:20 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-5e8d088d-609e-482e-a463-5b14aa29daaf tempest-ProjectReaderTests-1092271699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.204s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:15:20 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b2207d3f-d3bf-41b8-9b0b-40177b979c71 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6a9ed12-0b46-4fe4-96d4-60a777091343) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f76d20f0-0ec5-4846-96f4-5b24643e27e7', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:20 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b2207d3f-d3bf-41b8-9b0b-40177b979c71 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba93c55f-2680-4ccc-8ab8-d846c241b28a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:20 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-5e8d088d-609e-482e-a463-5b14aa29daaf tempest-ProjectReaderTests-1092271699 None] Creating offline snapshot 4e2984bb-d6bf-4ceb-84c2-eabaf95efa2f of volume de19e987-b2f2-408b-9e68-22510e74a925 {{(pid=88641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 16:15:20 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-b2207d3f-d3bf-41b8-9b0b-40177b979c71 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Volume volume-f76d20f0-0ec5-4846-96f4-5b24643e27e7 (f76d20f0-0ec5-4846-96f4-5b24643e27e7): created successfully Aug 10 16:15:20 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b2207d3f-d3bf-41b8-9b0b-40177b979c71 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba93c55f-2680-4ccc-8ab8-d846c241b28a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:20 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b2207d3f-d3bf-41b8-9b0b-40177b979c71 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Flow 'volume_create_manager' (1c514050-a8e6-4677-a43b-0b99ca1bf4b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:15:20 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ec08c6-5a58-4775-918a-0330dd28c9ef]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:15:20 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5e8d088d-609e-482e-a463-5b14aa29daaf tempest-ProjectReaderTests-1092271699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-de19e987-b2f2-408b-9e68-22510e74a925 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:20 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-b2207d3f-d3bf-41b8-9b0b-40177b979c71 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Created volume successfully. Aug 10 16:15:20 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-225cea79-22f9-4ed7-9d69-665912f198f0 tempest-ProjectReaderTests-845927054 None] Acquiring lock "cinder-70410b55-d5b4-4038-804a-1bce1976bdd9-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:15:20 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-225cea79-22f9-4ed7-9d69-665912f198f0 tempest-ProjectReaderTests-845927054 None] Lock "cinder-70410b55-d5b4-4038-804a-1bce1976bdd9-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:15:20 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-2e40db9a-92c2-4816-9e49-40e072aa94a7 tempest-VolumeDependencyTests-509891231 None] Created reservations ['50c89357-69ab-4833-8981-f29a13ea709f', 'd8a65607-4507-4162-9d64-1876fe57acb2', '298325fe-591d-4843-87a5-663f664217fb', '0f4bc998-2928-4b20-b1a1-de6d5741f40a'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:15:20 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-225cea79-22f9-4ed7-9d69-665912f198f0 tempest-ProjectReaderTests-845927054 None] Acquiring lock "cinder-quobyte-70410b55-d5b4-4038-804a-1bce1976bdd9" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:15:20 devstack sudo[108403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-de19e987-b2f2-408b-9e68-22510e74a925 Aug 10 16:15:20 devstack sudo[108403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:20 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-225cea79-22f9-4ed7-9d69-665912f198f0 tempest-ProjectReaderTests-845927054 None] Lock "cinder-quobyte-70410b55-d5b4-4038-804a-1bce1976bdd9" acquired by "delete_volume" :: waited 0.027s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:15:20 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-2e40db9a-92c2-4816-9e49-40e072aa94a7 tempest-VolumeDependencyTests-509891231 None] Delete snapshot completed successfully. Aug 10 16:15:20 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5660872-c2e4-481b-a084-ebf93e3af302]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:15:20 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-225cea79-22f9-4ed7-9d69-665912f198f0 tempest-ProjectReaderTests-845927054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-70410b55-d5b4-4038-804a-1bce1976bdd9 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:20 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-2e40db9a-92c2-4816-9e49-40e072aa94a7 tempest-VolumeDependencyTests-509891231 None] Lock "cinder-d61220b4-85b3-4076-9441-5e2f7f7c6984-delete_snapshot" released by "delete_snapshot" :: held 2.138s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:15:20 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-070a68c6-1c29-406f-86ff-a4501134793e tempest-VolumeDependencyTests-509891231 None] Acquiring lock "cinder-022bbfc3-45aa-4a33-9003-5b308b6784cd-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:15:20 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-070a68c6-1c29-406f-86ff-a4501134793e tempest-VolumeDependencyTests-509891231 None] Lock "cinder-022bbfc3-45aa-4a33-9003-5b308b6784cd-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:15:20 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-070a68c6-1c29-406f-86ff-a4501134793e tempest-VolumeDependencyTests-509891231 None] Acquiring lock "cinder-quobyte-022bbfc3-45aa-4a33-9003-5b308b6784cd" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:15:20 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-070a68c6-1c29-406f-86ff-a4501134793e tempest-VolumeDependencyTests-509891231 None] Lock "cinder-quobyte-022bbfc3-45aa-4a33-9003-5b308b6784cd" acquired by "delete_volume" :: waited 0.019s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:15:20 devstack sudo[108405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-70410b55-d5b4-4038-804a-1bce1976bdd9 Aug 10 16:15:20 devstack sudo[108405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:20 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[f855f410-9663-4f0c-9043-bb105615d1f4]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:15:20 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-070a68c6-1c29-406f-86ff-a4501134793e tempest-VolumeDependencyTests-509891231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-022bbfc3-45aa-4a33-9003-5b308b6784cd {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:20 devstack sudo[108403]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:20 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5e8d088d-609e-482e-a463-5b14aa29daaf tempest-ProjectReaderTests-1092271699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-de19e987-b2f2-408b-9e68-22510e74a925" returned: 0 in 0.432s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:20 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5e8d088d-609e-482e-a463-5b14aa29daaf tempest-ProjectReaderTests-1092271699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-de19e987-b2f2-408b-9e68-22510e74a925,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-de19e987-b2f2-408b-9e68-22510e74a925.4e2984bb-d6bf-4ceb-84c2-eabaf95efa2f 1G {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:20 devstack sudo[108411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-de19e987-b2f2-408b-9e68-22510e74a925,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-de19e987-b2f2-408b-9e68-22510e74a925.4e2984bb-d6bf-4ceb-84c2-eabaf95efa2f 1G Aug 10 16:15:20 devstack sudo[108411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:20 devstack sudo[108410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-022bbfc3-45aa-4a33-9003-5b308b6784cd Aug 10 16:15:20 devstack sudo[108410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:20 devstack sudo[108405]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:20 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-225cea79-22f9-4ed7-9d69-665912f198f0 tempest-ProjectReaderTests-845927054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-70410b55-d5b4-4038-804a-1bce1976bdd9" returned: 0 in 0.463s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:20 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-225cea79-22f9-4ed7-9d69-665912f198f0 tempest-ProjectReaderTests-845927054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-70410b55-d5b4-4038-804a-1bce1976bdd9 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:21 devstack sudo[108419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-70410b55-d5b4-4038-804a-1bce1976bdd9 Aug 10 16:15:21 devstack sudo[108419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:21 devstack sudo[108410]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:21 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-070a68c6-1c29-406f-86ff-a4501134793e tempest-VolumeDependencyTests-509891231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-022bbfc3-45aa-4a33-9003-5b308b6784cd" returned: 0 in 0.423s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:21 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-070a68c6-1c29-406f-86ff-a4501134793e tempest-VolumeDependencyTests-509891231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-022bbfc3-45aa-4a33-9003-5b308b6784cd {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:21 devstack sudo[108425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-022bbfc3-45aa-4a33-9003-5b308b6784cd Aug 10 16:15:21 devstack sudo[108425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:21 devstack sudo[108411]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:21 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5e8d088d-609e-482e-a463-5b14aa29daaf tempest-ProjectReaderTests-1092271699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-de19e987-b2f2-408b-9e68-22510e74a925,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-de19e987-b2f2-408b-9e68-22510e74a925.4e2984bb-d6bf-4ceb-84c2-eabaf95efa2f 1G" returned: 0 in 0.524s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:21 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5e8d088d-609e-482e-a463-5b14aa29daaf tempest-ProjectReaderTests-1092271699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de19e987-b2f2-408b-9e68-22510e74a925 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-de19e987-b2f2-408b-9e68-22510e74a925.4e2984bb-d6bf-4ceb-84c2-eabaf95efa2f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:21 devstack sudo[108429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de19e987-b2f2-408b-9e68-22510e74a925 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-de19e987-b2f2-408b-9e68-22510e74a925.4e2984bb-d6bf-4ceb-84c2-eabaf95efa2f Aug 10 16:15:21 devstack sudo[108429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:21 devstack sudo[108419]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:21 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-225cea79-22f9-4ed7-9d69-665912f198f0 tempest-ProjectReaderTests-845927054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-70410b55-d5b4-4038-804a-1bce1976bdd9" returned: 0 in 0.335s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:21 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-225cea79-22f9-4ed7-9d69-665912f198f0 tempest-ProjectReaderTests-845927054 None] Lock "cinder-quobyte-70410b55-d5b4-4038-804a-1bce1976bdd9" released by "delete_volume" :: held 0.864s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:15:21 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-225cea79-22f9-4ed7-9d69-665912f198f0 tempest-ProjectReaderTests-845927054 None] Created reservations ['b752d8fd-c9c3-4fb5-a38b-063fbe090a97', '98d83fa0-a262-4453-9cf4-721b9bcba2df', '72de4828-9126-46c1-b63c-9e96f91efc7b', '88a31f41-a4d3-46b1-b21d-e4be442bb01e'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:15:21 devstack sudo[108425]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:21 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-070a68c6-1c29-406f-86ff-a4501134793e tempest-VolumeDependencyTests-509891231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-022bbfc3-45aa-4a33-9003-5b308b6784cd" returned: 0 in 0.371s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:21 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-070a68c6-1c29-406f-86ff-a4501134793e tempest-VolumeDependencyTests-509891231 None] Lock "cinder-quobyte-022bbfc3-45aa-4a33-9003-5b308b6784cd" released by "delete_volume" :: held 0.873s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:15:21 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-225cea79-22f9-4ed7-9d69-665912f198f0 tempest-ProjectReaderTests-845927054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:15:21 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-225cea79-22f9-4ed7-9d69-665912f198f0 tempest-ProjectReaderTests-845927054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:15:21 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-225cea79-22f9-4ed7-9d69-665912f198f0 tempest-ProjectReaderTests-845927054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:15:21 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-225cea79-22f9-4ed7-9d69-665912f198f0 tempest-ProjectReaderTests-845927054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:15:21 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-225cea79-22f9-4ed7-9d69-665912f198f0 tempest-ProjectReaderTests-845927054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:15:21 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-225cea79-22f9-4ed7-9d69-665912f198f0 tempest-ProjectReaderTests-845927054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:21 devstack sudo[108436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:15:21 devstack sudo[108436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:21 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-070a68c6-1c29-406f-86ff-a4501134793e tempest-VolumeDependencyTests-509891231 None] Created reservations ['dfe80205-4d12-4ae9-bf70-8bfccf238e23', 'e71a609d-0a63-484c-a29e-298d0080bc9c', '4482be03-b0cd-4ff4-b1a8-64061450d701', '518177b8-804d-4a93-b668-f81549de7deb'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:15:21 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-070a68c6-1c29-406f-86ff-a4501134793e tempest-VolumeDependencyTests-509891231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:15:21 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-070a68c6-1c29-406f-86ff-a4501134793e tempest-VolumeDependencyTests-509891231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:15:21 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-070a68c6-1c29-406f-86ff-a4501134793e tempest-VolumeDependencyTests-509891231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:15:21 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-070a68c6-1c29-406f-86ff-a4501134793e tempest-VolumeDependencyTests-509891231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:15:21 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-070a68c6-1c29-406f-86ff-a4501134793e tempest-VolumeDependencyTests-509891231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:15:21 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-070a68c6-1c29-406f-86ff-a4501134793e tempest-VolumeDependencyTests-509891231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:21 devstack sudo[108429]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:21 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5e8d088d-609e-482e-a463-5b14aa29daaf tempest-ProjectReaderTests-1092271699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de19e987-b2f2-408b-9e68-22510e74a925 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-de19e987-b2f2-408b-9e68-22510e74a925.4e2984bb-d6bf-4ceb-84c2-eabaf95efa2f" returned: 0 in 0.511s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:21 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-5e8d088d-609e-482e-a463-5b14aa29daaf tempest-ProjectReaderTests-1092271699 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-de19e987-b2f2-408b-9e68-22510e74a925.4e2984bb-d6bf-4ceb-84c2-eabaf95efa2f is being set with open permissions: ugo+rw Aug 10 16:15:21 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5e8d088d-609e-482e-a463-5b14aa29daaf tempest-ProjectReaderTests-1092271699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-de19e987-b2f2-408b-9e68-22510e74a925.4e2984bb-d6bf-4ceb-84c2-eabaf95efa2f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:21 devstack sudo[108439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:15:21 devstack sudo[108439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:21 devstack sudo[108441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-de19e987-b2f2-408b-9e68-22510e74a925.4e2984bb-d6bf-4ceb-84c2-eabaf95efa2f Aug 10 16:15:21 devstack sudo[108441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:21 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c93c710-2e08-4fce-b4d5-183bd649f648 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:15:22 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-5c93c710-2e08-4fce-b4d5-183bd649f648 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Flow 'volume_create_manager' (a9ac2f7f-3157-4340-bdc4-0c1e70eafc7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:15:22 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-5c93c710-2e08-4fce-b4d5-183bd649f648 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a462aee6-6c1e-4350-8bb4-9af7e981b0ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:22 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-5c93c710-2e08-4fce-b4d5-183bd649f648 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a462aee6-6c1e-4350-8bb4-9af7e981b0ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:15:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-729315061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7aae6e6-d54c-4a5e-ae5f-a03a3066d796,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccf5be2b44e0412686562e3b1a2f3ddb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:15:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:15:22Z,use_quota=True,user_id='fa422d25b7c64f18b45e7eea99148691',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:22 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-5c93c710-2e08-4fce-b4d5-183bd649f648 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c0133a9-5a65-426c-be3c-1a3e658d9326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:22 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-5c93c710-2e08-4fce-b4d5-183bd649f648 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c0133a9-5a65-426c-be3c-1a3e658d9326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:22 devstack sudo[108436]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:22 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-5c93c710-2e08-4fce-b4d5-183bd649f648 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad41d90c-a5b3-4255-ba63-f07a1550fb63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:22 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-5c93c710-2e08-4fce-b4d5-183bd649f648 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad41d90c-a5b3-4255-ba63-f07a1550fb63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7aae6e6-d54c-4a5e-ae5f-a03a3066d796', 'volume_name': 'volume-c7aae6e6-d54c-4a5e-ae5f-a03a3066d796', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:22 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-5c93c710-2e08-4fce-b4d5-183bd649f648 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4bad88d-9b23-42e0-a8a2-4c0e7a5f55e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:22 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-5c93c710-2e08-4fce-b4d5-183bd649f648 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4bad88d-9b23-42e0-a8a2-4c0e7a5f55e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:22 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-5c93c710-2e08-4fce-b4d5-183bd649f648 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98595a98-77f0-41ab-9105-ef319652ccc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:22 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-5c93c710-2e08-4fce-b4d5-183bd649f648 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Volume c7aae6e6-d54c-4a5e-ae5f-a03a3066d796: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7aae6e6-d54c-4a5e-ae5f-a03a3066d796', 'volume_size': 1} Aug 10 16:15:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-5c93c710-2e08-4fce-b4d5-183bd649f648 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:15:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-225cea79-22f9-4ed7-9d69-665912f198f0 tempest-ProjectReaderTests-845927054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.558s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:22 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-225cea79-22f9-4ed7-9d69-665912f198f0 tempest-ProjectReaderTests-845927054 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:15:22 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-225cea79-22f9-4ed7-9d69-665912f198f0 tempest-ProjectReaderTests-845927054 None] Deleted volume successfully. Aug 10 16:15:22 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-225cea79-22f9-4ed7-9d69-665912f198f0 tempest-ProjectReaderTests-845927054 None] Lock "cinder-70410b55-d5b4-4038-804a-1bce1976bdd9-delete_volume" released by "delete_volume" :: held 1.789s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:15:22 devstack sudo[108439]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-070a68c6-1c29-406f-86ff-a4501134793e tempest-VolumeDependencyTests-509891231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.444s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:22 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-070a68c6-1c29-406f-86ff-a4501134793e tempest-VolumeDependencyTests-509891231 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:15:22 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-070a68c6-1c29-406f-86ff-a4501134793e tempest-VolumeDependencyTests-509891231 None] Deleted volume successfully. Aug 10 16:15:22 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-070a68c6-1c29-406f-86ff-a4501134793e tempest-VolumeDependencyTests-509891231 None] Lock "cinder-022bbfc3-45aa-4a33-9003-5b308b6784cd-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:15:22 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-fe2e7ffb-389d-4b6f-812a-bef5db18b1dd tempest-VolumeDependencyTests-509891231 None] Acquiring lock "cinder-3b4a5c38-6e18-4592-a5c2-2016d09fdde9-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:15:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5e8d088d-609e-482e-a463-5b14aa29daaf tempest-ProjectReaderTests-1092271699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-de19e987-b2f2-408b-9e68-22510e74a925.4e2984bb-d6bf-4ceb-84c2-eabaf95efa2f" returned: 0 in 0.550s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:22 devstack sudo[108441]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:22 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-fe2e7ffb-389d-4b6f-812a-bef5db18b1dd tempest-VolumeDependencyTests-509891231 None] Lock "cinder-3b4a5c38-6e18-4592-a5c2-2016d09fdde9-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:15:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5e8d088d-609e-482e-a463-5b14aa29daaf tempest-ProjectReaderTests-1092271699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-de19e987-b2f2-408b-9e68-22510e74a925.info {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:22 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-fe2e7ffb-389d-4b6f-812a-bef5db18b1dd tempest-VolumeDependencyTests-509891231 None] Acquiring lock "cinder-quobyte-3b4a5c38-6e18-4592-a5c2-2016d09fdde9" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:15:22 devstack sudo[108446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-de19e987-b2f2-408b-9e68-22510e74a925.info Aug 10 16:15:22 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bf3f678-e47b-4d5f-83f9-2966ada97aa1 tempest-ProjectReaderTests-845927054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:15:22 devstack sudo[108446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:22 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9bf3f678-e47b-4d5f-83f9-2966ada97aa1 tempest-ProjectReaderTests-845927054 None] Flow 'volume_create_manager' (13ac74ae-8f46-4a89-b4fd-e1c8ae577c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:15:22 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9bf3f678-e47b-4d5f-83f9-2966ada97aa1 tempest-ProjectReaderTests-845927054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4922523-b11b-47ad-ac2b-a695fdb6fc4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:22 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9bf3f678-e47b-4d5f-83f9-2966ada97aa1 tempest-ProjectReaderTests-845927054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4922523-b11b-47ad-ac2b-a695fdb6fc4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:15:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-307801719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3ccb10c-eaec-4e68-979c-3a789f48dd32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='facb635ed4174975915b23b03172230d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:15:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:15:22Z,use_quota=True,user_id='4e3477f77fae4ce3a793c4908c365497',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:22 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9bf3f678-e47b-4d5f-83f9-2966ada97aa1 tempest-ProjectReaderTests-845927054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (262407e3-678d-439b-8a58-1503528dd9fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:22 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9bf3f678-e47b-4d5f-83f9-2966ada97aa1 tempest-ProjectReaderTests-845927054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (262407e3-678d-439b-8a58-1503528dd9fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:22 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9bf3f678-e47b-4d5f-83f9-2966ada97aa1 tempest-ProjectReaderTests-845927054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0f3dd65-f8ca-44e1-b800-f40567aaf864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:22 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9bf3f678-e47b-4d5f-83f9-2966ada97aa1 tempest-ProjectReaderTests-845927054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0f3dd65-f8ca-44e1-b800-f40567aaf864) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3ccb10c-eaec-4e68-979c-3a789f48dd32', 'volume_name': 'volume-d3ccb10c-eaec-4e68-979c-3a789f48dd32', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:22 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9bf3f678-e47b-4d5f-83f9-2966ada97aa1 tempest-ProjectReaderTests-845927054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e91b5c3e-a85f-4eb4-8b48-dec625878d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:22 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9bf3f678-e47b-4d5f-83f9-2966ada97aa1 tempest-ProjectReaderTests-845927054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e91b5c3e-a85f-4eb4-8b48-dec625878d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:22 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9bf3f678-e47b-4d5f-83f9-2966ada97aa1 tempest-ProjectReaderTests-845927054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d7b8ffa-6353-4558-9e91-bf9b75c55a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:22 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-9bf3f678-e47b-4d5f-83f9-2966ada97aa1 tempest-ProjectReaderTests-845927054 None] Volume d3ccb10c-eaec-4e68-979c-3a789f48dd32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3ccb10c-eaec-4e68-979c-3a789f48dd32', 'volume_size': 1} Aug 10 16:15:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-9bf3f678-e47b-4d5f-83f9-2966ada97aa1 tempest-ProjectReaderTests-845927054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:15:22 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-fe2e7ffb-389d-4b6f-812a-bef5db18b1dd tempest-VolumeDependencyTests-509891231 None] Lock "cinder-quobyte-3b4a5c38-6e18-4592-a5c2-2016d09fdde9" acquired by "delete_volume" :: waited 0.138s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:15:22 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c744a0b-f479-4fa9-b0ae-e327d3d46554]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:15:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fe2e7ffb-389d-4b6f-812a-bef5db18b1dd tempest-VolumeDependencyTests-509891231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3b4a5c38-6e18-4592-a5c2-2016d09fdde9 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:22 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb379b52-a99e-4a6f-b22b-0df8cc88f7ca tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:15:22 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-fb379b52-a99e-4a6f-b22b-0df8cc88f7ca tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Flow 'volume_create_manager' (a8d84be8-2b96-4619-b909-4a4af36606a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:15:22 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-fb379b52-a99e-4a6f-b22b-0df8cc88f7ca tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dfdcb06-61e2-49b8-9911-0847438b5d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:22 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-fb379b52-a99e-4a6f-b22b-0df8cc88f7ca tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dfdcb06-61e2-49b8-9911-0847438b5d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:15:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1458646001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7c32d9c-c443-4d94-a9e7-32fc4ee7b059,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccf5be2b44e0412686562e3b1a2f3ddb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:15:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:15:23Z,use_quota=True,user_id='fa422d25b7c64f18b45e7eea99148691',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:22 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-fb379b52-a99e-4a6f-b22b-0df8cc88f7ca tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d2063d9-5522-44b1-9f92-7e3b58e5b0c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:22 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-fb379b52-a99e-4a6f-b22b-0df8cc88f7ca tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d2063d9-5522-44b1-9f92-7e3b58e5b0c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:22 devstack sudo[108446]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:22 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-fb379b52-a99e-4a6f-b22b-0df8cc88f7ca tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (363af519-b7ad-42c9-bddf-9949b176db37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:22 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-fb379b52-a99e-4a6f-b22b-0df8cc88f7ca tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (363af519-b7ad-42c9-bddf-9949b176db37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7c32d9c-c443-4d94-a9e7-32fc4ee7b059', 'volume_name': 'volume-d7c32d9c-c443-4d94-a9e7-32fc4ee7b059', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:22 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-fb379b52-a99e-4a6f-b22b-0df8cc88f7ca tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (405fe497-f78b-4509-9422-cc1c1d658646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:22 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-fb379b52-a99e-4a6f-b22b-0df8cc88f7ca tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (405fe497-f78b-4509-9422-cc1c1d658646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:22 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-fb379b52-a99e-4a6f-b22b-0df8cc88f7ca tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d314d39c-cc22-4191-84e7-d54843c1d6b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:22 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-fb379b52-a99e-4a6f-b22b-0df8cc88f7ca tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Volume d7c32d9c-c443-4d94-a9e7-32fc4ee7b059: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7c32d9c-c443-4d94-a9e7-32fc4ee7b059', 'volume_size': 1} Aug 10 16:15:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-fb379b52-a99e-4a6f-b22b-0df8cc88f7ca tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:15:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5e8d088d-609e-482e-a463-5b14aa29daaf tempest-ProjectReaderTests-1092271699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-de19e987-b2f2-408b-9e68-22510e74a925.info" returned: 0 in 0.380s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:22 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-5e8d088d-609e-482e-a463-5b14aa29daaf tempest-ProjectReaderTests-1092271699 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-de19e987-b2f2-408b-9e68-22510e74a925.info is being set with open permissions: ugo+rw Aug 10 16:15:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5e8d088d-609e-482e-a463-5b14aa29daaf tempest-ProjectReaderTests-1092271699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-de19e987-b2f2-408b-9e68-22510e74a925.info {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:22 devstack sudo[108449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3b4a5c38-6e18-4592-a5c2-2016d09fdde9 Aug 10 16:15:22 devstack sudo[108449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:22 devstack sudo[108452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-de19e987-b2f2-408b-9e68-22510e74a925.info Aug 10 16:15:22 devstack sudo[108452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:23 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-52e92a52-c75c-424c-bd03-f42af07d0b20 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:15:23 devstack sudo[108452]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:23 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-52e92a52-c75c-424c-bd03-f42af07d0b20 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Flow 'volume_create_manager' (e9920737-be3c-48a5-839b-4e9094d2c679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:15:23 devstack sudo[108449]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:23 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-52e92a52-c75c-424c-bd03-f42af07d0b20 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (324145e0-9935-4d25-ab2f-1453b0f50308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:23 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fe2e7ffb-389d-4b6f-812a-bef5db18b1dd tempest-VolumeDependencyTests-509891231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3b4a5c38-6e18-4592-a5c2-2016d09fdde9" returned: 0 in 0.465s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:23 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5e8d088d-609e-482e-a463-5b14aa29daaf tempest-ProjectReaderTests-1092271699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-de19e987-b2f2-408b-9e68-22510e74a925.info" returned: 0 in 0.310s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:23 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fe2e7ffb-389d-4b6f-812a-bef5db18b1dd tempest-VolumeDependencyTests-509891231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3b4a5c38-6e18-4592-a5c2-2016d09fdde9 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:23 devstack sudo[108458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3b4a5c38-6e18-4592-a5c2-2016d09fdde9 Aug 10 16:15:23 devstack sudo[108458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:23 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-5e8d088d-609e-482e-a463-5b14aa29daaf tempest-ProjectReaderTests-1092271699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.870s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:15:23 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-5c93c710-2e08-4fce-b4d5-183bd649f648 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.994s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:15:23 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-5c93c710-2e08-4fce-b4d5-183bd649f648 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:15:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-729315061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7aae6e6-d54c-4a5e-ae5f-a03a3066d796,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccf5be2b44e0412686562e3b1a2f3ddb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:15:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:15:22Z,use_quota=True,user_id='fa422d25b7c64f18b45e7eea99148691',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:15:23 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-5c93c710-2e08-4fce-b4d5-183bd649f648 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Creating volume c7aae6e6-d54c-4a5e-ae5f-a03a3066d796 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:15:23 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-5c93c710-2e08-4fce-b4d5-183bd649f648 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:15:23 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-5c93c710-2e08-4fce-b4d5-183bd649f648 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:15:23 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-5c93c710-2e08-4fce-b4d5-183bd649f648 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:15:23 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-5c93c710-2e08-4fce-b4d5-183bd649f648 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:15:23 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-5c93c710-2e08-4fce-b4d5-183bd649f648 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:15:23 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-5c93c710-2e08-4fce-b4d5-183bd649f648 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:15:23 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-5c93c710-2e08-4fce-b4d5-183bd649f648 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:15:23 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5c93c710-2e08-4fce-b4d5-183bd649f648 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c7aae6e6-d54c-4a5e-ae5f-a03a3066d796 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:23 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-52e92a52-c75c-424c-bd03-f42af07d0b20 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (324145e0-9935-4d25-ab2f-1453b0f50308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:15:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-644945067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42dc1ba1-4c9d-4665-b283-b950bc76f6cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccf5be2b44e0412686562e3b1a2f3ddb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:15:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:15:23Z,use_quota=True,user_id='fa422d25b7c64f18b45e7eea99148691',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:23 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-52e92a52-c75c-424c-bd03-f42af07d0b20 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d95dd72-8741-4498-8154-16e850e792ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:23 devstack sudo[108460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c7aae6e6-d54c-4a5e-ae5f-a03a3066d796 1073741824 Aug 10 16:15:23 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-52e92a52-c75c-424c-bd03-f42af07d0b20 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d95dd72-8741-4498-8154-16e850e792ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:23 devstack sudo[108460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:23 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-52e92a52-c75c-424c-bd03-f42af07d0b20 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad46f4d6-26ee-44f8-8b74-0111010aa5f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:23 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-52e92a52-c75c-424c-bd03-f42af07d0b20 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad46f4d6-26ee-44f8-8b74-0111010aa5f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42dc1ba1-4c9d-4665-b283-b950bc76f6cd', 'volume_name': 'volume-42dc1ba1-4c9d-4665-b283-b950bc76f6cd', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:23 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-52e92a52-c75c-424c-bd03-f42af07d0b20 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (131411c7-7b38-4ae8-a3a9-9acd1a6c7091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:23 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-52e92a52-c75c-424c-bd03-f42af07d0b20 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (131411c7-7b38-4ae8-a3a9-9acd1a6c7091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:23 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-52e92a52-c75c-424c-bd03-f42af07d0b20 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26b7a87e-a878-4bb9-8247-8f650fc477aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:23 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-52e92a52-c75c-424c-bd03-f42af07d0b20 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Volume 42dc1ba1-4c9d-4665-b283-b950bc76f6cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42dc1ba1-4c9d-4665-b283-b950bc76f6cd', 'volume_size': 1} Aug 10 16:15:23 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-52e92a52-c75c-424c-bd03-f42af07d0b20 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:15:23 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-5e8d088d-609e-482e-a463-5b14aa29daaf tempest-ProjectReaderTests-1092271699 None] Create snapshot completed successfully Aug 10 16:15:23 devstack sudo[108458]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:23 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fe2e7ffb-389d-4b6f-812a-bef5db18b1dd tempest-VolumeDependencyTests-509891231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3b4a5c38-6e18-4592-a5c2-2016d09fdde9" returned: 0 in 0.322s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:23 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-fe2e7ffb-389d-4b6f-812a-bef5db18b1dd tempest-VolumeDependencyTests-509891231 None] Lock "cinder-quobyte-3b4a5c38-6e18-4592-a5c2-2016d09fdde9" released by "delete_volume" :: held 0.857s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:15:23 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-fe2e7ffb-389d-4b6f-812a-bef5db18b1dd tempest-VolumeDependencyTests-509891231 None] Created reservations ['90acd77e-b1ca-4982-b763-abe375dc7257', '86b9c56f-7919-4d07-8ad1-c2b4dfecf3be', '130b8693-73de-48f0-8813-eacedeb0e2f2', 'aa4ed36c-0138-45b3-9c53-634bf58f8fc8'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:15:23 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d814350-7d3a-43db-9905-84df7bc3a8dd tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:15:23 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9d814350-7d3a-43db-9905-84df7bc3a8dd tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Flow 'volume_create_manager' (40dcf6a4-1237-40ae-bc72-ba093a35820f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:15:23 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9d814350-7d3a-43db-9905-84df7bc3a8dd tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ece9447-3576-4211-8307-7569d37ed910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:23 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9d814350-7d3a-43db-9905-84df7bc3a8dd tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ece9447-3576-4211-8307-7569d37ed910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:15:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1771346814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f7ca5a9-9995-42b0-8cb6-edf150564cd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccf5be2b44e0412686562e3b1a2f3ddb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:15:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:15:23Z,use_quota=True,user_id='fa422d25b7c64f18b45e7eea99148691',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:23 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9d814350-7d3a-43db-9905-84df7bc3a8dd tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5df431a-bc2e-49bb-8354-2f716c9e9eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:23 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9d814350-7d3a-43db-9905-84df7bc3a8dd tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5df431a-bc2e-49bb-8354-2f716c9e9eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:23 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9d814350-7d3a-43db-9905-84df7bc3a8dd tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2725115d-235f-4e7d-a31c-dc936decb7d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:23 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9d814350-7d3a-43db-9905-84df7bc3a8dd tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2725115d-235f-4e7d-a31c-dc936decb7d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f7ca5a9-9995-42b0-8cb6-edf150564cd6', 'volume_name': 'volume-3f7ca5a9-9995-42b0-8cb6-edf150564cd6', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:23 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9d814350-7d3a-43db-9905-84df7bc3a8dd tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1d20966-f6e5-4fe3-9d8c-b28962bcf084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:23 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9d814350-7d3a-43db-9905-84df7bc3a8dd tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1d20966-f6e5-4fe3-9d8c-b28962bcf084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:23 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9d814350-7d3a-43db-9905-84df7bc3a8dd tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ada8d2f3-135a-4c16-af07-b371dd1f746e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:23 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-9d814350-7d3a-43db-9905-84df7bc3a8dd tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Volume 3f7ca5a9-9995-42b0-8cb6-edf150564cd6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f7ca5a9-9995-42b0-8cb6-edf150564cd6', 'volume_size': 1} Aug 10 16:15:23 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-9d814350-7d3a-43db-9905-84df7bc3a8dd tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:15:23 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-fe2e7ffb-389d-4b6f-812a-bef5db18b1dd tempest-VolumeDependencyTests-509891231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:15:23 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-fe2e7ffb-389d-4b6f-812a-bef5db18b1dd tempest-VolumeDependencyTests-509891231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:15:23 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-fe2e7ffb-389d-4b6f-812a-bef5db18b1dd tempest-VolumeDependencyTests-509891231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:15:23 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-fe2e7ffb-389d-4b6f-812a-bef5db18b1dd tempest-VolumeDependencyTests-509891231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:15:23 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-fe2e7ffb-389d-4b6f-812a-bef5db18b1dd tempest-VolumeDependencyTests-509891231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:15:23 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fe2e7ffb-389d-4b6f-812a-bef5db18b1dd tempest-VolumeDependencyTests-509891231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:23 devstack sudo[108467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:15:23 devstack sudo[108467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:23 devstack sudo[108460]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:23 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5c93c710-2e08-4fce-b4d5-183bd649f648 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c7aae6e6-d54c-4a5e-ae5f-a03a3066d796 1073741824" returned: 0 in 0.638s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:23 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5c93c710-2e08-4fce-b4d5-183bd649f648 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c7aae6e6-d54c-4a5e-ae5f-a03a3066d796 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:23 devstack sudo[108469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c7aae6e6-d54c-4a5e-ae5f-a03a3066d796 Aug 10 16:15:23 devstack sudo[108469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:23 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c31ba25-9123-491f-bc47-772ff21ba15b tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:15:23 devstack sudo[108467]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:23 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9c31ba25-9123-491f-bc47-772ff21ba15b tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Flow 'volume_create_manager' (c2f45496-d226-48db-9cae-16f1e0f6abc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:15:23 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9c31ba25-9123-491f-bc47-772ff21ba15b tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e39ef0e2-d2bc-4c3b-a28c-76567dea5a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:24 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fe2e7ffb-389d-4b6f-812a-bef5db18b1dd tempest-VolumeDependencyTests-509891231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.300s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:24 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-fe2e7ffb-389d-4b6f-812a-bef5db18b1dd tempest-VolumeDependencyTests-509891231 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:15:24 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-fe2e7ffb-389d-4b6f-812a-bef5db18b1dd tempest-VolumeDependencyTests-509891231 None] Deleted volume successfully. Aug 10 16:15:24 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9c31ba25-9123-491f-bc47-772ff21ba15b tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e39ef0e2-d2bc-4c3b-a28c-76567dea5a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:15:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-610711865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b6ed93f-290a-4827-aa5b-53860189c5b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccf5be2b44e0412686562e3b1a2f3ddb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:15:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:15:24Z,use_quota=True,user_id='fa422d25b7c64f18b45e7eea99148691',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:24 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9c31ba25-9123-491f-bc47-772ff21ba15b tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d10858c5-2bf7-40c9-98bd-b43f4b1bb375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:24 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9c31ba25-9123-491f-bc47-772ff21ba15b tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d10858c5-2bf7-40c9-98bd-b43f4b1bb375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:24 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9c31ba25-9123-491f-bc47-772ff21ba15b tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a912814-fcd6-4cf8-8f00-0b184e2fc940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:24 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9c31ba25-9123-491f-bc47-772ff21ba15b tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a912814-fcd6-4cf8-8f00-0b184e2fc940) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b6ed93f-290a-4827-aa5b-53860189c5b8', 'volume_name': 'volume-0b6ed93f-290a-4827-aa5b-53860189c5b8', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:24 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9c31ba25-9123-491f-bc47-772ff21ba15b tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1af4d280-38d0-486e-8cfb-dd22a1233411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:24 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9c31ba25-9123-491f-bc47-772ff21ba15b tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1af4d280-38d0-486e-8cfb-dd22a1233411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:24 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9c31ba25-9123-491f-bc47-772ff21ba15b tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9f07579-1911-4e8b-85ce-141f440cad3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:24 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-9c31ba25-9123-491f-bc47-772ff21ba15b tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Volume 0b6ed93f-290a-4827-aa5b-53860189c5b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b6ed93f-290a-4827-aa5b-53860189c5b8', 'volume_size': 1} Aug 10 16:15:24 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-9c31ba25-9123-491f-bc47-772ff21ba15b tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:15:24 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-fe2e7ffb-389d-4b6f-812a-bef5db18b1dd tempest-VolumeDependencyTests-509891231 None] Lock "cinder-3b4a5c38-6e18-4592-a5c2-2016d09fdde9-delete_volume" released by "delete_volume" :: held 1.750s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:15:24 devstack sudo[108469]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:24 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5c93c710-2e08-4fce-b4d5-183bd649f648 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c7aae6e6-d54c-4a5e-ae5f-a03a3066d796" returned: 0 in 0.293s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:24 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-5c93c710-2e08-4fce-b4d5-183bd649f648 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:15:24 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-5c93c710-2e08-4fce-b4d5-183bd649f648 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:15:24 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-9bf3f678-e47b-4d5f-83f9-2966ada97aa1 tempest-ProjectReaderTests-845927054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.541s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:15:24 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-9bf3f678-e47b-4d5f-83f9-2966ada97aa1 tempest-ProjectReaderTests-845927054 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:15:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-307801719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3ccb10c-eaec-4e68-979c-3a789f48dd32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='facb635ed4174975915b23b03172230d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:15:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:15:22Z,use_quota=True,user_id='4e3477f77fae4ce3a793c4908c365497',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:15:24 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-9bf3f678-e47b-4d5f-83f9-2966ada97aa1 tempest-ProjectReaderTests-845927054 None] Creating volume d3ccb10c-eaec-4e68-979c-3a789f48dd32 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:15:24 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-9bf3f678-e47b-4d5f-83f9-2966ada97aa1 tempest-ProjectReaderTests-845927054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:15:24 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-9bf3f678-e47b-4d5f-83f9-2966ada97aa1 tempest-ProjectReaderTests-845927054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:15:24 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-9bf3f678-e47b-4d5f-83f9-2966ada97aa1 tempest-ProjectReaderTests-845927054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:15:24 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-9bf3f678-e47b-4d5f-83f9-2966ada97aa1 tempest-ProjectReaderTests-845927054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:15:24 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-9bf3f678-e47b-4d5f-83f9-2966ada97aa1 tempest-ProjectReaderTests-845927054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:15:24 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-9bf3f678-e47b-4d5f-83f9-2966ada97aa1 tempest-ProjectReaderTests-845927054 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:15:24 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-9bf3f678-e47b-4d5f-83f9-2966ada97aa1 tempest-ProjectReaderTests-845927054 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:15:24 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9bf3f678-e47b-4d5f-83f9-2966ada97aa1 tempest-ProjectReaderTests-845927054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d3ccb10c-eaec-4e68-979c-3a789f48dd32 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:24 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-5c93c710-2e08-4fce-b4d5-183bd649f648 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98595a98-77f0-41ab-9105-ef319652ccc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7aae6e6-d54c-4a5e-ae5f-a03a3066d796', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:24 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-5c93c710-2e08-4fce-b4d5-183bd649f648 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af9d8609-9d61-4f76-9029-9743fc558076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:24 devstack sudo[108473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d3ccb10c-eaec-4e68-979c-3a789f48dd32 1073741824 Aug 10 16:15:24 devstack sudo[108473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:24 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-5c93c710-2e08-4fce-b4d5-183bd649f648 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Volume volume-c7aae6e6-d54c-4a5e-ae5f-a03a3066d796 (c7aae6e6-d54c-4a5e-ae5f-a03a3066d796): created successfully Aug 10 16:15:24 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-5c93c710-2e08-4fce-b4d5-183bd649f648 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af9d8609-9d61-4f76-9029-9743fc558076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:24 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-5c93c710-2e08-4fce-b4d5-183bd649f648 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Flow 'volume_create_manager' (a9ac2f7f-3157-4340-bdc4-0c1e70eafc7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:15:24 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-5c93c710-2e08-4fce-b4d5-183bd649f648 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Created volume successfully. Aug 10 16:15:24 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-e89cf63d-f695-47aa-a41b-98792e3ddd80 tempest-ProjectReaderTests-1092271699 None] Acquiring lock "cinder-4e2984bb-d6bf-4ceb-84c2-eabaf95efa2f-delete_snapshot" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:15:24 devstack sudo[108473]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:24 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9bf3f678-e47b-4d5f-83f9-2966ada97aa1 tempest-ProjectReaderTests-845927054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d3ccb10c-eaec-4e68-979c-3a789f48dd32 1073741824" returned: 0 in 0.497s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:24 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-e89cf63d-f695-47aa-a41b-98792e3ddd80 tempest-ProjectReaderTests-1092271699 None] Lock "cinder-4e2984bb-d6bf-4ceb-84c2-eabaf95efa2f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:15:24 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-e89cf63d-f695-47aa-a41b-98792e3ddd80 tempest-ProjectReaderTests-1092271699 None] Acquiring lock "cinder-quobyte-de19e987-b2f2-408b-9e68-22510e74a925" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:15:24 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-e89cf63d-f695-47aa-a41b-98792e3ddd80 tempest-ProjectReaderTests-1092271699 None] Lock "cinder-quobyte-de19e987-b2f2-408b-9e68-22510e74a925" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:15:24 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-e89cf63d-f695-47aa-a41b-98792e3ddd80 tempest-ProjectReaderTests-1092271699 None] Acquiring lock "cinder-quobyte-4e2984bb-d6bf-4ceb-84c2-eabaf95efa2f" by "_delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:15:24 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-e89cf63d-f695-47aa-a41b-98792e3ddd80 tempest-ProjectReaderTests-1092271699 None] Lock "cinder-quobyte-4e2984bb-d6bf-4ceb-84c2-eabaf95efa2f" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:15:24 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-e89cf63d-f695-47aa-a41b-98792e3ddd80 tempest-ProjectReaderTests-1092271699 None] Deleting offline snapshot 4e2984bb-d6bf-4ceb-84c2-eabaf95efa2f of volume de19e987-b2f2-408b-9e68-22510e74a925 {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 16:15:24 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-e89cf63d-f695-47aa-a41b-98792e3ddd80 tempest-ProjectReaderTests-1092271699 None] snapshot_file for this snap is: volume-de19e987-b2f2-408b-9e68-22510e74a925.4e2984bb-d6bf-4ceb-84c2-eabaf95efa2f {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 16:15:24 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9bf3f678-e47b-4d5f-83f9-2966ada97aa1 tempest-ProjectReaderTests-845927054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d3ccb10c-eaec-4e68-979c-3a789f48dd32 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:24 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[38499295-ccf2-43be-a85d-f4f58b7c3381]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:15:24 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e89cf63d-f695-47aa-a41b-98792e3ddd80 tempest-ProjectReaderTests-1092271699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-de19e987-b2f2-408b-9e68-22510e74a925.4e2984bb-d6bf-4ceb-84c2-eabaf95efa2f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:24 devstack sudo[108479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d3ccb10c-eaec-4e68-979c-3a789f48dd32 Aug 10 16:15:24 devstack sudo[108479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:24 devstack sudo[108480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-de19e987-b2f2-408b-9e68-22510e74a925.4e2984bb-d6bf-4ceb-84c2-eabaf95efa2f Aug 10 16:15:24 devstack sudo[108480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:24 devstack sudo[108479]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:24 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9bf3f678-e47b-4d5f-83f9-2966ada97aa1 tempest-ProjectReaderTests-845927054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d3ccb10c-eaec-4e68-979c-3a789f48dd32" returned: 0 in 0.284s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:24 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-9bf3f678-e47b-4d5f-83f9-2966ada97aa1 tempest-ProjectReaderTests-845927054 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:15:24 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-9bf3f678-e47b-4d5f-83f9-2966ada97aa1 tempest-ProjectReaderTests-845927054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:15:24 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-fb379b52-a99e-4a6f-b22b-0df8cc88f7ca tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.238s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:15:24 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-fb379b52-a99e-4a6f-b22b-0df8cc88f7ca tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:15:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1458646001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7c32d9c-c443-4d94-a9e7-32fc4ee7b059,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccf5be2b44e0412686562e3b1a2f3ddb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:15:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:15:23Z,use_quota=True,user_id='fa422d25b7c64f18b45e7eea99148691',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:15:25 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-fb379b52-a99e-4a6f-b22b-0df8cc88f7ca tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Creating volume d7c32d9c-c443-4d94-a9e7-32fc4ee7b059 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:15:25 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-fb379b52-a99e-4a6f-b22b-0df8cc88f7ca tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:15:25 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-fb379b52-a99e-4a6f-b22b-0df8cc88f7ca tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:15:25 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-fb379b52-a99e-4a6f-b22b-0df8cc88f7ca tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:15:25 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-fb379b52-a99e-4a6f-b22b-0df8cc88f7ca tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:15:25 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-fb379b52-a99e-4a6f-b22b-0df8cc88f7ca tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:15:25 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-fb379b52-a99e-4a6f-b22b-0df8cc88f7ca tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:15:25 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-fb379b52-a99e-4a6f-b22b-0df8cc88f7ca tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:15:25 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fb379b52-a99e-4a6f-b22b-0df8cc88f7ca tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d7c32d9c-c443-4d94-a9e7-32fc4ee7b059 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:25 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9bf3f678-e47b-4d5f-83f9-2966ada97aa1 tempest-ProjectReaderTests-845927054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d7b8ffa-6353-4558-9e91-bf9b75c55a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3ccb10c-eaec-4e68-979c-3a789f48dd32', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:25 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9bf3f678-e47b-4d5f-83f9-2966ada97aa1 tempest-ProjectReaderTests-845927054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d50ab080-ad39-4ef3-85fd-fa2c744ab666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:25 devstack sudo[108484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d7c32d9c-c443-4d94-a9e7-32fc4ee7b059 1073741824 Aug 10 16:15:25 devstack sudo[108484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:25 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-9bf3f678-e47b-4d5f-83f9-2966ada97aa1 tempest-ProjectReaderTests-845927054 None] Volume volume-d3ccb10c-eaec-4e68-979c-3a789f48dd32 (d3ccb10c-eaec-4e68-979c-3a789f48dd32): created successfully Aug 10 16:15:25 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9bf3f678-e47b-4d5f-83f9-2966ada97aa1 tempest-ProjectReaderTests-845927054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d50ab080-ad39-4ef3-85fd-fa2c744ab666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:25 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9bf3f678-e47b-4d5f-83f9-2966ada97aa1 tempest-ProjectReaderTests-845927054 None] Flow 'volume_create_manager' (13ac74ae-8f46-4a89-b4fd-e1c8ae577c25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:15:25 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-9bf3f678-e47b-4d5f-83f9-2966ada97aa1 tempest-ProjectReaderTests-845927054 None] Created volume successfully. Aug 10 16:15:25 devstack sudo[108480]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:25 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e89cf63d-f695-47aa-a41b-98792e3ddd80 tempest-ProjectReaderTests-1092271699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-de19e987-b2f2-408b-9e68-22510e74a925.4e2984bb-d6bf-4ceb-84c2-eabaf95efa2f" returned: 0 in 0.449s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:25 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-e89cf63d-f695-47aa-a41b-98792e3ddd80 tempest-ProjectReaderTests-1092271699 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de19e987-b2f2-408b-9e68-22510e74a925(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 16:15:25 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[33bde5b4-88e6-465f-86c1-803f194afd6f]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:15:25 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e89cf63d-f695-47aa-a41b-98792e3ddd80 tempest-ProjectReaderTests-1092271699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-de19e987-b2f2-408b-9e68-22510e74a925 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:25 devstack sudo[108489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-de19e987-b2f2-408b-9e68-22510e74a925 Aug 10 16:15:25 devstack sudo[108489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:25 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-ca4360f9-9d6b-4735-be80-70981db8b005 tempest-ProjectReaderTests-845927054 None] Acquiring lock "cinder-d3ccb10c-eaec-4e68-979c-3a789f48dd32-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:15:25 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-ca4360f9-9d6b-4735-be80-70981db8b005 tempest-ProjectReaderTests-845927054 None] Lock "cinder-d3ccb10c-eaec-4e68-979c-3a789f48dd32-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:15:25 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-ca4360f9-9d6b-4735-be80-70981db8b005 tempest-ProjectReaderTests-845927054 None] Acquiring lock "cinder-quobyte-d3ccb10c-eaec-4e68-979c-3a789f48dd32" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:15:25 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-ca4360f9-9d6b-4735-be80-70981db8b005 tempest-ProjectReaderTests-845927054 None] Lock "cinder-quobyte-d3ccb10c-eaec-4e68-979c-3a789f48dd32" acquired by "delete_volume" :: waited 0.016s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:15:25 devstack sudo[108484]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:25 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fb379b52-a99e-4a6f-b22b-0df8cc88f7ca tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d7c32d9c-c443-4d94-a9e7-32fc4ee7b059 1073741824" returned: 0 in 0.648s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:25 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee2dc68a-8d13-4824-bac1-82ce5192597b]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:15:25 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ca4360f9-9d6b-4735-be80-70981db8b005 tempest-ProjectReaderTests-845927054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d3ccb10c-eaec-4e68-979c-3a789f48dd32 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:25 devstack sudo[108489]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:25 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e89cf63d-f695-47aa-a41b-98792e3ddd80 tempest-ProjectReaderTests-1092271699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-de19e987-b2f2-408b-9e68-22510e74a925" returned: 0 in 0.531s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:25 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e89cf63d-f695-47aa-a41b-98792e3ddd80 tempest-ProjectReaderTests-1092271699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-de19e987-b2f2-408b-9e68-22510e74a925.4e2984bb-d6bf-4ceb-84c2-eabaf95efa2f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:25 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fb379b52-a99e-4a6f-b22b-0df8cc88f7ca tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d7c32d9c-c443-4d94-a9e7-32fc4ee7b059 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:25 devstack sudo[108500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-de19e987-b2f2-408b-9e68-22510e74a925.4e2984bb-d6bf-4ceb-84c2-eabaf95efa2f Aug 10 16:15:25 devstack sudo[108500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:25 devstack sudo[108501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d7c32d9c-c443-4d94-a9e7-32fc4ee7b059 Aug 10 16:15:25 devstack sudo[108501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:25 devstack sudo[108499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d3ccb10c-eaec-4e68-979c-3a789f48dd32 Aug 10 16:15:25 devstack sudo[108499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:26 devstack sudo[108501]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:26 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fb379b52-a99e-4a6f-b22b-0df8cc88f7ca tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d7c32d9c-c443-4d94-a9e7-32fc4ee7b059" returned: 0 in 0.366s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:26 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-fb379b52-a99e-4a6f-b22b-0df8cc88f7ca tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] <== create_volume: return (1123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:15:26 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-fb379b52-a99e-4a6f-b22b-0df8cc88f7ca tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.126s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:15:26 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-52e92a52-c75c-424c-bd03-f42af07d0b20 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.865s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:15:26 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-52e92a52-c75c-424c-bd03-f42af07d0b20 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:15:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-644945067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42dc1ba1-4c9d-4665-b283-b950bc76f6cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccf5be2b44e0412686562e3b1a2f3ddb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:15:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:15:23Z,use_quota=True,user_id='fa422d25b7c64f18b45e7eea99148691',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:15:26 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-52e92a52-c75c-424c-bd03-f42af07d0b20 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Creating volume 42dc1ba1-4c9d-4665-b283-b950bc76f6cd {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:15:26 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-52e92a52-c75c-424c-bd03-f42af07d0b20 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:15:26 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-52e92a52-c75c-424c-bd03-f42af07d0b20 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:15:26 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-52e92a52-c75c-424c-bd03-f42af07d0b20 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:15:26 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-52e92a52-c75c-424c-bd03-f42af07d0b20 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:15:26 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-52e92a52-c75c-424c-bd03-f42af07d0b20 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:15:26 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-52e92a52-c75c-424c-bd03-f42af07d0b20 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:15:26 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-52e92a52-c75c-424c-bd03-f42af07d0b20 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:15:26 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-52e92a52-c75c-424c-bd03-f42af07d0b20 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-42dc1ba1-4c9d-4665-b283-b950bc76f6cd 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:26 devstack sudo[108513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-42dc1ba1-4c9d-4665-b283-b950bc76f6cd 1073741824 Aug 10 16:15:26 devstack sudo[108513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:26 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-fb379b52-a99e-4a6f-b22b-0df8cc88f7ca tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d314d39c-cc22-4191-84e7-d54843c1d6b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7c32d9c-c443-4d94-a9e7-32fc4ee7b059', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:26 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-fb379b52-a99e-4a6f-b22b-0df8cc88f7ca tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b826e67-8e5a-4bed-a482-402586db8244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:26 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-fb379b52-a99e-4a6f-b22b-0df8cc88f7ca tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Volume volume-d7c32d9c-c443-4d94-a9e7-32fc4ee7b059 (d7c32d9c-c443-4d94-a9e7-32fc4ee7b059): created successfully Aug 10 16:15:26 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-fb379b52-a99e-4a6f-b22b-0df8cc88f7ca tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b826e67-8e5a-4bed-a482-402586db8244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:26 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-fb379b52-a99e-4a6f-b22b-0df8cc88f7ca tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Flow 'volume_create_manager' (a8d84be8-2b96-4619-b909-4a4af36606a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:15:26 devstack sudo[108499]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:26 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ca4360f9-9d6b-4735-be80-70981db8b005 tempest-ProjectReaderTests-845927054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d3ccb10c-eaec-4e68-979c-3a789f48dd32" returned: 0 in 0.522s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:26 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ca4360f9-9d6b-4735-be80-70981db8b005 tempest-ProjectReaderTests-845927054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d3ccb10c-eaec-4e68-979c-3a789f48dd32 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:26 devstack sudo[108500]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:26 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e89cf63d-f695-47aa-a41b-98792e3ddd80 tempest-ProjectReaderTests-1092271699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-de19e987-b2f2-408b-9e68-22510e74a925.4e2984bb-d6bf-4ceb-84c2-eabaf95efa2f" returned: 0 in 0.506s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:26 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e89cf63d-f695-47aa-a41b-98792e3ddd80 tempest-ProjectReaderTests-1092271699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-de19e987-b2f2-408b-9e68-22510e74a925.4e2984bb-d6bf-4ceb-84c2-eabaf95efa2f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:26 devstack sudo[108516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d3ccb10c-eaec-4e68-979c-3a789f48dd32 Aug 10 16:15:26 devstack sudo[108516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:26 devstack sudo[108517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-de19e987-b2f2-408b-9e68-22510e74a925.4e2984bb-d6bf-4ceb-84c2-eabaf95efa2f Aug 10 16:15:26 devstack sudo[108517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:26 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-fb379b52-a99e-4a6f-b22b-0df8cc88f7ca tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Created volume successfully. Aug 10 16:15:26 devstack sudo[108517]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:26 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e89cf63d-f695-47aa-a41b-98792e3ddd80 tempest-ProjectReaderTests-1092271699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-de19e987-b2f2-408b-9e68-22510e74a925.4e2984bb-d6bf-4ceb-84c2-eabaf95efa2f" returned: 0 in 0.339s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:26 devstack sudo[108516]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:26 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-e89cf63d-f695-47aa-a41b-98792e3ddd80 tempest-ProjectReaderTests-1092271699 None] Lock "cinder-quobyte-4e2984bb-d6bf-4ceb-84c2-eabaf95efa2f" released by "_delete_snapshot" :: held 1.957s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:15:26 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ca4360f9-9d6b-4735-be80-70981db8b005 tempest-ProjectReaderTests-845927054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d3ccb10c-eaec-4e68-979c-3a789f48dd32" returned: 0 in 0.406s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:26 devstack sudo[108513]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:26 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-e89cf63d-f695-47aa-a41b-98792e3ddd80 tempest-ProjectReaderTests-1092271699 None] Lock "cinder-quobyte-de19e987-b2f2-408b-9e68-22510e74a925" released by "delete_snapshot" :: held 2.010s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:15:26 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-52e92a52-c75c-424c-bd03-f42af07d0b20 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-42dc1ba1-4c9d-4665-b283-b950bc76f6cd 1073741824" returned: 0 in 0.520s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:26 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-ca4360f9-9d6b-4735-be80-70981db8b005 tempest-ProjectReaderTests-845927054 None] Lock "cinder-quobyte-d3ccb10c-eaec-4e68-979c-3a789f48dd32" released by "delete_volume" :: held 1.047s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:15:26 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-52e92a52-c75c-424c-bd03-f42af07d0b20 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-42dc1ba1-4c9d-4665-b283-b950bc76f6cd {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:26 devstack sudo[108526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-42dc1ba1-4c9d-4665-b283-b950bc76f6cd Aug 10 16:15:26 devstack sudo[108526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:26 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-ca4360f9-9d6b-4735-be80-70981db8b005 tempest-ProjectReaderTests-845927054 None] Created reservations ['9a49ad8c-eef0-45d0-baa6-0fee5f8c82ef', 'd6222ef8-aed0-41b9-96c9-aa705dc0a8c3', '2868bcb0-39b0-4767-9725-cd0c03d45c64', '7ec75dd5-e83d-4e0a-a544-a16b598f944c'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:15:26 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-e89cf63d-f695-47aa-a41b-98792e3ddd80 tempest-ProjectReaderTests-1092271699 None] Created reservations ['3807dffd-773b-4f0a-a638-1497885699e6', '65f6f4f1-8004-4897-aaaf-2ea9e3256b07', 'dd7bde78-8868-4bbe-97b5-b20100cb7006', '5b969062-4bd2-44e9-8a75-7e36c81c5e77'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:15:26 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-e89cf63d-f695-47aa-a41b-98792e3ddd80 tempest-ProjectReaderTests-1092271699 None] Delete snapshot completed successfully. Aug 10 16:15:26 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-e89cf63d-f695-47aa-a41b-98792e3ddd80 tempest-ProjectReaderTests-1092271699 None] Lock "cinder-4e2984bb-d6bf-4ceb-84c2-eabaf95efa2f-delete_snapshot" released by "delete_snapshot" :: held 2.291s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:15:26 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-ca4360f9-9d6b-4735-be80-70981db8b005 tempest-ProjectReaderTests-845927054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:15:26 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-ca4360f9-9d6b-4735-be80-70981db8b005 tempest-ProjectReaderTests-845927054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:15:26 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-ca4360f9-9d6b-4735-be80-70981db8b005 tempest-ProjectReaderTests-845927054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:15:26 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-ca4360f9-9d6b-4735-be80-70981db8b005 tempest-ProjectReaderTests-845927054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:15:26 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-ca4360f9-9d6b-4735-be80-70981db8b005 tempest-ProjectReaderTests-845927054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:15:26 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ca4360f9-9d6b-4735-be80-70981db8b005 tempest-ProjectReaderTests-845927054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:26 devstack sudo[108528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:15:26 devstack sudo[108528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:27 devstack sudo[108526]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:27 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-52e92a52-c75c-424c-bd03-f42af07d0b20 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-42dc1ba1-4c9d-4665-b283-b950bc76f6cd" returned: 0 in 0.292s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:27 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-52e92a52-c75c-424c-bd03-f42af07d0b20 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:15:27 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-52e92a52-c75c-424c-bd03-f42af07d0b20 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:15:27 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-9d814350-7d3a-43db-9905-84df7bc3a8dd tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.397s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:15:27 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-9d814350-7d3a-43db-9905-84df7bc3a8dd tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:15:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1771346814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f7ca5a9-9995-42b0-8cb6-edf150564cd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccf5be2b44e0412686562e3b1a2f3ddb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:15:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:15:23Z,use_quota=True,user_id='fa422d25b7c64f18b45e7eea99148691',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:15:27 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-9d814350-7d3a-43db-9905-84df7bc3a8dd tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Creating volume 3f7ca5a9-9995-42b0-8cb6-edf150564cd6 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:15:27 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-9d814350-7d3a-43db-9905-84df7bc3a8dd tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:15:27 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-9d814350-7d3a-43db-9905-84df7bc3a8dd tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:15:27 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-9d814350-7d3a-43db-9905-84df7bc3a8dd tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:15:27 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-9d814350-7d3a-43db-9905-84df7bc3a8dd tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:15:27 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-9d814350-7d3a-43db-9905-84df7bc3a8dd tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:15:27 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-9d814350-7d3a-43db-9905-84df7bc3a8dd tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:15:27 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-9d814350-7d3a-43db-9905-84df7bc3a8dd tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:15:27 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9d814350-7d3a-43db-9905-84df7bc3a8dd tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3f7ca5a9-9995-42b0-8cb6-edf150564cd6 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:27 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-52e92a52-c75c-424c-bd03-f42af07d0b20 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26b7a87e-a878-4bb9-8247-8f650fc477aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42dc1ba1-4c9d-4665-b283-b950bc76f6cd', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:27 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-52e92a52-c75c-424c-bd03-f42af07d0b20 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3c7c762-6981-4af9-8519-90c0dd71f61e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:27 devstack sudo[108531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3f7ca5a9-9995-42b0-8cb6-edf150564cd6 1073741824 Aug 10 16:15:27 devstack sudo[108531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:27 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-52e92a52-c75c-424c-bd03-f42af07d0b20 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Volume volume-42dc1ba1-4c9d-4665-b283-b950bc76f6cd (42dc1ba1-4c9d-4665-b283-b950bc76f6cd): created successfully Aug 10 16:15:27 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-52e92a52-c75c-424c-bd03-f42af07d0b20 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3c7c762-6981-4af9-8519-90c0dd71f61e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:27 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-52e92a52-c75c-424c-bd03-f42af07d0b20 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Flow 'volume_create_manager' (e9920737-be3c-48a5-839b-4e9094d2c679) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:15:27 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-52e92a52-c75c-424c-bd03-f42af07d0b20 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Created volume successfully. Aug 10 16:15:27 devstack sudo[108528]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:27 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ca4360f9-9d6b-4735-be80-70981db8b005 tempest-ProjectReaderTests-845927054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.307s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:27 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-ca4360f9-9d6b-4735-be80-70981db8b005 tempest-ProjectReaderTests-845927054 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:15:27 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-ca4360f9-9d6b-4735-be80-70981db8b005 tempest-ProjectReaderTests-845927054 None] Deleted volume successfully. Aug 10 16:15:27 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-ca4360f9-9d6b-4735-be80-70981db8b005 tempest-ProjectReaderTests-845927054 None] Lock "cinder-d3ccb10c-eaec-4e68-979c-3a789f48dd32-delete_volume" released by "delete_volume" :: held 1.753s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:15:27 devstack sudo[108531]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:27 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9d814350-7d3a-43db-9905-84df7bc3a8dd tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3f7ca5a9-9995-42b0-8cb6-edf150564cd6 1073741824" returned: 0 in 0.547s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:27 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9d814350-7d3a-43db-9905-84df7bc3a8dd tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3f7ca5a9-9995-42b0-8cb6-edf150564cd6 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:27 devstack sudo[108538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3f7ca5a9-9995-42b0-8cb6-edf150564cd6 Aug 10 16:15:27 devstack sudo[108538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:27 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-785c4e98-7910-48e2-a3f8-7f7eaa6daa98 tempest-ProjectReaderTests-1092271699 None] Acquiring lock "cinder-de19e987-b2f2-408b-9e68-22510e74a925-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:15:27 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-785c4e98-7910-48e2-a3f8-7f7eaa6daa98 tempest-ProjectReaderTests-1092271699 None] Lock "cinder-de19e987-b2f2-408b-9e68-22510e74a925-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:15:27 devstack sudo[108538]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:27 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9d814350-7d3a-43db-9905-84df7bc3a8dd tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3f7ca5a9-9995-42b0-8cb6-edf150564cd6" returned: 0 in 0.305s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:27 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-9d814350-7d3a-43db-9905-84df7bc3a8dd tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:15:27 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-9d814350-7d3a-43db-9905-84df7bc3a8dd tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:15:27 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-9c31ba25-9123-491f-bc47-772ff21ba15b tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.870s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:15:27 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-9c31ba25-9123-491f-bc47-772ff21ba15b tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:15:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-610711865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b6ed93f-290a-4827-aa5b-53860189c5b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccf5be2b44e0412686562e3b1a2f3ddb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:15:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:15:24Z,use_quota=True,user_id='fa422d25b7c64f18b45e7eea99148691',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:15:27 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-9c31ba25-9123-491f-bc47-772ff21ba15b tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Creating volume 0b6ed93f-290a-4827-aa5b-53860189c5b8 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:15:27 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-9c31ba25-9123-491f-bc47-772ff21ba15b tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:15:27 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-9c31ba25-9123-491f-bc47-772ff21ba15b tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:15:27 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-9c31ba25-9123-491f-bc47-772ff21ba15b tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:15:27 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-9c31ba25-9123-491f-bc47-772ff21ba15b tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:15:27 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-9c31ba25-9123-491f-bc47-772ff21ba15b tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:15:27 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-9c31ba25-9123-491f-bc47-772ff21ba15b tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:15:27 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-9c31ba25-9123-491f-bc47-772ff21ba15b tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:15:27 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9c31ba25-9123-491f-bc47-772ff21ba15b tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-0b6ed93f-290a-4827-aa5b-53860189c5b8 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:27 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9d814350-7d3a-43db-9905-84df7bc3a8dd tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ada8d2f3-135a-4c16-af07-b371dd1f746e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f7ca5a9-9995-42b0-8cb6-edf150564cd6', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:28 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9d814350-7d3a-43db-9905-84df7bc3a8dd tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6419187-bae1-4a5a-b999-e069f90ab2cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:28 devstack sudo[108541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-0b6ed93f-290a-4827-aa5b-53860189c5b8 1073741824 Aug 10 16:15:28 devstack sudo[108541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:28 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-785c4e98-7910-48e2-a3f8-7f7eaa6daa98 tempest-ProjectReaderTests-1092271699 None] Acquiring lock "cinder-quobyte-de19e987-b2f2-408b-9e68-22510e74a925" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:15:28 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-9d814350-7d3a-43db-9905-84df7bc3a8dd tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Volume volume-3f7ca5a9-9995-42b0-8cb6-edf150564cd6 (3f7ca5a9-9995-42b0-8cb6-edf150564cd6): created successfully Aug 10 16:15:28 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9d814350-7d3a-43db-9905-84df7bc3a8dd tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6419187-bae1-4a5a-b999-e069f90ab2cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:28 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9d814350-7d3a-43db-9905-84df7bc3a8dd tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Flow 'volume_create_manager' (40dcf6a4-1237-40ae-bc72-ba093a35820f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:15:28 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-785c4e98-7910-48e2-a3f8-7f7eaa6daa98 tempest-ProjectReaderTests-1092271699 None] Lock "cinder-quobyte-de19e987-b2f2-408b-9e68-22510e74a925" acquired by "delete_volume" :: waited 0.041s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:15:28 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-9d814350-7d3a-43db-9905-84df7bc3a8dd tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Created volume successfully. Aug 10 16:15:28 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b6c33b-05c5-4c81-8786-111d4a87676c]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:15:28 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-785c4e98-7910-48e2-a3f8-7f7eaa6daa98 tempest-ProjectReaderTests-1092271699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-de19e987-b2f2-408b-9e68-22510e74a925 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:28 devstack sudo[108543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-de19e987-b2f2-408b-9e68-22510e74a925 Aug 10 16:15:28 devstack sudo[108543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:28 devstack sudo[108541]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:28 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9c31ba25-9123-491f-bc47-772ff21ba15b tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-0b6ed93f-290a-4827-aa5b-53860189c5b8 1073741824" returned: 0 in 0.620s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:28 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9c31ba25-9123-491f-bc47-772ff21ba15b tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-0b6ed93f-290a-4827-aa5b-53860189c5b8 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:28 devstack sudo[108543]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:28 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-785c4e98-7910-48e2-a3f8-7f7eaa6daa98 tempest-ProjectReaderTests-1092271699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-de19e987-b2f2-408b-9e68-22510e74a925" returned: 0 in 0.506s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:28 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-785c4e98-7910-48e2-a3f8-7f7eaa6daa98 tempest-ProjectReaderTests-1092271699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-de19e987-b2f2-408b-9e68-22510e74a925 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:28 devstack sudo[108552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-0b6ed93f-290a-4827-aa5b-53860189c5b8 Aug 10 16:15:28 devstack sudo[108552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:28 devstack sudo[108553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-de19e987-b2f2-408b-9e68-22510e74a925 Aug 10 16:15:28 devstack sudo[108553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:28 devstack sudo[108552]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:28 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9c31ba25-9123-491f-bc47-772ff21ba15b tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-0b6ed93f-290a-4827-aa5b-53860189c5b8" returned: 0 in 0.281s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:28 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-9c31ba25-9123-491f-bc47-772ff21ba15b tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:15:28 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-9c31ba25-9123-491f-bc47-772ff21ba15b tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:15:28 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9c31ba25-9123-491f-bc47-772ff21ba15b tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9f07579-1911-4e8b-85ce-141f440cad3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b6ed93f-290a-4827-aa5b-53860189c5b8', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:28 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9c31ba25-9123-491f-bc47-772ff21ba15b tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d44fdbf8-3727-4163-ae34-c01f91c4954c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:28 devstack sudo[108553]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:28 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-9c31ba25-9123-491f-bc47-772ff21ba15b tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Volume volume-0b6ed93f-290a-4827-aa5b-53860189c5b8 (0b6ed93f-290a-4827-aa5b-53860189c5b8): created successfully Aug 10 16:15:28 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9c31ba25-9123-491f-bc47-772ff21ba15b tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d44fdbf8-3727-4163-ae34-c01f91c4954c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:28 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-9c31ba25-9123-491f-bc47-772ff21ba15b tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Flow 'volume_create_manager' (c2f45496-d226-48db-9cae-16f1e0f6abc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:15:28 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-785c4e98-7910-48e2-a3f8-7f7eaa6daa98 tempest-ProjectReaderTests-1092271699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-de19e987-b2f2-408b-9e68-22510e74a925" returned: 0 in 0.356s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:29 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-785c4e98-7910-48e2-a3f8-7f7eaa6daa98 tempest-ProjectReaderTests-1092271699 None] Lock "cinder-quobyte-de19e987-b2f2-408b-9e68-22510e74a925" released by "delete_volume" :: held 0.958s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:15:29 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-9c31ba25-9123-491f-bc47-772ff21ba15b tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Created volume successfully. Aug 10 16:15:29 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-785c4e98-7910-48e2-a3f8-7f7eaa6daa98 tempest-ProjectReaderTests-1092271699 None] Created reservations ['11c9ee55-a190-4d52-9bfa-919782a04dd7', '7e4438b8-afd3-4cc5-8b69-6401a98a62e2', '67affd1e-4ade-4edd-8f70-3ac6ec7bd9a6', '2a81bf8d-0e4b-4dcc-a175-147e59c41977'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:15:29 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-785c4e98-7910-48e2-a3f8-7f7eaa6daa98 tempest-ProjectReaderTests-1092271699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:15:29 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-785c4e98-7910-48e2-a3f8-7f7eaa6daa98 tempest-ProjectReaderTests-1092271699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:15:29 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-785c4e98-7910-48e2-a3f8-7f7eaa6daa98 tempest-ProjectReaderTests-1092271699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:15:29 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-785c4e98-7910-48e2-a3f8-7f7eaa6daa98 tempest-ProjectReaderTests-1092271699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:15:29 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-785c4e98-7910-48e2-a3f8-7f7eaa6daa98 tempest-ProjectReaderTests-1092271699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:15:29 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-785c4e98-7910-48e2-a3f8-7f7eaa6daa98 tempest-ProjectReaderTests-1092271699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:29 devstack sudo[108558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:15:29 devstack sudo[108558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:29 devstack sudo[108558]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:29 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-785c4e98-7910-48e2-a3f8-7f7eaa6daa98 tempest-ProjectReaderTests-1092271699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.269s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:29 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-785c4e98-7910-48e2-a3f8-7f7eaa6daa98 tempest-ProjectReaderTests-1092271699 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:15:29 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-785c4e98-7910-48e2-a3f8-7f7eaa6daa98 tempest-ProjectReaderTests-1092271699 None] Deleted volume successfully. Aug 10 16:15:29 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-785c4e98-7910-48e2-a3f8-7f7eaa6daa98 tempest-ProjectReaderTests-1092271699 None] Lock "cinder-de19e987-b2f2-408b-9e68-22510e74a925-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:15:29 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-12a40b8a-7b68-4c3e-8e5a-64b316afee18 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Acquiring lock "cinder-0b6ed93f-290a-4827-aa5b-53860189c5b8-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:15:29 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-12a40b8a-7b68-4c3e-8e5a-64b316afee18 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Lock "cinder-0b6ed93f-290a-4827-aa5b-53860189c5b8-delete_volume" acquired by "delete_volume" :: waited 0.130s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:15:29 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-12a40b8a-7b68-4c3e-8e5a-64b316afee18 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Acquiring lock "cinder-quobyte-0b6ed93f-290a-4827-aa5b-53860189c5b8" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:15:29 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-12a40b8a-7b68-4c3e-8e5a-64b316afee18 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Lock "cinder-quobyte-0b6ed93f-290a-4827-aa5b-53860189c5b8" acquired by "delete_volume" :: waited 0.014s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:15:29 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[759924a7-68ec-4924-8256-d4107efc70f9]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:15:29 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-12a40b8a-7b68-4c3e-8e5a-64b316afee18 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-0b6ed93f-290a-4827-aa5b-53860189c5b8 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:30 devstack sudo[108561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-0b6ed93f-290a-4827-aa5b-53860189c5b8 Aug 10 16:15:30 devstack sudo[108561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:30 devstack sudo[108561]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:30 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-12a40b8a-7b68-4c3e-8e5a-64b316afee18 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-0b6ed93f-290a-4827-aa5b-53860189c5b8" returned: 0 in 0.457s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:30 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-12a40b8a-7b68-4c3e-8e5a-64b316afee18 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-0b6ed93f-290a-4827-aa5b-53860189c5b8 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:30 devstack sudo[108566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-0b6ed93f-290a-4827-aa5b-53860189c5b8 Aug 10 16:15:30 devstack sudo[108566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:30 devstack sudo[108566]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:30 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-12a40b8a-7b68-4c3e-8e5a-64b316afee18 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-0b6ed93f-290a-4827-aa5b-53860189c5b8" returned: 0 in 0.331s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:30 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-12a40b8a-7b68-4c3e-8e5a-64b316afee18 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Lock "cinder-quobyte-0b6ed93f-290a-4827-aa5b-53860189c5b8" released by "delete_volume" :: held 0.844s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:15:30 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-12a40b8a-7b68-4c3e-8e5a-64b316afee18 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Created reservations ['edb145d7-7b70-4dd1-b256-89cf078582f1', 'b1f4c66b-94a6-40ed-9bbd-d8185b3f0d4e', '713635de-a715-4caa-bef4-4862fa8b6840', '6afbe03b-2148-4e30-a312-7353561001a0'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:15:30 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6c1e8c9-5dd9-4210-9dbb-2c2398e87d1f tempest-ProjectReaderTests-1092271699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:15:30 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c6c1e8c9-5dd9-4210-9dbb-2c2398e87d1f tempest-ProjectReaderTests-1092271699 None] Flow 'volume_create_manager' (5fabf8e8-856d-44b2-baac-81f257e128f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:15:30 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c6c1e8c9-5dd9-4210-9dbb-2c2398e87d1f tempest-ProjectReaderTests-1092271699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86504b73-a21f-4380-b892-aa434441739c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:30 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c6c1e8c9-5dd9-4210-9dbb-2c2398e87d1f tempest-ProjectReaderTests-1092271699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86504b73-a21f-4380-b892-aa434441739c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:15:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1997215512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1affae34-aa2f-4dca-bcb8-1c703b015642,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8da6b8cdad34ff69416120b23e9a25c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:15:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:15:31Z,use_quota=True,user_id='4e50367bdb2c40639a24a8a70eaa2b15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:30 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c6c1e8c9-5dd9-4210-9dbb-2c2398e87d1f tempest-ProjectReaderTests-1092271699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a53c9c20-6d15-4dbb-bae2-c5dbfcaa8235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:30 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c6c1e8c9-5dd9-4210-9dbb-2c2398e87d1f tempest-ProjectReaderTests-1092271699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a53c9c20-6d15-4dbb-bae2-c5dbfcaa8235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:30 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c6c1e8c9-5dd9-4210-9dbb-2c2398e87d1f tempest-ProjectReaderTests-1092271699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8118263b-2bb3-46b1-a6de-468e89f3ed2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:30 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c6c1e8c9-5dd9-4210-9dbb-2c2398e87d1f tempest-ProjectReaderTests-1092271699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8118263b-2bb3-46b1-a6de-468e89f3ed2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1affae34-aa2f-4dca-bcb8-1c703b015642', 'volume_name': 'volume-1affae34-aa2f-4dca-bcb8-1c703b015642', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:30 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c6c1e8c9-5dd9-4210-9dbb-2c2398e87d1f tempest-ProjectReaderTests-1092271699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (417a18c3-3a85-4cad-8953-1550a2d3e387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:30 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c6c1e8c9-5dd9-4210-9dbb-2c2398e87d1f tempest-ProjectReaderTests-1092271699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (417a18c3-3a85-4cad-8953-1550a2d3e387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:30 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c6c1e8c9-5dd9-4210-9dbb-2c2398e87d1f tempest-ProjectReaderTests-1092271699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (572235ed-1bf8-4b07-a35e-418474a7eeac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:30 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-c6c1e8c9-5dd9-4210-9dbb-2c2398e87d1f tempest-ProjectReaderTests-1092271699 None] Volume 1affae34-aa2f-4dca-bcb8-1c703b015642: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1affae34-aa2f-4dca-bcb8-1c703b015642', 'volume_size': 1} Aug 10 16:15:30 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-c6c1e8c9-5dd9-4210-9dbb-2c2398e87d1f tempest-ProjectReaderTests-1092271699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:15:30 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-c6c1e8c9-5dd9-4210-9dbb-2c2398e87d1f tempest-ProjectReaderTests-1092271699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:15:30 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-c6c1e8c9-5dd9-4210-9dbb-2c2398e87d1f tempest-ProjectReaderTests-1092271699 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:15:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1997215512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1affae34-aa2f-4dca-bcb8-1c703b015642,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8da6b8cdad34ff69416120b23e9a25c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:15:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:15:31Z,use_quota=True,user_id='4e50367bdb2c40639a24a8a70eaa2b15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:15:30 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-c6c1e8c9-5dd9-4210-9dbb-2c2398e87d1f tempest-ProjectReaderTests-1092271699 None] Creating volume 1affae34-aa2f-4dca-bcb8-1c703b015642 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:15:30 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-c6c1e8c9-5dd9-4210-9dbb-2c2398e87d1f tempest-ProjectReaderTests-1092271699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:15:30 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-c6c1e8c9-5dd9-4210-9dbb-2c2398e87d1f tempest-ProjectReaderTests-1092271699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:15:30 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-c6c1e8c9-5dd9-4210-9dbb-2c2398e87d1f tempest-ProjectReaderTests-1092271699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:15:30 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-c6c1e8c9-5dd9-4210-9dbb-2c2398e87d1f tempest-ProjectReaderTests-1092271699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:15:30 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-c6c1e8c9-5dd9-4210-9dbb-2c2398e87d1f tempest-ProjectReaderTests-1092271699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:15:30 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-c6c1e8c9-5dd9-4210-9dbb-2c2398e87d1f tempest-ProjectReaderTests-1092271699 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:15:30 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-c6c1e8c9-5dd9-4210-9dbb-2c2398e87d1f tempest-ProjectReaderTests-1092271699 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:15:30 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c6c1e8c9-5dd9-4210-9dbb-2c2398e87d1f tempest-ProjectReaderTests-1092271699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-1affae34-aa2f-4dca-bcb8-1c703b015642 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:30 devstack sudo[108569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-1affae34-aa2f-4dca-bcb8-1c703b015642 1073741824 Aug 10 16:15:30 devstack sudo[108569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:30 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-12a40b8a-7b68-4c3e-8e5a-64b316afee18 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:15:30 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-12a40b8a-7b68-4c3e-8e5a-64b316afee18 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:15:30 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-12a40b8a-7b68-4c3e-8e5a-64b316afee18 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:15:30 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-12a40b8a-7b68-4c3e-8e5a-64b316afee18 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:15:30 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-12a40b8a-7b68-4c3e-8e5a-64b316afee18 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:15:30 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-12a40b8a-7b68-4c3e-8e5a-64b316afee18 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:31 devstack sudo[108571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:15:31 devstack sudo[108571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:31 devstack sudo[108571]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:31 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-12a40b8a-7b68-4c3e-8e5a-64b316afee18 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.324s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:31 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-12a40b8a-7b68-4c3e-8e5a-64b316afee18 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:15:31 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-12a40b8a-7b68-4c3e-8e5a-64b316afee18 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Deleted volume successfully. Aug 10 16:15:31 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-12a40b8a-7b68-4c3e-8e5a-64b316afee18 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Lock "cinder-0b6ed93f-290a-4827-aa5b-53860189c5b8-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:15:31 devstack sudo[108569]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:31 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c6c1e8c9-5dd9-4210-9dbb-2c2398e87d1f tempest-ProjectReaderTests-1092271699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-1affae34-aa2f-4dca-bcb8-1c703b015642 1073741824" returned: 0 in 0.572s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:31 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c6c1e8c9-5dd9-4210-9dbb-2c2398e87d1f tempest-ProjectReaderTests-1092271699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-1affae34-aa2f-4dca-bcb8-1c703b015642 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:31 devstack sudo[108578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-1affae34-aa2f-4dca-bcb8-1c703b015642 Aug 10 16:15:31 devstack sudo[108578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:31 devstack sudo[108578]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:31 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-c6c1e8c9-5dd9-4210-9dbb-2c2398e87d1f tempest-ProjectReaderTests-1092271699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-1affae34-aa2f-4dca-bcb8-1c703b015642" returned: 0 in 0.384s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:31 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-c6c1e8c9-5dd9-4210-9dbb-2c2398e87d1f tempest-ProjectReaderTests-1092271699 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:15:31 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-c6c1e8c9-5dd9-4210-9dbb-2c2398e87d1f tempest-ProjectReaderTests-1092271699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:15:31 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c6c1e8c9-5dd9-4210-9dbb-2c2398e87d1f tempest-ProjectReaderTests-1092271699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (572235ed-1bf8-4b07-a35e-418474a7eeac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1affae34-aa2f-4dca-bcb8-1c703b015642', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:31 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c6c1e8c9-5dd9-4210-9dbb-2c2398e87d1f tempest-ProjectReaderTests-1092271699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46b661e4-bb90-4061-afd5-19374e3cb630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:31 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-c6c1e8c9-5dd9-4210-9dbb-2c2398e87d1f tempest-ProjectReaderTests-1092271699 None] Volume volume-1affae34-aa2f-4dca-bcb8-1c703b015642 (1affae34-aa2f-4dca-bcb8-1c703b015642): created successfully Aug 10 16:15:31 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c6c1e8c9-5dd9-4210-9dbb-2c2398e87d1f tempest-ProjectReaderTests-1092271699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46b661e4-bb90-4061-afd5-19374e3cb630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:32 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-c6c1e8c9-5dd9-4210-9dbb-2c2398e87d1f tempest-ProjectReaderTests-1092271699 None] Flow 'volume_create_manager' (5fabf8e8-856d-44b2-baac-81f257e128f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:15:32 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-6c3988fe-4e73-4a64-806e-9eb7c786c828 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Acquiring lock "cinder-3f7ca5a9-9995-42b0-8cb6-edf150564cd6-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:15:32 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-c6c1e8c9-5dd9-4210-9dbb-2c2398e87d1f tempest-ProjectReaderTests-1092271699 None] Created volume successfully. Aug 10 16:15:32 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-6c3988fe-4e73-4a64-806e-9eb7c786c828 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Lock "cinder-3f7ca5a9-9995-42b0-8cb6-edf150564cd6-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:15:32 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-6c3988fe-4e73-4a64-806e-9eb7c786c828 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Acquiring lock "cinder-quobyte-3f7ca5a9-9995-42b0-8cb6-edf150564cd6" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:15:32 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ccf5a7f-9c90-4847-802d-b5ea1c6b9dde tempest-VolumeImageDependencyTests-339855100 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:15:32 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-6ccf5a7f-9c90-4847-802d-b5ea1c6b9dde tempest-VolumeImageDependencyTests-339855100 None] Flow 'volume_create_manager' (b60da916-340f-4492-8036-f3fc225282db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:15:32 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-6ccf5a7f-9c90-4847-802d-b5ea1c6b9dde tempest-VolumeImageDependencyTests-339855100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0966ec7b-e470-4cdd-8c6b-d6603f035491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:32 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-6c3988fe-4e73-4a64-806e-9eb7c786c828 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Lock "cinder-quobyte-3f7ca5a9-9995-42b0-8cb6-edf150564cd6" acquired by "delete_volume" :: waited 0.051s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:15:32 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-6ccf5a7f-9c90-4847-802d-b5ea1c6b9dde tempest-VolumeImageDependencyTests-339855100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0966ec7b-e470-4cdd-8c6b-d6603f035491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:15:32Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8da15e3-d5e6-4459-9f36-9cbeb167677c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3df04838bf9f4aa2bdc90e7947a2e8f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:15:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:15:32Z,use_quota=True,user_id='71a0c160fa6249ffabc361ad12b0dc09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:32 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-6ccf5a7f-9c90-4847-802d-b5ea1c6b9dde tempest-VolumeImageDependencyTests-339855100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3351406-9d44-4e8c-8659-5b8274d8d04d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:32 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-6ccf5a7f-9c90-4847-802d-b5ea1c6b9dde tempest-VolumeImageDependencyTests-339855100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3351406-9d44-4e8c-8659-5b8274d8d04d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:32 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-6ccf5a7f-9c90-4847-802d-b5ea1c6b9dde tempest-VolumeImageDependencyTests-339855100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bfb27d5-9b62-4546-bb7e-5feb73c5bf0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:32 devstack cinder-volume[88641]: DEBUG cinder.image.glance [None req-6ccf5a7f-9c90-4847-802d-b5ea1c6b9dde tempest-VolumeImageDependencyTests-339855100 None] Creating Keystone auth plugin from conf {{(pid=88641) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 10 16:15:32 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[a040208a-2113-4a04-81b1-ba0320b120fe]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:15:32 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6c3988fe-4e73-4a64-806e-9eb7c786c828 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3f7ca5a9-9995-42b0-8cb6-edf150564cd6 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:32 devstack sudo[108581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3f7ca5a9-9995-42b0-8cb6-edf150564cd6 Aug 10 16:15:32 devstack sudo[108581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:32 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-6ccf5a7f-9c90-4847-802d-b5ea1c6b9dde tempest-VolumeImageDependencyTests-339855100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bfb27d5-9b62-4546-bb7e-5feb73c5bf0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c8da15e3-d5e6-4459-9f36-9cbeb167677c', 'volume_name': 'volume-c8da15e3-d5e6-4459-9f36-9cbeb167677c', 'volume_size': 1, 'image_id': 'bf6d8feb-935a-4d7d-b5e9-9a1f666c6930', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bf6d8feb-935a-4d7d-b5e9-9a1f666c6930', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8875b76149fd54f6de3bf95b74d3f010', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3df04838bf9f4aa2bdc90e7947a2e8f6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7bff3c12f2e8bd3da5e994a401f6aab0daf46a78eb57dd35ed0d67f8fb00ce09a2cc71bc22a265f13260b38c1fd44393d4756581c9518f2c7504e69b75c92337', 'id': 'bf6d8feb-935a-4d7d-b5e9-9a1f666c6930', 'created_at': datetime.datetime(2026, 8, 10, 14, 15, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 10, 14, 15, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bf6d8feb-935a-4d7d-b5e9-9a1f666c6930/file', 'properties': {}}, 'image_service': }' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:32 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-6ccf5a7f-9c90-4847-802d-b5ea1c6b9dde tempest-VolumeImageDependencyTests-339855100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07bb4aa0-0a52-4fc0-899f-46cdf2974374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:32 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-6ccf5a7f-9c90-4847-802d-b5ea1c6b9dde tempest-VolumeImageDependencyTests-339855100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07bb4aa0-0a52-4fc0-899f-46cdf2974374) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:32 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-6ccf5a7f-9c90-4847-802d-b5ea1c6b9dde tempest-VolumeImageDependencyTests-339855100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc6a53d7-68fe-4cd4-9199-c685cc00134e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:32 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-6ccf5a7f-9c90-4847-802d-b5ea1c6b9dde tempest-VolumeImageDependencyTests-339855100 None] Volume c8da15e3-d5e6-4459-9f36-9cbeb167677c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c8da15e3-d5e6-4459-9f36-9cbeb167677c', 'volume_size': 1, 'image_id': 'bf6d8feb-935a-4d7d-b5e9-9a1f666c6930', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bf6d8feb-935a-4d7d-b5e9-9a1f666c6930', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8875b76149fd54f6de3bf95b74d3f010', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3df04838bf9f4aa2bdc90e7947a2e8f6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7bff3c12f2e8bd3da5e994a401f6aab0daf46a78eb57dd35ed0d67f8fb00ce09a2cc71bc22a265f13260b38c1fd44393d4756581c9518f2c7504e69b75c92337', 'id': 'bf6d8feb-935a-4d7d-b5e9-9a1f666c6930', 'created_at': datetime.datetime(2026, 8, 10, 14, 15, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 10, 14, 15, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bf6d8feb-935a-4d7d-b5e9-9a1f666c6930/file', 'properties': {}}, 'image_service': } Aug 10 16:15:32 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ccf5a7f-9c90-4847-802d-b5ea1c6b9dde tempest-VolumeImageDependencyTests-339855100 None] Trying to clone c8da15e3-d5e6-4459-9f36-9cbeb167677c from image bf6d8feb-935a-4d7d-b5e9-9a1f666c6930 at location (None, [{'url': 'file:///opt/stack/data/glance/images/bf6d8feb-935a-4d7d-b5e9-9a1f666c6930', 'metadata': {}}]). {{(pid=88641) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 10 16:15:32 devstack sudo[108581]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:32 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6c3988fe-4e73-4a64-806e-9eb7c786c828 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3f7ca5a9-9995-42b0-8cb6-edf150564cd6" returned: 0 in 0.480s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:32 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6c3988fe-4e73-4a64-806e-9eb7c786c828 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3f7ca5a9-9995-42b0-8cb6-edf150564cd6 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:32 devstack sudo[108588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3f7ca5a9-9995-42b0-8cb6-edf150564cd6 Aug 10 16:15:32 devstack sudo[108588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:32 devstack cinder-volume[88641]: DEBUG cinder.image.image_utils [None req-6ccf5a7f-9c90-4847-802d-b5ea1c6b9dde tempest-VolumeImageDependencyTests-339855100 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_bf6d8feb-935a-4d7d-b5e9-9a1f666c6930_dkqklsyidevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88641) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 10 16:15:32 devstack cinder-volume[88641]: INFO cinder.image.image_utils [None req-6ccf5a7f-9c90-4847-802d-b5ea1c6b9dde tempest-VolumeImageDependencyTests-339855100 None] Image download 0.00 MB at 0.00 MB/s Aug 10 16:15:32 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[50187271-8f35-4705-a842-ddb45e0a83d1]: (4, 'raw') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:15:32 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6ccf5a7f-9c90-4847-802d-b5ea1c6b9dde tempest-VolumeImageDependencyTests-339855100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bf6d8feb-935a-4d7d-b5e9-9a1f666c6930_dkqklsyidevstack@QuobyteHD {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:33 devstack sudo[108590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bf6d8feb-935a-4d7d-b5e9-9a1f666c6930_dkqklsyidevstack@QuobyteHD Aug 10 16:15:33 devstack sudo[108590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:33 devstack sudo[108588]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:33 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6c3988fe-4e73-4a64-806e-9eb7c786c828 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-3f7ca5a9-9995-42b0-8cb6-edf150564cd6" returned: 0 in 0.374s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:33 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-6c3988fe-4e73-4a64-806e-9eb7c786c828 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Lock "cinder-quobyte-3f7ca5a9-9995-42b0-8cb6-edf150564cd6" released by "delete_volume" :: held 0.931s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:15:33 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-a6bbabd0-c959-466d-978f-e7f2dfccd19e tempest-ProjectReaderTests-1092271699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:15:33 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-a6bbabd0-c959-466d-978f-e7f2dfccd19e tempest-ProjectReaderTests-1092271699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:15:33 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-a6bbabd0-c959-466d-978f-e7f2dfccd19e tempest-ProjectReaderTests-1092271699 None] Creating offline snapshot e60f2022-51f8-4a07-b5d6-69c7e556fe68 of volume 1affae34-aa2f-4dca-bcb8-1c703b015642 {{(pid=88641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 16:15:33 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-6c3988fe-4e73-4a64-806e-9eb7c786c828 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Created reservations ['a1874347-c0af-47cc-9853-43f75b5e0b76', '473fee2c-2389-4e0a-a5f0-6d097af64363', 'e9d4bbb4-298f-4b5d-aa31-6d5e9ef7edcd', 'bc441861-15b9-4abc-b311-07f29cdd4a59'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:15:33 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c527a96-c1d4-4c6e-aa07-7b1ef6554e89]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:15:33 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a6bbabd0-c959-466d-978f-e7f2dfccd19e tempest-ProjectReaderTests-1092271699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-1affae34-aa2f-4dca-bcb8-1c703b015642 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:33 devstack sudo[108590]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:33 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6ccf5a7f-9c90-4847-802d-b5ea1c6b9dde tempest-VolumeImageDependencyTests-339855100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bf6d8feb-935a-4d7d-b5e9-9a1f666c6930_dkqklsyidevstack@QuobyteHD" returned: 0 in 0.442s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:33 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6ccf5a7f-9c90-4847-802d-b5ea1c6b9dde tempest-VolumeImageDependencyTests-339855100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bf6d8feb-935a-4d7d-b5e9-9a1f666c6930_dkqklsyidevstack@QuobyteHD {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:33 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-6c3988fe-4e73-4a64-806e-9eb7c786c828 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:15:33 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-6c3988fe-4e73-4a64-806e-9eb7c786c828 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:15:33 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-6c3988fe-4e73-4a64-806e-9eb7c786c828 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:15:33 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-6c3988fe-4e73-4a64-806e-9eb7c786c828 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:15:33 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-6c3988fe-4e73-4a64-806e-9eb7c786c828 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:15:33 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6c3988fe-4e73-4a64-806e-9eb7c786c828 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:33 devstack sudo[108597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:15:33 devstack sudo[108597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:33 devstack sudo[108593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-1affae34-aa2f-4dca-bcb8-1c703b015642 Aug 10 16:15:33 devstack sudo[108593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:33 devstack sudo[108596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bf6d8feb-935a-4d7d-b5e9-9a1f666c6930_dkqklsyidevstack@QuobyteHD Aug 10 16:15:33 devstack sudo[108596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:33 devstack sudo[108597]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:33 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6c3988fe-4e73-4a64-806e-9eb7c786c828 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.292s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:33 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-6c3988fe-4e73-4a64-806e-9eb7c786c828 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:15:33 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-6c3988fe-4e73-4a64-806e-9eb7c786c828 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Deleted volume successfully. Aug 10 16:15:33 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-6c3988fe-4e73-4a64-806e-9eb7c786c828 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Lock "cinder-3f7ca5a9-9995-42b0-8cb6-edf150564cd6-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:15:33 devstack sudo[108596]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:33 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6ccf5a7f-9c90-4847-802d-b5ea1c6b9dde tempest-VolumeImageDependencyTests-339855100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bf6d8feb-935a-4d7d-b5e9-9a1f666c6930_dkqklsyidevstack@QuobyteHD" returned: 1 in 0.409s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:33 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6ccf5a7f-9c90-4847-802d-b5ea1c6b9dde tempest-VolumeImageDependencyTests-339855100 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bf6d8feb-935a-4d7d-b5e9-9a1f666c6930_dkqklsyidevstack@QuobyteHD' failed. Not Retrying. {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 10 16:15:33 devstack cinder-volume[88641]: DEBUG cinder.image.image_utils [None req-6ccf5a7f-9c90-4847-802d-b5ea1c6b9dde tempest-VolumeImageDependencyTests-339855100 None] Temporary image bf6d8feb-935a-4d7d-b5e9-9a1f666c6930 is fetched for user 71a0c160fa6249ffabc361ad12b0dc09. {{(pid=88641) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 10 16:15:33 devstack sudo[108593]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:33 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a6bbabd0-c959-466d-978f-e7f2dfccd19e tempest-ProjectReaderTests-1092271699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-1affae34-aa2f-4dca-bcb8-1c703b015642" returned: 0 in 0.490s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:33 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a6bbabd0-c959-466d-978f-e7f2dfccd19e tempest-ProjectReaderTests-1092271699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-1affae34-aa2f-4dca-bcb8-1c703b015642,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-1affae34-aa2f-4dca-bcb8-1c703b015642.e60f2022-51f8-4a07-b5d6-69c7e556fe68 1G {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:33 devstack sudo[108610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-1affae34-aa2f-4dca-bcb8-1c703b015642,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-1affae34-aa2f-4dca-bcb8-1c703b015642.e60f2022-51f8-4a07-b5d6-69c7e556fe68 1G Aug 10 16:15:33 devstack sudo[108610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:33 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[e841c8ac-c6f0-46cf-9d95-3d04324e84d6]: (4, 'raw') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:15:33 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6ccf5a7f-9c90-4847-802d-b5ea1c6b9dde tempest-VolumeImageDependencyTests-339855100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bf6d8feb-935a-4d7d-b5e9-9a1f666c6930_dkqklsyidevstack@QuobyteHD {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:33 devstack sudo[108612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bf6d8feb-935a-4d7d-b5e9-9a1f666c6930_dkqklsyidevstack@QuobyteHD Aug 10 16:15:33 devstack sudo[108612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:34 devstack sudo[108610]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:34 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a6bbabd0-c959-466d-978f-e7f2dfccd19e tempest-ProjectReaderTests-1092271699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-1affae34-aa2f-4dca-bcb8-1c703b015642,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-1affae34-aa2f-4dca-bcb8-1c703b015642.e60f2022-51f8-4a07-b5d6-69c7e556fe68 1G" returned: 0 in 0.499s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:34 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a6bbabd0-c959-466d-978f-e7f2dfccd19e tempest-ProjectReaderTests-1092271699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1affae34-aa2f-4dca-bcb8-1c703b015642 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-1affae34-aa2f-4dca-bcb8-1c703b015642.e60f2022-51f8-4a07-b5d6-69c7e556fe68 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:34 devstack sudo[108612]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:34 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6ccf5a7f-9c90-4847-802d-b5ea1c6b9dde tempest-VolumeImageDependencyTests-339855100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bf6d8feb-935a-4d7d-b5e9-9a1f666c6930_dkqklsyidevstack@QuobyteHD" returned: 0 in 0.436s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:34 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6ccf5a7f-9c90-4847-802d-b5ea1c6b9dde tempest-VolumeImageDependencyTests-339855100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bf6d8feb-935a-4d7d-b5e9-9a1f666c6930_dkqklsyidevstack@QuobyteHD {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:34 devstack sudo[108620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1affae34-aa2f-4dca-bcb8-1c703b015642 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-1affae34-aa2f-4dca-bcb8-1c703b015642.e60f2022-51f8-4a07-b5d6-69c7e556fe68 Aug 10 16:15:34 devstack sudo[108620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:34 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-da900b41-9079-4661-9c9b-a384cdb1957a tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Acquiring lock "cinder-42dc1ba1-4c9d-4665-b283-b950bc76f6cd-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:15:34 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-da900b41-9079-4661-9c9b-a384cdb1957a tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Lock "cinder-42dc1ba1-4c9d-4665-b283-b950bc76f6cd-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:15:34 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-da900b41-9079-4661-9c9b-a384cdb1957a tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Acquiring lock "cinder-quobyte-42dc1ba1-4c9d-4665-b283-b950bc76f6cd" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:15:34 devstack sudo[108621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bf6d8feb-935a-4d7d-b5e9-9a1f666c6930_dkqklsyidevstack@QuobyteHD Aug 10 16:15:34 devstack sudo[108621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:34 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-da900b41-9079-4661-9c9b-a384cdb1957a tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Lock "cinder-quobyte-42dc1ba1-4c9d-4665-b283-b950bc76f6cd" acquired by "delete_volume" :: waited 0.016s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:15:34 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e6872b3-e112-40e1-b860-a0664bc1edf0]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:15:34 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-da900b41-9079-4661-9c9b-a384cdb1957a tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-42dc1ba1-4c9d-4665-b283-b950bc76f6cd {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:34 devstack sudo[108624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-42dc1ba1-4c9d-4665-b283-b950bc76f6cd Aug 10 16:15:34 devstack sudo[108624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:34 devstack sudo[108620]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:34 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a6bbabd0-c959-466d-978f-e7f2dfccd19e tempest-ProjectReaderTests-1092271699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1affae34-aa2f-4dca-bcb8-1c703b015642 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-1affae34-aa2f-4dca-bcb8-1c703b015642.e60f2022-51f8-4a07-b5d6-69c7e556fe68" returned: 0 in 0.392s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:34 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-a6bbabd0-c959-466d-978f-e7f2dfccd19e tempest-ProjectReaderTests-1092271699 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-1affae34-aa2f-4dca-bcb8-1c703b015642.e60f2022-51f8-4a07-b5d6-69c7e556fe68 is being set with open permissions: ugo+rw Aug 10 16:15:34 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a6bbabd0-c959-466d-978f-e7f2dfccd19e tempest-ProjectReaderTests-1092271699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-1affae34-aa2f-4dca-bcb8-1c703b015642.e60f2022-51f8-4a07-b5d6-69c7e556fe68 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:34 devstack sudo[108621]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:34 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6ccf5a7f-9c90-4847-802d-b5ea1c6b9dde tempest-VolumeImageDependencyTests-339855100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bf6d8feb-935a-4d7d-b5e9-9a1f666c6930_dkqklsyidevstack@QuobyteHD" returned: 1 in 0.400s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:34 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6ccf5a7f-9c90-4847-802d-b5ea1c6b9dde tempest-VolumeImageDependencyTests-339855100 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bf6d8feb-935a-4d7d-b5e9-9a1f666c6930_dkqklsyidevstack@QuobyteHD' failed. Not Retrying. {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 10 16:15:34 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-6ccf5a7f-9c90-4847-802d-b5ea1c6b9dde tempest-VolumeImageDependencyTests-339855100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:15:34 devstack sudo[108633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-1affae34-aa2f-4dca-bcb8-1c703b015642.e60f2022-51f8-4a07-b5d6-69c7e556fe68 Aug 10 16:15:34 devstack sudo[108633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:34 devstack sudo[108624]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:34 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-da900b41-9079-4661-9c9b-a384cdb1957a tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-42dc1ba1-4c9d-4665-b283-b950bc76f6cd" returned: 0 in 0.423s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:34 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-da900b41-9079-4661-9c9b-a384cdb1957a tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-42dc1ba1-4c9d-4665-b283-b950bc76f6cd {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:34 devstack sudo[108633]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:34 devstack sudo[108639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-42dc1ba1-4c9d-4665-b283-b950bc76f6cd Aug 10 16:15:34 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a6bbabd0-c959-466d-978f-e7f2dfccd19e tempest-ProjectReaderTests-1092271699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-1affae34-aa2f-4dca-bcb8-1c703b015642.e60f2022-51f8-4a07-b5d6-69c7e556fe68" returned: 0 in 0.272s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:34 devstack sudo[108639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:34 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a6bbabd0-c959-466d-978f-e7f2dfccd19e tempest-ProjectReaderTests-1092271699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-1affae34-aa2f-4dca-bcb8-1c703b015642.info {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:34 devstack sudo[108641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-1affae34-aa2f-4dca-bcb8-1c703b015642.info Aug 10 16:15:34 devstack sudo[108641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:35 devstack sudo[108639]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:35 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-da900b41-9079-4661-9c9b-a384cdb1957a tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-42dc1ba1-4c9d-4665-b283-b950bc76f6cd" returned: 0 in 0.270s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:35 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-da900b41-9079-4661-9c9b-a384cdb1957a tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Lock "cinder-quobyte-42dc1ba1-4c9d-4665-b283-b950bc76f6cd" released by "delete_volume" :: held 0.756s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:15:35 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-da900b41-9079-4661-9c9b-a384cdb1957a tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Created reservations ['bfc5ee02-6320-4edf-af3d-196f3d9ca0da', '89442212-2eab-4224-bb88-44cc92de3d84', '094520e1-64ff-417f-84ca-a47ced87c784', 'df8bc08a-e161-4f9e-b0cd-6e05d8502d6a'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:15:35 devstack sudo[108641]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:35 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a6bbabd0-c959-466d-978f-e7f2dfccd19e tempest-ProjectReaderTests-1092271699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-1affae34-aa2f-4dca-bcb8-1c703b015642.info" returned: 0 in 0.314s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:35 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-a6bbabd0-c959-466d-978f-e7f2dfccd19e tempest-ProjectReaderTests-1092271699 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-1affae34-aa2f-4dca-bcb8-1c703b015642.info is being set with open permissions: ugo+rw Aug 10 16:15:35 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a6bbabd0-c959-466d-978f-e7f2dfccd19e tempest-ProjectReaderTests-1092271699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-1affae34-aa2f-4dca-bcb8-1c703b015642.info {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:35 devstack sudo[108645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-1affae34-aa2f-4dca-bcb8-1c703b015642.info Aug 10 16:15:35 devstack sudo[108645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:35 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-da900b41-9079-4661-9c9b-a384cdb1957a tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:15:35 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-da900b41-9079-4661-9c9b-a384cdb1957a tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:15:35 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-da900b41-9079-4661-9c9b-a384cdb1957a tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:15:35 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-da900b41-9079-4661-9c9b-a384cdb1957a tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:15:35 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-da900b41-9079-4661-9c9b-a384cdb1957a tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:15:35 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-da900b41-9079-4661-9c9b-a384cdb1957a tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:35 devstack sudo[108647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:15:35 devstack sudo[108647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:35 devstack sudo[108645]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:35 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-a6bbabd0-c959-466d-978f-e7f2dfccd19e tempest-ProjectReaderTests-1092271699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-1affae34-aa2f-4dca-bcb8-1c703b015642.info" returned: 0 in 0.295s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:35 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-a6bbabd0-c959-466d-978f-e7f2dfccd19e tempest-ProjectReaderTests-1092271699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.371s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:15:35 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-6ccf5a7f-9c90-4847-802d-b5ea1c6b9dde tempest-VolumeImageDependencyTests-339855100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.919s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:15:35 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-6ccf5a7f-9c90-4847-802d-b5ea1c6b9dde tempest-VolumeImageDependencyTests-339855100 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:15:32Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8da15e3-d5e6-4459-9f36-9cbeb167677c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3df04838bf9f4aa2bdc90e7947a2e8f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:15:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:15:32Z,use_quota=True,user_id='71a0c160fa6249ffabc361ad12b0dc09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:15:35 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-6ccf5a7f-9c90-4847-802d-b5ea1c6b9dde tempest-VolumeImageDependencyTests-339855100 None] Creating volume c8da15e3-d5e6-4459-9f36-9cbeb167677c {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:15:35 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-6ccf5a7f-9c90-4847-802d-b5ea1c6b9dde tempest-VolumeImageDependencyTests-339855100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:15:35 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-6ccf5a7f-9c90-4847-802d-b5ea1c6b9dde tempest-VolumeImageDependencyTests-339855100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:15:35 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-6ccf5a7f-9c90-4847-802d-b5ea1c6b9dde tempest-VolumeImageDependencyTests-339855100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:15:35 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-6ccf5a7f-9c90-4847-802d-b5ea1c6b9dde tempest-VolumeImageDependencyTests-339855100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:15:35 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-6ccf5a7f-9c90-4847-802d-b5ea1c6b9dde tempest-VolumeImageDependencyTests-339855100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:15:35 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-6ccf5a7f-9c90-4847-802d-b5ea1c6b9dde tempest-VolumeImageDependencyTests-339855100 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:15:35 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-6ccf5a7f-9c90-4847-802d-b5ea1c6b9dde tempest-VolumeImageDependencyTests-339855100 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:15:35 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6ccf5a7f-9c90-4847-802d-b5ea1c6b9dde tempest-VolumeImageDependencyTests-339855100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c8da15e3-d5e6-4459-9f36-9cbeb167677c 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:35 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-dbed8779-da65-4f18-a7b0-361a522b85ac tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Acquiring lock "cinder-d7c32d9c-c443-4d94-a9e7-32fc4ee7b059-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:15:35 devstack sudo[108651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c8da15e3-d5e6-4459-9f36-9cbeb167677c 1073741824 Aug 10 16:15:35 devstack sudo[108651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:35 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-dbed8779-da65-4f18-a7b0-361a522b85ac tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Lock "cinder-d7c32d9c-c443-4d94-a9e7-32fc4ee7b059-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:15:35 devstack sudo[108647]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:35 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-a6bbabd0-c959-466d-978f-e7f2dfccd19e tempest-ProjectReaderTests-1092271699 None] Create snapshot completed successfully Aug 10 16:15:35 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-da900b41-9079-4661-9c9b-a384cdb1957a tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.333s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:35 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-da900b41-9079-4661-9c9b-a384cdb1957a tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:15:35 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-da900b41-9079-4661-9c9b-a384cdb1957a tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Deleted volume successfully. Aug 10 16:15:35 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-da900b41-9079-4661-9c9b-a384cdb1957a tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Lock "cinder-42dc1ba1-4c9d-4665-b283-b950bc76f6cd-delete_volume" released by "delete_volume" :: held 1.352s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:15:35 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-dbed8779-da65-4f18-a7b0-361a522b85ac tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Acquiring lock "cinder-quobyte-d7c32d9c-c443-4d94-a9e7-32fc4ee7b059" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:15:35 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-dbed8779-da65-4f18-a7b0-361a522b85ac tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Lock "cinder-quobyte-d7c32d9c-c443-4d94-a9e7-32fc4ee7b059" acquired by "delete_volume" :: waited 0.016s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:15:35 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[2058da03-c2b3-4b79-8e51-74d64f82717d]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:15:35 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-dbed8779-da65-4f18-a7b0-361a522b85ac tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d7c32d9c-c443-4d94-a9e7-32fc4ee7b059 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:35 devstack sudo[108653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d7c32d9c-c443-4d94-a9e7-32fc4ee7b059 Aug 10 16:15:35 devstack sudo[108653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:36 devstack sudo[108651]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6ccf5a7f-9c90-4847-802d-b5ea1c6b9dde tempest-VolumeImageDependencyTests-339855100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c8da15e3-d5e6-4459-9f36-9cbeb167677c 1073741824" returned: 0 in 0.553s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6ccf5a7f-9c90-4847-802d-b5ea1c6b9dde tempest-VolumeImageDependencyTests-339855100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c8da15e3-d5e6-4459-9f36-9cbeb167677c {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:36 devstack sudo[108662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c8da15e3-d5e6-4459-9f36-9cbeb167677c Aug 10 16:15:36 devstack sudo[108662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:36 devstack sudo[108653]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-dbed8779-da65-4f18-a7b0-361a522b85ac tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d7c32d9c-c443-4d94-a9e7-32fc4ee7b059" returned: 0 in 0.480s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-dbed8779-da65-4f18-a7b0-361a522b85ac tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d7c32d9c-c443-4d94-a9e7-32fc4ee7b059 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:36 devstack sudo[108664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d7c32d9c-c443-4d94-a9e7-32fc4ee7b059 Aug 10 16:15:36 devstack sudo[108664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:36 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-5657581f-0ec9-4355-b71c-1034c24902ba tempest-ProjectReaderTests-1092271699 None] Acquiring lock "cinder-e60f2022-51f8-4a07-b5d6-69c7e556fe68-delete_snapshot" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:15:36 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-5657581f-0ec9-4355-b71c-1034c24902ba tempest-ProjectReaderTests-1092271699 None] Lock "cinder-e60f2022-51f8-4a07-b5d6-69c7e556fe68-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:15:36 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-5657581f-0ec9-4355-b71c-1034c24902ba tempest-ProjectReaderTests-1092271699 None] Acquiring lock "cinder-quobyte-1affae34-aa2f-4dca-bcb8-1c703b015642" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:15:36 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-5657581f-0ec9-4355-b71c-1034c24902ba tempest-ProjectReaderTests-1092271699 None] Lock "cinder-quobyte-1affae34-aa2f-4dca-bcb8-1c703b015642" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:15:36 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-5657581f-0ec9-4355-b71c-1034c24902ba tempest-ProjectReaderTests-1092271699 None] Acquiring lock "cinder-quobyte-e60f2022-51f8-4a07-b5d6-69c7e556fe68" by "_delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:15:36 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-5657581f-0ec9-4355-b71c-1034c24902ba tempest-ProjectReaderTests-1092271699 None] Lock "cinder-quobyte-e60f2022-51f8-4a07-b5d6-69c7e556fe68" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:15:36 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-5657581f-0ec9-4355-b71c-1034c24902ba tempest-ProjectReaderTests-1092271699 None] Deleting offline snapshot e60f2022-51f8-4a07-b5d6-69c7e556fe68 of volume 1affae34-aa2f-4dca-bcb8-1c703b015642 {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 16:15:36 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-5657581f-0ec9-4355-b71c-1034c24902ba tempest-ProjectReaderTests-1092271699 None] snapshot_file for this snap is: volume-1affae34-aa2f-4dca-bcb8-1c703b015642.e60f2022-51f8-4a07-b5d6-69c7e556fe68 {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 16:15:36 devstack cinder-volume[88641]: DEBUG oslo_service.periodic_task [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88641) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 16:15:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:15:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:15:36 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:15:36 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:15:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:15:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:36 devstack sudo[108662]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:36 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[e39c2cfd-51ea-4a31-99e9-882801f382b5]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:15:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5657581f-0ec9-4355-b71c-1034c24902ba tempest-ProjectReaderTests-1092271699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-1affae34-aa2f-4dca-bcb8-1c703b015642.e60f2022-51f8-4a07-b5d6-69c7e556fe68 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:36 devstack sudo[108667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:15:36 devstack sudo[108667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6ccf5a7f-9c90-4847-802d-b5ea1c6b9dde tempest-VolumeImageDependencyTests-339855100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c8da15e3-d5e6-4459-9f36-9cbeb167677c" returned: 0 in 0.363s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:36 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-6ccf5a7f-9c90-4847-802d-b5ea1c6b9dde tempest-VolumeImageDependencyTests-339855100 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:15:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-6ccf5a7f-9c90-4847-802d-b5ea1c6b9dde tempest-VolumeImageDependencyTests-339855100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:15:36 devstack cinder-volume[88641]: DEBUG cinder.volume.volume_utils [None req-6ccf5a7f-9c90-4847-802d-b5ea1c6b9dde tempest-VolumeImageDependencyTests-339855100 None] Attempting download of bf6d8feb-935a-4d7d-b5e9-9a1f666c6930 ((None, [{'url': 'file:///opt/stack/data/glance/images/bf6d8feb-935a-4d7d-b5e9-9a1f666c6930', 'metadata': {}}])) to volume c8da15e3-d5e6-4459-9f36-9cbeb167677c. {{(pid=88641) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 10 16:15:36 devstack sudo[108664]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-dbed8779-da65-4f18-a7b0-361a522b85ac tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d7c32d9c-c443-4d94-a9e7-32fc4ee7b059" returned: 0 in 0.403s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:36 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-dbed8779-da65-4f18-a7b0-361a522b85ac tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Lock "cinder-quobyte-d7c32d9c-c443-4d94-a9e7-32fc4ee7b059" released by "delete_volume" :: held 0.947s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:15:36 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ea503a-15d0-4f01-b4e3-f3431cd09237]: (4, 'raw') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:15:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6ccf5a7f-9c90-4847-802d-b5ea1c6b9dde tempest-VolumeImageDependencyTests-339855100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bf6d8feb-935a-4d7d-b5e9-9a1f666c6930_9y2eqkbo {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:36 devstack sudo[108668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-1affae34-aa2f-4dca-bcb8-1c703b015642.e60f2022-51f8-4a07-b5d6-69c7e556fe68 Aug 10 16:15:36 devstack sudo[108668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:36 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-dbed8779-da65-4f18-a7b0-361a522b85ac tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Created reservations ['fc990a5a-a9a6-45ed-b7a4-f99827cbe8d9', 'a783565f-a9d8-4523-9919-0912b2551cd4', '42577cdb-83b7-47b0-bb45-e3e41a2d4528', '257a3d29-ba51-4411-8d3e-9c7e0488c1c5'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:15:36 devstack sudo[108667]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.370s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:36 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:15:36 devstack cinder-volume[88641]: DEBUG oslo_service.periodic_task [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Running periodic task VolumeManager._thread_info {{(pid=88641) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 16:15:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] thread count: 28 {{(pid=88641) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 10 16:15:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] thread info: [<_MainThread(MainThread, started 127361545748608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88641) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 10 16:15:36 devstack sudo[108671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bf6d8feb-935a-4d7d-b5e9-9a1f666c6930_9y2eqkbo Aug 10 16:15:36 devstack sudo[108671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-dbed8779-da65-4f18-a7b0-361a522b85ac tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:15:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-dbed8779-da65-4f18-a7b0-361a522b85ac tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:15:36 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-dbed8779-da65-4f18-a7b0-361a522b85ac tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:15:36 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-dbed8779-da65-4f18-a7b0-361a522b85ac tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:15:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-dbed8779-da65-4f18-a7b0-361a522b85ac tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:15:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-dbed8779-da65-4f18-a7b0-361a522b85ac tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:37 devstack sudo[108675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:15:37 devstack sudo[108675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:37 devstack sudo[108668]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5657581f-0ec9-4355-b71c-1034c24902ba tempest-ProjectReaderTests-1092271699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-1affae34-aa2f-4dca-bcb8-1c703b015642.e60f2022-51f8-4a07-b5d6-69c7e556fe68" returned: 0 in 0.545s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:37 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-5657581f-0ec9-4355-b71c-1034c24902ba tempest-ProjectReaderTests-1092271699 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1affae34-aa2f-4dca-bcb8-1c703b015642(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 16:15:37 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c6a890c-c78c-46a5-a6de-aeb4fea80e1f]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:15:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5657581f-0ec9-4355-b71c-1034c24902ba tempest-ProjectReaderTests-1092271699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-1affae34-aa2f-4dca-bcb8-1c703b015642 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:37 devstack sudo[108671]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6ccf5a7f-9c90-4847-802d-b5ea1c6b9dde tempest-VolumeImageDependencyTests-339855100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bf6d8feb-935a-4d7d-b5e9-9a1f666c6930_9y2eqkbo" returned: 0 in 0.495s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6ccf5a7f-9c90-4847-802d-b5ea1c6b9dde tempest-VolumeImageDependencyTests-339855100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bf6d8feb-935a-4d7d-b5e9-9a1f666c6930_9y2eqkbo {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:37 devstack sudo[108680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-1affae34-aa2f-4dca-bcb8-1c703b015642 Aug 10 16:15:37 devstack sudo[108680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:37 devstack sudo[108675]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-dbed8779-da65-4f18-a7b0-361a522b85ac tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.352s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:37 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-dbed8779-da65-4f18-a7b0-361a522b85ac tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:15:37 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-dbed8779-da65-4f18-a7b0-361a522b85ac tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Deleted volume successfully. Aug 10 16:15:37 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-dbed8779-da65-4f18-a7b0-361a522b85ac tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Lock "cinder-d7c32d9c-c443-4d94-a9e7-32fc4ee7b059-delete_volume" released by "delete_volume" :: held 1.730s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:15:37 devstack sudo[108684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bf6d8feb-935a-4d7d-b5e9-9a1f666c6930_9y2eqkbo Aug 10 16:15:37 devstack sudo[108684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:37 devstack sudo[108680]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5657581f-0ec9-4355-b71c-1034c24902ba tempest-ProjectReaderTests-1092271699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-1affae34-aa2f-4dca-bcb8-1c703b015642" returned: 0 in 0.566s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5657581f-0ec9-4355-b71c-1034c24902ba tempest-ProjectReaderTests-1092271699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-1affae34-aa2f-4dca-bcb8-1c703b015642.e60f2022-51f8-4a07-b5d6-69c7e556fe68 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:37 devstack sudo[108690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-1affae34-aa2f-4dca-bcb8-1c703b015642.e60f2022-51f8-4a07-b5d6-69c7e556fe68 Aug 10 16:15:37 devstack sudo[108690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:37 devstack sudo[108684]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6ccf5a7f-9c90-4847-802d-b5ea1c6b9dde tempest-VolumeImageDependencyTests-339855100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bf6d8feb-935a-4d7d-b5e9-9a1f666c6930_9y2eqkbo" returned: 1 in 0.594s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6ccf5a7f-9c90-4847-802d-b5ea1c6b9dde tempest-VolumeImageDependencyTests-339855100 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bf6d8feb-935a-4d7d-b5e9-9a1f666c6930_9y2eqkbo' failed. Not Retrying. {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 10 16:15:37 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fbee613-b7b0-4940-88da-3f073a1e67a7]: (4, 'raw') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:15:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6ccf5a7f-9c90-4847-802d-b5ea1c6b9dde tempest-VolumeImageDependencyTests-339855100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bf6d8feb-935a-4d7d-b5e9-9a1f666c6930_dkqklsyidevstack@QuobyteHD {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:37 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-ac9347aa-16ce-4884-8921-e64480cc73f2 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Acquiring lock "cinder-c7aae6e6-d54c-4a5e-ae5f-a03a3066d796-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:15:37 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-ac9347aa-16ce-4884-8921-e64480cc73f2 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Lock "cinder-c7aae6e6-d54c-4a5e-ae5f-a03a3066d796-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:15:38 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-ac9347aa-16ce-4884-8921-e64480cc73f2 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Acquiring lock "cinder-quobyte-c7aae6e6-d54c-4a5e-ae5f-a03a3066d796" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:15:38 devstack sudo[108694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bf6d8feb-935a-4d7d-b5e9-9a1f666c6930_dkqklsyidevstack@QuobyteHD Aug 10 16:15:38 devstack sudo[108694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:38 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-ac9347aa-16ce-4884-8921-e64480cc73f2 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Lock "cinder-quobyte-c7aae6e6-d54c-4a5e-ae5f-a03a3066d796" acquired by "delete_volume" :: waited 0.022s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:15:38 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[a31750ad-a4fd-4e4c-967d-04053cdf8c4e]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:15:38 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ac9347aa-16ce-4884-8921-e64480cc73f2 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c7aae6e6-d54c-4a5e-ae5f-a03a3066d796 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:38 devstack sudo[108690]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:38 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5657581f-0ec9-4355-b71c-1034c24902ba tempest-ProjectReaderTests-1092271699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-1affae34-aa2f-4dca-bcb8-1c703b015642.e60f2022-51f8-4a07-b5d6-69c7e556fe68" returned: 0 in 0.512s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:38 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5657581f-0ec9-4355-b71c-1034c24902ba tempest-ProjectReaderTests-1092271699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-1affae34-aa2f-4dca-bcb8-1c703b015642.e60f2022-51f8-4a07-b5d6-69c7e556fe68 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:38 devstack sudo[108700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-1affae34-aa2f-4dca-bcb8-1c703b015642.e60f2022-51f8-4a07-b5d6-69c7e556fe68 Aug 10 16:15:38 devstack sudo[108700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:38 devstack sudo[108699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c7aae6e6-d54c-4a5e-ae5f-a03a3066d796 Aug 10 16:15:38 devstack sudo[108699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:38 devstack sudo[108694]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:38 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6ccf5a7f-9c90-4847-802d-b5ea1c6b9dde tempest-VolumeImageDependencyTests-339855100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bf6d8feb-935a-4d7d-b5e9-9a1f666c6930_dkqklsyidevstack@QuobyteHD" returned: 0 in 0.498s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:38 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6ccf5a7f-9c90-4847-802d-b5ea1c6b9dde tempest-VolumeImageDependencyTests-339855100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bf6d8feb-935a-4d7d-b5e9-9a1f666c6930_dkqklsyidevstack@QuobyteHD {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:38 devstack sudo[108705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bf6d8feb-935a-4d7d-b5e9-9a1f666c6930_dkqklsyidevstack@QuobyteHD Aug 10 16:15:38 devstack sudo[108705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:38 devstack sudo[108700]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:38 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5657581f-0ec9-4355-b71c-1034c24902ba tempest-ProjectReaderTests-1092271699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-1affae34-aa2f-4dca-bcb8-1c703b015642.e60f2022-51f8-4a07-b5d6-69c7e556fe68" returned: 0 in 0.304s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:38 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-5657581f-0ec9-4355-b71c-1034c24902ba tempest-ProjectReaderTests-1092271699 None] Lock "cinder-quobyte-e60f2022-51f8-4a07-b5d6-69c7e556fe68" released by "_delete_snapshot" :: held 2.084s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:15:38 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-5657581f-0ec9-4355-b71c-1034c24902ba tempest-ProjectReaderTests-1092271699 None] Lock "cinder-quobyte-1affae34-aa2f-4dca-bcb8-1c703b015642" released by "delete_snapshot" :: held 2.116s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:15:38 devstack sudo[108699]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:38 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ac9347aa-16ce-4884-8921-e64480cc73f2 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c7aae6e6-d54c-4a5e-ae5f-a03a3066d796" returned: 0 in 0.516s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:38 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ac9347aa-16ce-4884-8921-e64480cc73f2 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c7aae6e6-d54c-4a5e-ae5f-a03a3066d796 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:38 devstack sudo[108711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c7aae6e6-d54c-4a5e-ae5f-a03a3066d796 Aug 10 16:15:38 devstack sudo[108711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:38 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-5657581f-0ec9-4355-b71c-1034c24902ba tempest-ProjectReaderTests-1092271699 None] Created reservations ['9dd6d19b-d68b-4c9d-9f80-eec2bf3f1d62', '4bae0314-b795-4b58-bd5d-d2b904f568b5', '81d626d8-fef2-4bc7-93eb-7d821090e6f5', '34d1ef54-902d-4fe0-b6d7-144750cc7f87'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:15:38 devstack sudo[108705]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:38 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6ccf5a7f-9c90-4847-802d-b5ea1c6b9dde tempest-VolumeImageDependencyTests-339855100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bf6d8feb-935a-4d7d-b5e9-9a1f666c6930_dkqklsyidevstack@QuobyteHD" returned: 1 in 0.418s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:38 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6ccf5a7f-9c90-4847-802d-b5ea1c6b9dde tempest-VolumeImageDependencyTests-339855100 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bf6d8feb-935a-4d7d-b5e9-9a1f666c6930_dkqklsyidevstack@QuobyteHD' failed. Not Retrying. {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 10 16:15:38 devstack cinder-volume[88641]: DEBUG cinder.image.image_utils [None req-6ccf5a7f-9c90-4847-802d-b5ea1c6b9dde tempest-VolumeImageDependencyTests-339855100 None] bf6d8feb-935a-4d7d-b5e9-9a1f666c6930 was raw, converting to qcow2 {{(pid=88641) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 10 16:15:38 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6ccf5a7f-9c90-4847-802d-b5ea1c6b9dde tempest-VolumeImageDependencyTests-339855100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_bf6d8feb-935a-4d7d-b5e9-9a1f666c6930_dkqklsyidevstack@QuobyteHD /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c8da15e3-d5e6-4459-9f36-9cbeb167677c {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:38 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-5657581f-0ec9-4355-b71c-1034c24902ba tempest-ProjectReaderTests-1092271699 None] Delete snapshot completed successfully. Aug 10 16:15:38 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-5657581f-0ec9-4355-b71c-1034c24902ba tempest-ProjectReaderTests-1092271699 None] Lock "cinder-e60f2022-51f8-4a07-b5d6-69c7e556fe68-delete_snapshot" released by "delete_snapshot" :: held 2.382s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:15:38 devstack sudo[108716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_bf6d8feb-935a-4d7d-b5e9-9a1f666c6930_dkqklsyidevstack@QuobyteHD /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c8da15e3-d5e6-4459-9f36-9cbeb167677c Aug 10 16:15:38 devstack sudo[108716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:38 devstack sudo[108711]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:38 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ac9347aa-16ce-4884-8921-e64480cc73f2 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c7aae6e6-d54c-4a5e-ae5f-a03a3066d796" returned: 0 in 0.349s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:38 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-ac9347aa-16ce-4884-8921-e64480cc73f2 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Lock "cinder-quobyte-c7aae6e6-d54c-4a5e-ae5f-a03a3066d796" released by "delete_volume" :: held 0.927s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:15:39 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-ac9347aa-16ce-4884-8921-e64480cc73f2 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Created reservations ['1c2de55d-227a-4e98-acf9-2064a80c40fb', '83dd2412-048e-49cc-90ad-97c78e643eb9', '7105f191-b020-42c9-8bf5-44a34a1cebda', '40b3eb24-7ca0-403d-807d-bd8ebc2f1ec9'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:15:39 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-ac9347aa-16ce-4884-8921-e64480cc73f2 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:15:39 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-ac9347aa-16ce-4884-8921-e64480cc73f2 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:15:39 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-ac9347aa-16ce-4884-8921-e64480cc73f2 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:15:39 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-ac9347aa-16ce-4884-8921-e64480cc73f2 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:15:39 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-ac9347aa-16ce-4884-8921-e64480cc73f2 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:15:39 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ac9347aa-16ce-4884-8921-e64480cc73f2 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:39 devstack sudo[108722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:15:39 devstack sudo[108722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:39 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-99b7b89b-0b28-4b2e-b7d4-4dd54101d384 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Acquiring lock "cinder-f76d20f0-0ec5-4846-96f4-5b24643e27e7-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:15:39 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-99b7b89b-0b28-4b2e-b7d4-4dd54101d384 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Lock "cinder-f76d20f0-0ec5-4846-96f4-5b24643e27e7-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:15:39 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-99b7b89b-0b28-4b2e-b7d4-4dd54101d384 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Acquiring lock "cinder-quobyte-f76d20f0-0ec5-4846-96f4-5b24643e27e7" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:15:39 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-99b7b89b-0b28-4b2e-b7d4-4dd54101d384 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Lock "cinder-quobyte-f76d20f0-0ec5-4846-96f4-5b24643e27e7" acquired by "delete_volume" :: waited 0.018s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:15:39 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d950843-f20d-4bf2-a8c2-255e09a29275]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:15:39 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-99b7b89b-0b28-4b2e-b7d4-4dd54101d384 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f76d20f0-0ec5-4846-96f4-5b24643e27e7 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:39 devstack sudo[108722]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:39 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ac9347aa-16ce-4884-8921-e64480cc73f2 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.336s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:39 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-ac9347aa-16ce-4884-8921-e64480cc73f2 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:15:39 devstack sudo[108724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f76d20f0-0ec5-4846-96f4-5b24643e27e7 Aug 10 16:15:39 devstack sudo[108716]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:39 devstack sudo[108724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:39 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-ac9347aa-16ce-4884-8921-e64480cc73f2 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Deleted volume successfully. Aug 10 16:15:39 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6ccf5a7f-9c90-4847-802d-b5ea1c6b9dde tempest-VolumeImageDependencyTests-339855100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_bf6d8feb-935a-4d7d-b5e9-9a1f666c6930_dkqklsyidevstack@QuobyteHD /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c8da15e3-d5e6-4459-9f36-9cbeb167677c" returned: 0 in 0.712s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:39 devstack cinder-volume[88641]: DEBUG cinder.image.image_utils [None req-6ccf5a7f-9c90-4847-802d-b5ea1c6b9dde tempest-VolumeImageDependencyTests-339855100 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_bf6d8feb-935a-4d7d-b5e9-9a1f666c6930_dkqklsyidevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c8da15e3-d5e6-4459-9f36-9cbeb167677c {{(pid=88641) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 10 16:15:39 devstack cinder-volume[88641]: INFO cinder.image.image_utils [None req-6ccf5a7f-9c90-4847-802d-b5ea1c6b9dde tempest-VolumeImageDependencyTests-339855100 None] Converted 0.00 MB image at 0.00 MB/s Aug 10 16:15:39 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6ccf5a7f-9c90-4847-802d-b5ea1c6b9dde tempest-VolumeImageDependencyTests-339855100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c8da15e3-d5e6-4459-9f36-9cbeb167677c 1G {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:39 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-ac9347aa-16ce-4884-8921-e64480cc73f2 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Lock "cinder-c7aae6e6-d54c-4a5e-ae5f-a03a3066d796-delete_volume" released by "delete_volume" :: held 1.579s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:15:39 devstack sudo[108727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c8da15e3-d5e6-4459-9f36-9cbeb167677c 1G Aug 10 16:15:39 devstack sudo[108727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:39 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-19152fe5-2999-4af4-a34d-d1bdd4af9c46 tempest-ProjectReaderTests-1092271699 None] Acquiring lock "cinder-1affae34-aa2f-4dca-bcb8-1c703b015642-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:15:39 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-19152fe5-2999-4af4-a34d-d1bdd4af9c46 tempest-ProjectReaderTests-1092271699 None] Lock "cinder-1affae34-aa2f-4dca-bcb8-1c703b015642-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:15:39 devstack sudo[108724]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:39 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-19152fe5-2999-4af4-a34d-d1bdd4af9c46 tempest-ProjectReaderTests-1092271699 None] Acquiring lock "cinder-quobyte-1affae34-aa2f-4dca-bcb8-1c703b015642" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:15:39 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-99b7b89b-0b28-4b2e-b7d4-4dd54101d384 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f76d20f0-0ec5-4846-96f4-5b24643e27e7" returned: 0 in 0.543s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:39 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-99b7b89b-0b28-4b2e-b7d4-4dd54101d384 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f76d20f0-0ec5-4846-96f4-5b24643e27e7 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:39 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-19152fe5-2999-4af4-a34d-d1bdd4af9c46 tempest-ProjectReaderTests-1092271699 None] Lock "cinder-quobyte-1affae34-aa2f-4dca-bcb8-1c703b015642" acquired by "delete_volume" :: waited 0.057s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:15:39 devstack sudo[108735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f76d20f0-0ec5-4846-96f4-5b24643e27e7 Aug 10 16:15:39 devstack sudo[108735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:40 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ddf61c0-f9f1-4845-8134-b16bb30b928e]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:15:40 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-19152fe5-2999-4af4-a34d-d1bdd4af9c46 tempest-ProjectReaderTests-1092271699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-1affae34-aa2f-4dca-bcb8-1c703b015642 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:40 devstack sudo[108727]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:40 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6ccf5a7f-9c90-4847-802d-b5ea1c6b9dde tempest-VolumeImageDependencyTests-339855100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c8da15e3-d5e6-4459-9f36-9cbeb167677c 1G" returned: 0 in 0.600s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:40 devstack cinder-volume[88641]: DEBUG cinder.volume.volume_utils [None req-6ccf5a7f-9c90-4847-802d-b5ea1c6b9dde tempest-VolumeImageDependencyTests-339855100 None] Downloaded image bf6d8feb-935a-4d7d-b5e9-9a1f666c6930 ((None, [{'url': 'file:///opt/stack/data/glance/images/bf6d8feb-935a-4d7d-b5e9-9a1f666c6930', 'metadata': {}}])) to volume c8da15e3-d5e6-4459-9f36-9cbeb167677c successfully. {{(pid=88641) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 10 16:15:40 devstack cinder-volume[88641]: DEBUG cinder.image.image_utils [None req-6ccf5a7f-9c90-4847-802d-b5ea1c6b9dde tempest-VolumeImageDependencyTests-339855100 None] Temporary image bf6d8feb-935a-4d7d-b5e9-9a1f666c6930 for user 71a0c160fa6249ffabc361ad12b0dc09 is deleted. {{(pid=88641) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 10 16:15:40 devstack cinder-volume[88641]: DEBUG cinder.volume.volume_utils [None req-6ccf5a7f-9c90-4847-802d-b5ea1c6b9dde tempest-VolumeImageDependencyTests-339855100 None] Marking volume c8da15e3-d5e6-4459-9f36-9cbeb167677c as bootable. {{(pid=88641) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 10 16:15:40 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ccf5a7f-9c90-4847-802d-b5ea1c6b9dde tempest-VolumeImageDependencyTests-339855100 None] Copying metadata from image bf6d8feb-935a-4d7d-b5e9-9a1f666c6930 to c8da15e3-d5e6-4459-9f36-9cbeb167677c. {{(pid=88641) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 10 16:15:40 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ccf5a7f-9c90-4847-802d-b5ea1c6b9dde tempest-VolumeImageDependencyTests-339855100 None] Creating volume glance metadata for volume c8da15e3-d5e6-4459-9f36-9cbeb167677c backed by image bf6d8feb-935a-4d7d-b5e9-9a1f666c6930 with: {'image_id': 'bf6d8feb-935a-4d7d-b5e9-9a1f666c6930', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '8875b76149fd54f6de3bf95b74d3f010', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88641) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 10 16:15:40 devstack sudo[108738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-1affae34-aa2f-4dca-bcb8-1c703b015642 Aug 10 16:15:40 devstack sudo[108738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:40 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-6ccf5a7f-9c90-4847-802d-b5ea1c6b9dde tempest-VolumeImageDependencyTests-339855100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc6a53d7-68fe-4cd4-9199-c685cc00134e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8da15e3-d5e6-4459-9f36-9cbeb167677c', 'volume_size': 1, 'image_id': 'bf6d8feb-935a-4d7d-b5e9-9a1f666c6930', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bf6d8feb-935a-4d7d-b5e9-9a1f666c6930', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8875b76149fd54f6de3bf95b74d3f010', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3df04838bf9f4aa2bdc90e7947a2e8f6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7bff3c12f2e8bd3da5e994a401f6aab0daf46a78eb57dd35ed0d67f8fb00ce09a2cc71bc22a265f13260b38c1fd44393d4756581c9518f2c7504e69b75c92337', 'id': 'bf6d8feb-935a-4d7d-b5e9-9a1f666c6930', 'created_at': datetime.datetime(2026, 8, 10, 14, 15, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 10, 14, 15, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bf6d8feb-935a-4d7d-b5e9-9a1f666c6930/file', 'properties': {}}, 'image_service': }' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:40 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-6ccf5a7f-9c90-4847-802d-b5ea1c6b9dde tempest-VolumeImageDependencyTests-339855100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (476f2649-32a2-48b2-84bb-d12757643ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:40 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-6ccf5a7f-9c90-4847-802d-b5ea1c6b9dde tempest-VolumeImageDependencyTests-339855100 None] Volume volume-c8da15e3-d5e6-4459-9f36-9cbeb167677c (c8da15e3-d5e6-4459-9f36-9cbeb167677c): created successfully Aug 10 16:15:40 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-6ccf5a7f-9c90-4847-802d-b5ea1c6b9dde tempest-VolumeImageDependencyTests-339855100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (476f2649-32a2-48b2-84bb-d12757643ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:40 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-6ccf5a7f-9c90-4847-802d-b5ea1c6b9dde tempest-VolumeImageDependencyTests-339855100 None] Flow 'volume_create_manager' (b60da916-340f-4492-8036-f3fc225282db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:15:40 devstack sudo[108735]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:40 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-99b7b89b-0b28-4b2e-b7d4-4dd54101d384 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-f76d20f0-0ec5-4846-96f4-5b24643e27e7" returned: 0 in 0.504s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:40 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-6ccf5a7f-9c90-4847-802d-b5ea1c6b9dde tempest-VolumeImageDependencyTests-339855100 None] Created volume successfully. Aug 10 16:15:40 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-99b7b89b-0b28-4b2e-b7d4-4dd54101d384 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Lock "cinder-quobyte-f76d20f0-0ec5-4846-96f4-5b24643e27e7" released by "delete_volume" :: held 1.110s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:15:40 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-99b7b89b-0b28-4b2e-b7d4-4dd54101d384 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Created reservations ['ba8af837-e359-4d63-b08c-e7e290dbe4bb', 'e54553e9-dfe2-47f3-b61f-c3824a576428', 'a49029e3-3586-46ec-8dda-076aae4eae96', 'b08bf628-b3c5-406e-8e96-ec9bd48d1456'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:15:40 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-99b7b89b-0b28-4b2e-b7d4-4dd54101d384 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:15:40 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-99b7b89b-0b28-4b2e-b7d4-4dd54101d384 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:15:40 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-99b7b89b-0b28-4b2e-b7d4-4dd54101d384 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:15:40 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-99b7b89b-0b28-4b2e-b7d4-4dd54101d384 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:15:40 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-99b7b89b-0b28-4b2e-b7d4-4dd54101d384 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:15:40 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-99b7b89b-0b28-4b2e-b7d4-4dd54101d384 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:40 devstack sudo[108738]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:40 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-19152fe5-2999-4af4-a34d-d1bdd4af9c46 tempest-ProjectReaderTests-1092271699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-1affae34-aa2f-4dca-bcb8-1c703b015642" returned: 0 in 0.524s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:40 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-19152fe5-2999-4af4-a34d-d1bdd4af9c46 tempest-ProjectReaderTests-1092271699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-1affae34-aa2f-4dca-bcb8-1c703b015642 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:40 devstack sudo[108745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-1affae34-aa2f-4dca-bcb8-1c703b015642 Aug 10 16:15:40 devstack sudo[108745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:40 devstack sudo[108744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:15:40 devstack sudo[108744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:40 devstack sudo[108745]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:40 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-19152fe5-2999-4af4-a34d-d1bdd4af9c46 tempest-ProjectReaderTests-1092271699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-1affae34-aa2f-4dca-bcb8-1c703b015642" returned: 0 in 0.304s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:40 devstack sudo[108744]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:40 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-99b7b89b-0b28-4b2e-b7d4-4dd54101d384 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.345s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:40 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-99b7b89b-0b28-4b2e-b7d4-4dd54101d384 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:15:40 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-19152fe5-2999-4af4-a34d-d1bdd4af9c46 tempest-ProjectReaderTests-1092271699 None] Lock "cinder-quobyte-1affae34-aa2f-4dca-bcb8-1c703b015642" released by "delete_volume" :: held 0.986s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:15:40 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-99b7b89b-0b28-4b2e-b7d4-4dd54101d384 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Deleted volume successfully. Aug 10 16:15:40 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-99b7b89b-0b28-4b2e-b7d4-4dd54101d384 tempest-CreateVolumesFromSourceVolumeTest-2030570990 None] Lock "cinder-f76d20f0-0ec5-4846-96f4-5b24643e27e7-delete_volume" released by "delete_volume" :: held 1.745s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:15:40 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-861e8f72-3efc-45cf-9c9f-f19ef755fc89 tempest-VolumeImageDependencyTests-339855100 None] Acquiring lock "cinder-c8da15e3-d5e6-4459-9f36-9cbeb167677c-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:15:41 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-861e8f72-3efc-45cf-9c9f-f19ef755fc89 tempest-VolumeImageDependencyTests-339855100 None] Lock "cinder-c8da15e3-d5e6-4459-9f36-9cbeb167677c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:15:41 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-19152fe5-2999-4af4-a34d-d1bdd4af9c46 tempest-ProjectReaderTests-1092271699 None] Created reservations ['2706bf00-25aa-45ec-b792-c0ecb777daa8', '6780b73c-fdc9-4443-8f6f-6011d99d1c1d', 'ad831efe-3e93-4a46-9f10-d67bebc5eea7', '45c061d3-0c1b-468a-9d28-25139a8e4bf7'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:15:41 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-861e8f72-3efc-45cf-9c9f-f19ef755fc89 tempest-VolumeImageDependencyTests-339855100 None] Acquiring lock "cinder-quobyte-c8da15e3-d5e6-4459-9f36-9cbeb167677c" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:15:41 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-861e8f72-3efc-45cf-9c9f-f19ef755fc89 tempest-VolumeImageDependencyTests-339855100 None] Lock "cinder-quobyte-c8da15e3-d5e6-4459-9f36-9cbeb167677c" acquired by "delete_volume" :: waited 0.021s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:15:41 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d4c5f6-b904-4021-aa5e-38ddacda8205]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:15:41 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-861e8f72-3efc-45cf-9c9f-f19ef755fc89 tempest-VolumeImageDependencyTests-339855100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c8da15e3-d5e6-4459-9f36-9cbeb167677c {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:41 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-19152fe5-2999-4af4-a34d-d1bdd4af9c46 tempest-ProjectReaderTests-1092271699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:15:41 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-19152fe5-2999-4af4-a34d-d1bdd4af9c46 tempest-ProjectReaderTests-1092271699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:15:41 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-19152fe5-2999-4af4-a34d-d1bdd4af9c46 tempest-ProjectReaderTests-1092271699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:15:41 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-19152fe5-2999-4af4-a34d-d1bdd4af9c46 tempest-ProjectReaderTests-1092271699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:15:41 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-19152fe5-2999-4af4-a34d-d1bdd4af9c46 tempest-ProjectReaderTests-1092271699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:15:41 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-19152fe5-2999-4af4-a34d-d1bdd4af9c46 tempest-ProjectReaderTests-1092271699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:41 devstack sudo[108751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:15:41 devstack sudo[108751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:41 devstack sudo[108750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c8da15e3-d5e6-4459-9f36-9cbeb167677c Aug 10 16:15:41 devstack sudo[108750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:41 devstack sudo[108751]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:41 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-19152fe5-2999-4af4-a34d-d1bdd4af9c46 tempest-ProjectReaderTests-1092271699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.272s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:41 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-19152fe5-2999-4af4-a34d-d1bdd4af9c46 tempest-ProjectReaderTests-1092271699 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:15:41 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-19152fe5-2999-4af4-a34d-d1bdd4af9c46 tempest-ProjectReaderTests-1092271699 None] Deleted volume successfully. Aug 10 16:15:41 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-19152fe5-2999-4af4-a34d-d1bdd4af9c46 tempest-ProjectReaderTests-1092271699 None] Lock "cinder-1affae34-aa2f-4dca-bcb8-1c703b015642-delete_volume" released by "delete_volume" :: held 1.734s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:15:41 devstack sudo[108750]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:41 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-861e8f72-3efc-45cf-9c9f-f19ef755fc89 tempest-VolumeImageDependencyTests-339855100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c8da15e3-d5e6-4459-9f36-9cbeb167677c" returned: 0 in 0.442s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:41 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-861e8f72-3efc-45cf-9c9f-f19ef755fc89 tempest-VolumeImageDependencyTests-339855100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c8da15e3-d5e6-4459-9f36-9cbeb167677c {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:41 devstack sudo[108758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c8da15e3-d5e6-4459-9f36-9cbeb167677c Aug 10 16:15:41 devstack sudo[108758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:41 devstack sudo[108758]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:41 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-861e8f72-3efc-45cf-9c9f-f19ef755fc89 tempest-VolumeImageDependencyTests-339855100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-c8da15e3-d5e6-4459-9f36-9cbeb167677c" returned: 0 in 0.267s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:41 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-861e8f72-3efc-45cf-9c9f-f19ef755fc89 tempest-VolumeImageDependencyTests-339855100 None] Lock "cinder-quobyte-c8da15e3-d5e6-4459-9f36-9cbeb167677c" released by "delete_volume" :: held 0.763s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:15:41 devstack cinder-volume[88641]: DEBUG dbcounter [-] [88641] Writing DB stats cinder:SELECT=233,cinder:UPDATE=320,cinder:INSERT=80,cinder:DELETE=22 {{(pid=88641) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 16:15:41 devstack cinder-volume[88641]: DEBUG dbcounter [-] [88641] Writing DB stats cinder:UPDATE=322,cinder:SELECT=230,cinder:DELETE=35,cinder:INSERT=90 {{(pid=88641) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 16:15:41 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-861e8f72-3efc-45cf-9c9f-f19ef755fc89 tempest-VolumeImageDependencyTests-339855100 None] Created reservations ['91ce6504-6aad-4777-8054-c02d46c25cbf', '3edb6649-9896-4f18-b8f5-ba41e6736134', 'b372c2bf-0a21-483d-ac8a-2501529412d5', '4933aa0b-f3a5-4aad-8806-24f7cad26928'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:15:42 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-861e8f72-3efc-45cf-9c9f-f19ef755fc89 tempest-VolumeImageDependencyTests-339855100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:15:42 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-861e8f72-3efc-45cf-9c9f-f19ef755fc89 tempest-VolumeImageDependencyTests-339855100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:15:42 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-861e8f72-3efc-45cf-9c9f-f19ef755fc89 tempest-VolumeImageDependencyTests-339855100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:15:42 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-861e8f72-3efc-45cf-9c9f-f19ef755fc89 tempest-VolumeImageDependencyTests-339855100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:15:42 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-861e8f72-3efc-45cf-9c9f-f19ef755fc89 tempest-VolumeImageDependencyTests-339855100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:15:42 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-861e8f72-3efc-45cf-9c9f-f19ef755fc89 tempest-VolumeImageDependencyTests-339855100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:42 devstack sudo[108761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:15:42 devstack sudo[108761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:42 devstack sudo[108761]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:42 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-861e8f72-3efc-45cf-9c9f-f19ef755fc89 tempest-VolumeImageDependencyTests-339855100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.468s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:42 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-861e8f72-3efc-45cf-9c9f-f19ef755fc89 tempest-VolumeImageDependencyTests-339855100 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:15:42 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-861e8f72-3efc-45cf-9c9f-f19ef755fc89 tempest-VolumeImageDependencyTests-339855100 None] Deleted volume successfully. Aug 10 16:15:42 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-861e8f72-3efc-45cf-9c9f-f19ef755fc89 tempest-VolumeImageDependencyTests-339855100 None] Lock "cinder-c8da15e3-d5e6-4459-9f36-9cbeb167677c-delete_volume" released by "delete_volume" :: held 1.667s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:15:42 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc690926-de44-4774-8e2d-8bd4bc4f5dd1 tempest-ProjectReaderTests-1092271699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:15:42 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-fc690926-de44-4774-8e2d-8bd4bc4f5dd1 tempest-ProjectReaderTests-1092271699 None] Flow 'volume_create_manager' (a4aa0350-8207-4d1b-92b9-3830ddd76f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:15:42 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-fc690926-de44-4774-8e2d-8bd4bc4f5dd1 tempest-ProjectReaderTests-1092271699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2caaef22-4fc5-4051-90a1-93b86ccee7f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:42 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-fc690926-de44-4774-8e2d-8bd4bc4f5dd1 tempest-ProjectReaderTests-1092271699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2caaef22-4fc5-4051-90a1-93b86ccee7f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:15:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1421047226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6af1de3d-f80d-4f40-9445-5ebe11f8a5d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8da6b8cdad34ff69416120b23e9a25c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:15:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:15:43Z,use_quota=True,user_id='4e50367bdb2c40639a24a8a70eaa2b15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:42 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-fc690926-de44-4774-8e2d-8bd4bc4f5dd1 tempest-ProjectReaderTests-1092271699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17c572d9-5c2e-417c-9a9a-02da420de699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:42 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-fc690926-de44-4774-8e2d-8bd4bc4f5dd1 tempest-ProjectReaderTests-1092271699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17c572d9-5c2e-417c-9a9a-02da420de699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:42 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-fc690926-de44-4774-8e2d-8bd4bc4f5dd1 tempest-ProjectReaderTests-1092271699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdad1bab-c7d3-486f-97f5-15aa3b3c4cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:42 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-fc690926-de44-4774-8e2d-8bd4bc4f5dd1 tempest-ProjectReaderTests-1092271699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdad1bab-c7d3-486f-97f5-15aa3b3c4cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6af1de3d-f80d-4f40-9445-5ebe11f8a5d1', 'volume_name': 'volume-6af1de3d-f80d-4f40-9445-5ebe11f8a5d1', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:42 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-fc690926-de44-4774-8e2d-8bd4bc4f5dd1 tempest-ProjectReaderTests-1092271699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b9f3d62-c654-4823-8eea-c572d33f902d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:42 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-fc690926-de44-4774-8e2d-8bd4bc4f5dd1 tempest-ProjectReaderTests-1092271699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b9f3d62-c654-4823-8eea-c572d33f902d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:42 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-fc690926-de44-4774-8e2d-8bd4bc4f5dd1 tempest-ProjectReaderTests-1092271699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7d0f6cb-d068-44ba-b8f7-ef1a64f6fef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:42 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-fc690926-de44-4774-8e2d-8bd4bc4f5dd1 tempest-ProjectReaderTests-1092271699 None] Volume 6af1de3d-f80d-4f40-9445-5ebe11f8a5d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6af1de3d-f80d-4f40-9445-5ebe11f8a5d1', 'volume_size': 1} Aug 10 16:15:42 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-fc690926-de44-4774-8e2d-8bd4bc4f5dd1 tempest-ProjectReaderTests-1092271699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:15:42 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-fc690926-de44-4774-8e2d-8bd4bc4f5dd1 tempest-ProjectReaderTests-1092271699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:15:42 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-fc690926-de44-4774-8e2d-8bd4bc4f5dd1 tempest-ProjectReaderTests-1092271699 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:15:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1421047226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6af1de3d-f80d-4f40-9445-5ebe11f8a5d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8da6b8cdad34ff69416120b23e9a25c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:15:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:15:43Z,use_quota=True,user_id='4e50367bdb2c40639a24a8a70eaa2b15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:15:42 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-fc690926-de44-4774-8e2d-8bd4bc4f5dd1 tempest-ProjectReaderTests-1092271699 None] Creating volume 6af1de3d-f80d-4f40-9445-5ebe11f8a5d1 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:15:42 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-fc690926-de44-4774-8e2d-8bd4bc4f5dd1 tempest-ProjectReaderTests-1092271699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:15:42 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-fc690926-de44-4774-8e2d-8bd4bc4f5dd1 tempest-ProjectReaderTests-1092271699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:15:42 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-fc690926-de44-4774-8e2d-8bd4bc4f5dd1 tempest-ProjectReaderTests-1092271699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:15:42 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-fc690926-de44-4774-8e2d-8bd4bc4f5dd1 tempest-ProjectReaderTests-1092271699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:15:42 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-fc690926-de44-4774-8e2d-8bd4bc4f5dd1 tempest-ProjectReaderTests-1092271699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:15:42 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-fc690926-de44-4774-8e2d-8bd4bc4f5dd1 tempest-ProjectReaderTests-1092271699 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:15:42 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-fc690926-de44-4774-8e2d-8bd4bc4f5dd1 tempest-ProjectReaderTests-1092271699 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:15:43 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fc690926-de44-4774-8e2d-8bd4bc4f5dd1 tempest-ProjectReaderTests-1092271699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6af1de3d-f80d-4f40-9445-5ebe11f8a5d1 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:43 devstack sudo[108765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6af1de3d-f80d-4f40-9445-5ebe11f8a5d1 1073741824 Aug 10 16:15:43 devstack sudo[108765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:43 devstack sudo[108765]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:43 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fc690926-de44-4774-8e2d-8bd4bc4f5dd1 tempest-ProjectReaderTests-1092271699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6af1de3d-f80d-4f40-9445-5ebe11f8a5d1 1073741824" returned: 0 in 0.645s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:43 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fc690926-de44-4774-8e2d-8bd4bc4f5dd1 tempest-ProjectReaderTests-1092271699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6af1de3d-f80d-4f40-9445-5ebe11f8a5d1 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:43 devstack sudo[108771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6af1de3d-f80d-4f40-9445-5ebe11f8a5d1 Aug 10 16:15:43 devstack sudo[108771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:44 devstack sudo[108771]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:44 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fc690926-de44-4774-8e2d-8bd4bc4f5dd1 tempest-ProjectReaderTests-1092271699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6af1de3d-f80d-4f40-9445-5ebe11f8a5d1" returned: 0 in 0.355s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:44 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-fc690926-de44-4774-8e2d-8bd4bc4f5dd1 tempest-ProjectReaderTests-1092271699 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:15:44 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-fc690926-de44-4774-8e2d-8bd4bc4f5dd1 tempest-ProjectReaderTests-1092271699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:15:44 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-fc690926-de44-4774-8e2d-8bd4bc4f5dd1 tempest-ProjectReaderTests-1092271699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7d0f6cb-d068-44ba-b8f7-ef1a64f6fef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6af1de3d-f80d-4f40-9445-5ebe11f8a5d1', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:44 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-fc690926-de44-4774-8e2d-8bd4bc4f5dd1 tempest-ProjectReaderTests-1092271699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e09fa2d6-4baf-435e-b9fa-e7e451850f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:44 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-fc690926-de44-4774-8e2d-8bd4bc4f5dd1 tempest-ProjectReaderTests-1092271699 None] Volume volume-6af1de3d-f80d-4f40-9445-5ebe11f8a5d1 (6af1de3d-f80d-4f40-9445-5ebe11f8a5d1): created successfully Aug 10 16:15:44 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-fc690926-de44-4774-8e2d-8bd4bc4f5dd1 tempest-ProjectReaderTests-1092271699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e09fa2d6-4baf-435e-b9fa-e7e451850f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:44 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-fc690926-de44-4774-8e2d-8bd4bc4f5dd1 tempest-ProjectReaderTests-1092271699 None] Flow 'volume_create_manager' (a4aa0350-8207-4d1b-92b9-3830ddd76f70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:15:44 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-fc690926-de44-4774-8e2d-8bd4bc4f5dd1 tempest-ProjectReaderTests-1092271699 None] Created volume successfully. Aug 10 16:15:45 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-13715fb7-a288-4a48-9cd5-ae4ad1e51acf tempest-ProjectReaderTests-1092271699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:15:45 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-13715fb7-a288-4a48-9cd5-ae4ad1e51acf tempest-ProjectReaderTests-1092271699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:15:45 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-13715fb7-a288-4a48-9cd5-ae4ad1e51acf tempest-ProjectReaderTests-1092271699 None] Creating offline snapshot b0dd42a8-c062-4e26-ab90-9adc2fbc4ece of volume 6af1de3d-f80d-4f40-9445-5ebe11f8a5d1 {{(pid=88641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 16:15:45 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4e82c75-f1f9-4f31-8a89-109459080819 tempest-CinderUnicodeTest-1100710175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:15:45 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-e4e82c75-f1f9-4f31-8a89-109459080819 tempest-CinderUnicodeTest-1100710175 None] Flow 'volume_create_manager' (a7cd65e2-46b1-491a-bb1c-a4bfe251a938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:15:45 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-e4e82c75-f1f9-4f31-8a89-109459080819 tempest-CinderUnicodeTest-1100710175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce3515b5-3b9f-41da-bff8-1df5d3117432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:45 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[244f7e09-2ae5-4e50-801e-9a43cbfcdb62]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:15:45 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-13715fb7-a288-4a48-9cd5-ae4ad1e51acf tempest-ProjectReaderTests-1092271699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6af1de3d-f80d-4f40-9445-5ebe11f8a5d1 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:45 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-e4e82c75-f1f9-4f31-8a89-109459080819 tempest-CinderUnicodeTest-1100710175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce3515b5-3b9f-41da-bff8-1df5d3117432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:15:45Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8af5d2d6-df92-4b4e-8f69-4002447e618e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e852059e5fde46879bcf3b08b884db13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:15:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:15:46Z,use_quota=True,user_id='f0ab5608484e4f299cc87e26ad70023c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:45 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-e4e82c75-f1f9-4f31-8a89-109459080819 tempest-CinderUnicodeTest-1100710175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38bab6b5-c1b5-44f8-9db1-4c5b81e52d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:45 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-e4e82c75-f1f9-4f31-8a89-109459080819 tempest-CinderUnicodeTest-1100710175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38bab6b5-c1b5-44f8-9db1-4c5b81e52d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:45 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-e4e82c75-f1f9-4f31-8a89-109459080819 tempest-CinderUnicodeTest-1100710175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (386e8c7b-89be-470d-a7bf-1016efc8308c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:45 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-e4e82c75-f1f9-4f31-8a89-109459080819 tempest-CinderUnicodeTest-1100710175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (386e8c7b-89be-470d-a7bf-1016efc8308c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8af5d2d6-df92-4b4e-8f69-4002447e618e', 'volume_name': 'volume-8af5d2d6-df92-4b4e-8f69-4002447e618e', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:45 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-e4e82c75-f1f9-4f31-8a89-109459080819 tempest-CinderUnicodeTest-1100710175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74d3d86b-48f8-4817-a547-cfa782085bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:45 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-e4e82c75-f1f9-4f31-8a89-109459080819 tempest-CinderUnicodeTest-1100710175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74d3d86b-48f8-4817-a547-cfa782085bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:45 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-e4e82c75-f1f9-4f31-8a89-109459080819 tempest-CinderUnicodeTest-1100710175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c06552c-3fc9-4eab-86ec-8fb921af421d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:45 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-e4e82c75-f1f9-4f31-8a89-109459080819 tempest-CinderUnicodeTest-1100710175 None] Volume 8af5d2d6-df92-4b4e-8f69-4002447e618e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8af5d2d6-df92-4b4e-8f69-4002447e618e', 'volume_size': 1} Aug 10 16:15:45 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-e4e82c75-f1f9-4f31-8a89-109459080819 tempest-CinderUnicodeTest-1100710175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:15:45 devstack sudo[108774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6af1de3d-f80d-4f40-9445-5ebe11f8a5d1 Aug 10 16:15:46 devstack sudo[108774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:46 devstack sudo[108774]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:46 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-13715fb7-a288-4a48-9cd5-ae4ad1e51acf tempest-ProjectReaderTests-1092271699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6af1de3d-f80d-4f40-9445-5ebe11f8a5d1" returned: 0 in 0.431s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:46 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-13715fb7-a288-4a48-9cd5-ae4ad1e51acf tempest-ProjectReaderTests-1092271699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6af1de3d-f80d-4f40-9445-5ebe11f8a5d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6af1de3d-f80d-4f40-9445-5ebe11f8a5d1.b0dd42a8-c062-4e26-ab90-9adc2fbc4ece 1G {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:46 devstack sudo[108779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6af1de3d-f80d-4f40-9445-5ebe11f8a5d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6af1de3d-f80d-4f40-9445-5ebe11f8a5d1.b0dd42a8-c062-4e26-ab90-9adc2fbc4ece 1G Aug 10 16:15:46 devstack sudo[108779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:46 devstack sudo[108779]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:46 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-13715fb7-a288-4a48-9cd5-ae4ad1e51acf tempest-ProjectReaderTests-1092271699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6af1de3d-f80d-4f40-9445-5ebe11f8a5d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6af1de3d-f80d-4f40-9445-5ebe11f8a5d1.b0dd42a8-c062-4e26-ab90-9adc2fbc4ece 1G" returned: 0 in 0.513s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:46 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-13715fb7-a288-4a48-9cd5-ae4ad1e51acf tempest-ProjectReaderTests-1092271699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6af1de3d-f80d-4f40-9445-5ebe11f8a5d1 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6af1de3d-f80d-4f40-9445-5ebe11f8a5d1.b0dd42a8-c062-4e26-ab90-9adc2fbc4ece {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:46 devstack sudo[108785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6af1de3d-f80d-4f40-9445-5ebe11f8a5d1 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6af1de3d-f80d-4f40-9445-5ebe11f8a5d1.b0dd42a8-c062-4e26-ab90-9adc2fbc4ece Aug 10 16:15:46 devstack sudo[108785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:47 devstack sudo[108785]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:47 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-13715fb7-a288-4a48-9cd5-ae4ad1e51acf tempest-ProjectReaderTests-1092271699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6af1de3d-f80d-4f40-9445-5ebe11f8a5d1 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6af1de3d-f80d-4f40-9445-5ebe11f8a5d1.b0dd42a8-c062-4e26-ab90-9adc2fbc4ece" returned: 0 in 0.358s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:47 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-13715fb7-a288-4a48-9cd5-ae4ad1e51acf tempest-ProjectReaderTests-1092271699 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6af1de3d-f80d-4f40-9445-5ebe11f8a5d1.b0dd42a8-c062-4e26-ab90-9adc2fbc4ece is being set with open permissions: ugo+rw Aug 10 16:15:47 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-13715fb7-a288-4a48-9cd5-ae4ad1e51acf tempest-ProjectReaderTests-1092271699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6af1de3d-f80d-4f40-9445-5ebe11f8a5d1.b0dd42a8-c062-4e26-ab90-9adc2fbc4ece {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:47 devstack sudo[108791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6af1de3d-f80d-4f40-9445-5ebe11f8a5d1.b0dd42a8-c062-4e26-ab90-9adc2fbc4ece Aug 10 16:15:47 devstack sudo[108791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:47 devstack sudo[108791]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:47 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-13715fb7-a288-4a48-9cd5-ae4ad1e51acf tempest-ProjectReaderTests-1092271699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6af1de3d-f80d-4f40-9445-5ebe11f8a5d1.b0dd42a8-c062-4e26-ab90-9adc2fbc4ece" returned: 0 in 0.284s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:47 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-13715fb7-a288-4a48-9cd5-ae4ad1e51acf tempest-ProjectReaderTests-1092271699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6af1de3d-f80d-4f40-9445-5ebe11f8a5d1.info {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:47 devstack sudo[108794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6af1de3d-f80d-4f40-9445-5ebe11f8a5d1.info Aug 10 16:15:47 devstack sudo[108794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:47 devstack sudo[108794]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:47 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-13715fb7-a288-4a48-9cd5-ae4ad1e51acf tempest-ProjectReaderTests-1092271699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6af1de3d-f80d-4f40-9445-5ebe11f8a5d1.info" returned: 0 in 0.294s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:47 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-13715fb7-a288-4a48-9cd5-ae4ad1e51acf tempest-ProjectReaderTests-1092271699 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6af1de3d-f80d-4f40-9445-5ebe11f8a5d1.info is being set with open permissions: ugo+rw Aug 10 16:15:47 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-13715fb7-a288-4a48-9cd5-ae4ad1e51acf tempest-ProjectReaderTests-1092271699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6af1de3d-f80d-4f40-9445-5ebe11f8a5d1.info {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:47 devstack sudo[108797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6af1de3d-f80d-4f40-9445-5ebe11f8a5d1.info Aug 10 16:15:47 devstack sudo[108797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:47 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-beb899cc-e374-4957-86c1-547ca89745eb tempest-ProjectAdminTests-1093550114 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7576522827148, 'free_capacity_gb': 1775.7576522827148, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88641) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 10 16:15:48 devstack sudo[108797]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:48 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-13715fb7-a288-4a48-9cd5-ae4ad1e51acf tempest-ProjectReaderTests-1092271699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6af1de3d-f80d-4f40-9445-5ebe11f8a5d1.info" returned: 0 in 0.329s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:48 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-13715fb7-a288-4a48-9cd5-ae4ad1e51acf tempest-ProjectReaderTests-1092271699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.349s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:15:48 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-e4e82c75-f1f9-4f31-8a89-109459080819 tempest-CinderUnicodeTest-1100710175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.186s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:15:48 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-e4e82c75-f1f9-4f31-8a89-109459080819 tempest-CinderUnicodeTest-1100710175 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:15:45Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8af5d2d6-df92-4b4e-8f69-4002447e618e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e852059e5fde46879bcf3b08b884db13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:15:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:15:46Z,use_quota=True,user_id='f0ab5608484e4f299cc87e26ad70023c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:15:48 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-e4e82c75-f1f9-4f31-8a89-109459080819 tempest-CinderUnicodeTest-1100710175 None] Creating volume 8af5d2d6-df92-4b4e-8f69-4002447e618e {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:15:48 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-e4e82c75-f1f9-4f31-8a89-109459080819 tempest-CinderUnicodeTest-1100710175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:15:48 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-e4e82c75-f1f9-4f31-8a89-109459080819 tempest-CinderUnicodeTest-1100710175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:15:48 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-e4e82c75-f1f9-4f31-8a89-109459080819 tempest-CinderUnicodeTest-1100710175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:15:48 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-e4e82c75-f1f9-4f31-8a89-109459080819 tempest-CinderUnicodeTest-1100710175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:15:48 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-e4e82c75-f1f9-4f31-8a89-109459080819 tempest-CinderUnicodeTest-1100710175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:15:48 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-e4e82c75-f1f9-4f31-8a89-109459080819 tempest-CinderUnicodeTest-1100710175 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:15:48 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-e4e82c75-f1f9-4f31-8a89-109459080819 tempest-CinderUnicodeTest-1100710175 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:15:48 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e4e82c75-f1f9-4f31-8a89-109459080819 tempest-CinderUnicodeTest-1100710175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-8af5d2d6-df92-4b4e-8f69-4002447e618e 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:48 devstack sudo[108800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-8af5d2d6-df92-4b4e-8f69-4002447e618e 1073741824 Aug 10 16:15:48 devstack sudo[108800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:48 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-13715fb7-a288-4a48-9cd5-ae4ad1e51acf tempest-ProjectReaderTests-1092271699 None] Create snapshot completed successfully Aug 10 16:15:48 devstack sudo[108800]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:48 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e4e82c75-f1f9-4f31-8a89-109459080819 tempest-CinderUnicodeTest-1100710175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-8af5d2d6-df92-4b4e-8f69-4002447e618e 1073741824" returned: 0 in 0.509s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:48 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e4e82c75-f1f9-4f31-8a89-109459080819 tempest-CinderUnicodeTest-1100710175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-8af5d2d6-df92-4b4e-8f69-4002447e618e {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:48 devstack sudo[108806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-8af5d2d6-df92-4b4e-8f69-4002447e618e Aug 10 16:15:48 devstack sudo[108806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:48 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-1e8bb103-8203-43c4-82f4-dcbd8615c937 tempest-ProjectReaderTests-1092271699 None] Acquiring lock "cinder-b0dd42a8-c062-4e26-ab90-9adc2fbc4ece-delete_snapshot" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:15:49 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-1e8bb103-8203-43c4-82f4-dcbd8615c937 tempest-ProjectReaderTests-1092271699 None] Lock "cinder-b0dd42a8-c062-4e26-ab90-9adc2fbc4ece-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:15:49 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-1e8bb103-8203-43c4-82f4-dcbd8615c937 tempest-ProjectReaderTests-1092271699 None] Acquiring lock "cinder-quobyte-6af1de3d-f80d-4f40-9445-5ebe11f8a5d1" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:15:49 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-1e8bb103-8203-43c4-82f4-dcbd8615c937 tempest-ProjectReaderTests-1092271699 None] Lock "cinder-quobyte-6af1de3d-f80d-4f40-9445-5ebe11f8a5d1" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:15:49 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-1e8bb103-8203-43c4-82f4-dcbd8615c937 tempest-ProjectReaderTests-1092271699 None] Acquiring lock "cinder-quobyte-b0dd42a8-c062-4e26-ab90-9adc2fbc4ece" by "_delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:15:49 devstack sudo[108806]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:49 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-1e8bb103-8203-43c4-82f4-dcbd8615c937 tempest-ProjectReaderTests-1092271699 None] Lock "cinder-quobyte-b0dd42a8-c062-4e26-ab90-9adc2fbc4ece" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:15:49 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-1e8bb103-8203-43c4-82f4-dcbd8615c937 tempest-ProjectReaderTests-1092271699 None] Deleting offline snapshot b0dd42a8-c062-4e26-ab90-9adc2fbc4ece of volume 6af1de3d-f80d-4f40-9445-5ebe11f8a5d1 {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 16:15:49 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-1e8bb103-8203-43c4-82f4-dcbd8615c937 tempest-ProjectReaderTests-1092271699 None] snapshot_file for this snap is: volume-6af1de3d-f80d-4f40-9445-5ebe11f8a5d1.b0dd42a8-c062-4e26-ab90-9adc2fbc4ece {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 16:15:49 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e4e82c75-f1f9-4f31-8a89-109459080819 tempest-CinderUnicodeTest-1100710175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-8af5d2d6-df92-4b4e-8f69-4002447e618e" returned: 0 in 0.394s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:49 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-e4e82c75-f1f9-4f31-8a89-109459080819 tempest-CinderUnicodeTest-1100710175 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:15:49 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-e4e82c75-f1f9-4f31-8a89-109459080819 tempest-CinderUnicodeTest-1100710175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:15:49 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[9440cf5f-be69-4010-af53-6bfe6597a5a9]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:15:49 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-e4e82c75-f1f9-4f31-8a89-109459080819 tempest-CinderUnicodeTest-1100710175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c06552c-3fc9-4eab-86ec-8fb921af421d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8af5d2d6-df92-4b4e-8f69-4002447e618e', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:49 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-e4e82c75-f1f9-4f31-8a89-109459080819 tempest-CinderUnicodeTest-1100710175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10735610-6051-4b67-aa98-5665b9d04d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:49 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-1e8bb103-8203-43c4-82f4-dcbd8615c937 tempest-ProjectReaderTests-1092271699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6af1de3d-f80d-4f40-9445-5ebe11f8a5d1.b0dd42a8-c062-4e26-ab90-9adc2fbc4ece {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:49 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-e4e82c75-f1f9-4f31-8a89-109459080819 tempest-CinderUnicodeTest-1100710175 None] Volume volume-8af5d2d6-df92-4b4e-8f69-4002447e618e (8af5d2d6-df92-4b4e-8f69-4002447e618e): created successfully Aug 10 16:15:49 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-e4e82c75-f1f9-4f31-8a89-109459080819 tempest-CinderUnicodeTest-1100710175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10735610-6051-4b67-aa98-5665b9d04d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:49 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-e4e82c75-f1f9-4f31-8a89-109459080819 tempest-CinderUnicodeTest-1100710175 None] Flow 'volume_create_manager' (a7cd65e2-46b1-491a-bb1c-a4bfe251a938) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:15:49 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-e4e82c75-f1f9-4f31-8a89-109459080819 tempest-CinderUnicodeTest-1100710175 None] Created volume successfully. Aug 10 16:15:49 devstack sudo[108809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6af1de3d-f80d-4f40-9445-5ebe11f8a5d1.b0dd42a8-c062-4e26-ab90-9adc2fbc4ece Aug 10 16:15:49 devstack sudo[108809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:49 devstack sudo[108809]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:49 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-1e8bb103-8203-43c4-82f4-dcbd8615c937 tempest-ProjectReaderTests-1092271699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6af1de3d-f80d-4f40-9445-5ebe11f8a5d1.b0dd42a8-c062-4e26-ab90-9adc2fbc4ece" returned: 0 in 0.452s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:49 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-1e8bb103-8203-43c4-82f4-dcbd8615c937 tempest-ProjectReaderTests-1092271699 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6af1de3d-f80d-4f40-9445-5ebe11f8a5d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 16:15:49 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[a600d859-25e9-4e71-89f3-f64103bbe97a]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:15:49 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-1e8bb103-8203-43c4-82f4-dcbd8615c937 tempest-ProjectReaderTests-1092271699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6af1de3d-f80d-4f40-9445-5ebe11f8a5d1 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:49 devstack sudo[108814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6af1de3d-f80d-4f40-9445-5ebe11f8a5d1 Aug 10 16:15:49 devstack sudo[108814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:50 devstack sudo[108814]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-1e8bb103-8203-43c4-82f4-dcbd8615c937 tempest-ProjectReaderTests-1092271699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6af1de3d-f80d-4f40-9445-5ebe11f8a5d1" returned: 0 in 0.469s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-1e8bb103-8203-43c4-82f4-dcbd8615c937 tempest-ProjectReaderTests-1092271699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6af1de3d-f80d-4f40-9445-5ebe11f8a5d1.b0dd42a8-c062-4e26-ab90-9adc2fbc4ece {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:50 devstack sudo[108819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6af1de3d-f80d-4f40-9445-5ebe11f8a5d1.b0dd42a8-c062-4e26-ab90-9adc2fbc4ece Aug 10 16:15:50 devstack sudo[108819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:50 devstack sudo[108819]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-1e8bb103-8203-43c4-82f4-dcbd8615c937 tempest-ProjectReaderTests-1092271699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6af1de3d-f80d-4f40-9445-5ebe11f8a5d1.b0dd42a8-c062-4e26-ab90-9adc2fbc4ece" returned: 0 in 0.564s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-1e8bb103-8203-43c4-82f4-dcbd8615c937 tempest-ProjectReaderTests-1092271699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6af1de3d-f80d-4f40-9445-5ebe11f8a5d1.b0dd42a8-c062-4e26-ab90-9adc2fbc4ece {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:50 devstack sudo[108825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6af1de3d-f80d-4f40-9445-5ebe11f8a5d1.b0dd42a8-c062-4e26-ab90-9adc2fbc4ece Aug 10 16:15:50 devstack sudo[108825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:50 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-b961b7e2-f61d-4dba-a693-3eb3fbe6d39b tempest-CinderUnicodeTest-1100710175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:15:50 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b961b7e2-f61d-4dba-a693-3eb3fbe6d39b tempest-CinderUnicodeTest-1100710175 None] Flow 'volume_create_manager' (6d637a17-54f9-4ec9-ae63-46f2ceb97d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:15:50 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b961b7e2-f61d-4dba-a693-3eb3fbe6d39b tempest-CinderUnicodeTest-1100710175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b85965c0-b27c-43b9-99b5-d75172405e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:50 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b961b7e2-f61d-4dba-a693-3eb3fbe6d39b tempest-CinderUnicodeTest-1100710175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b85965c0-b27c-43b9-99b5-d75172405e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:15:50Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1466923556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2df16e7-25be-467b-90ab-406d5dfcfabf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e852059e5fde46879bcf3b08b884db13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:15:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:15:51Z,use_quota=True,user_id='f0ab5608484e4f299cc87e26ad70023c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:50 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b961b7e2-f61d-4dba-a693-3eb3fbe6d39b tempest-CinderUnicodeTest-1100710175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9007012a-baeb-4d8a-b168-91a909340c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:50 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b961b7e2-f61d-4dba-a693-3eb3fbe6d39b tempest-CinderUnicodeTest-1100710175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9007012a-baeb-4d8a-b168-91a909340c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:50 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b961b7e2-f61d-4dba-a693-3eb3fbe6d39b tempest-CinderUnicodeTest-1100710175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d32c059f-617f-4178-b6af-614dc961d9ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:50 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b961b7e2-f61d-4dba-a693-3eb3fbe6d39b tempest-CinderUnicodeTest-1100710175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d32c059f-617f-4178-b6af-614dc961d9ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2df16e7-25be-467b-90ab-406d5dfcfabf', 'volume_name': 'volume-a2df16e7-25be-467b-90ab-406d5dfcfabf', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:50 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b961b7e2-f61d-4dba-a693-3eb3fbe6d39b tempest-CinderUnicodeTest-1100710175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa2690a8-e6f1-4e96-8ad6-cf8fc30a064b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:50 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b961b7e2-f61d-4dba-a693-3eb3fbe6d39b tempest-CinderUnicodeTest-1100710175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa2690a8-e6f1-4e96-8ad6-cf8fc30a064b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:50 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b961b7e2-f61d-4dba-a693-3eb3fbe6d39b tempest-CinderUnicodeTest-1100710175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abf90ab5-2c87-450c-9ab0-59e1648df938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:50 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-b961b7e2-f61d-4dba-a693-3eb3fbe6d39b tempest-CinderUnicodeTest-1100710175 None] Volume a2df16e7-25be-467b-90ab-406d5dfcfabf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2df16e7-25be-467b-90ab-406d5dfcfabf', 'volume_size': 1} Aug 10 16:15:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-b961b7e2-f61d-4dba-a693-3eb3fbe6d39b tempest-CinderUnicodeTest-1100710175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:15:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-b961b7e2-f61d-4dba-a693-3eb3fbe6d39b tempest-CinderUnicodeTest-1100710175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:15:50 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-b961b7e2-f61d-4dba-a693-3eb3fbe6d39b tempest-CinderUnicodeTest-1100710175 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:15:50Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1466923556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2df16e7-25be-467b-90ab-406d5dfcfabf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e852059e5fde46879bcf3b08b884db13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:15:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:15:51Z,use_quota=True,user_id='f0ab5608484e4f299cc87e26ad70023c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:15:50 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-b961b7e2-f61d-4dba-a693-3eb3fbe6d39b tempest-CinderUnicodeTest-1100710175 None] Creating volume a2df16e7-25be-467b-90ab-406d5dfcfabf {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:15:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-b961b7e2-f61d-4dba-a693-3eb3fbe6d39b tempest-CinderUnicodeTest-1100710175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:15:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-b961b7e2-f61d-4dba-a693-3eb3fbe6d39b tempest-CinderUnicodeTest-1100710175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:15:50 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-b961b7e2-f61d-4dba-a693-3eb3fbe6d39b tempest-CinderUnicodeTest-1100710175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:15:51 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-b961b7e2-f61d-4dba-a693-3eb3fbe6d39b tempest-CinderUnicodeTest-1100710175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:15:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-b961b7e2-f61d-4dba-a693-3eb3fbe6d39b tempest-CinderUnicodeTest-1100710175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:15:51 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-b961b7e2-f61d-4dba-a693-3eb3fbe6d39b tempest-CinderUnicodeTest-1100710175 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:15:51 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-b961b7e2-f61d-4dba-a693-3eb3fbe6d39b tempest-CinderUnicodeTest-1100710175 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:15:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b961b7e2-f61d-4dba-a693-3eb3fbe6d39b tempest-CinderUnicodeTest-1100710175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a2df16e7-25be-467b-90ab-406d5dfcfabf 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:51 devstack sudo[108830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a2df16e7-25be-467b-90ab-406d5dfcfabf 1073741824 Aug 10 16:15:51 devstack sudo[108830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:51 devstack sudo[108825]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-1e8bb103-8203-43c4-82f4-dcbd8615c937 tempest-ProjectReaderTests-1092271699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6af1de3d-f80d-4f40-9445-5ebe11f8a5d1.b0dd42a8-c062-4e26-ab90-9adc2fbc4ece" returned: 0 in 0.442s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:51 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-1e8bb103-8203-43c4-82f4-dcbd8615c937 tempest-ProjectReaderTests-1092271699 None] Lock "cinder-quobyte-b0dd42a8-c062-4e26-ab90-9adc2fbc4ece" released by "_delete_snapshot" :: held 2.089s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:15:51 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-1e8bb103-8203-43c4-82f4-dcbd8615c937 tempest-ProjectReaderTests-1092271699 None] Lock "cinder-quobyte-6af1de3d-f80d-4f40-9445-5ebe11f8a5d1" released by "delete_snapshot" :: held 2.120s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:15:51 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-1e8bb103-8203-43c4-82f4-dcbd8615c937 tempest-ProjectReaderTests-1092271699 None] Created reservations ['ce2d417c-6460-4b3c-bb0d-f0f223eaed6e', 'd0abf1ae-3741-4c95-ad78-fca0349dd845', '6b021d74-7c76-41d4-b5c6-6496cf30e268', '670f4207-b510-4848-822c-083f7174fee2'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:15:51 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-1e8bb103-8203-43c4-82f4-dcbd8615c937 tempest-ProjectReaderTests-1092271699 None] Delete snapshot completed successfully. Aug 10 16:15:51 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-1e8bb103-8203-43c4-82f4-dcbd8615c937 tempest-ProjectReaderTests-1092271699 None] Lock "cinder-b0dd42a8-c062-4e26-ab90-9adc2fbc4ece-delete_snapshot" released by "delete_snapshot" :: held 2.310s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:15:51 devstack sudo[108830]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b961b7e2-f61d-4dba-a693-3eb3fbe6d39b tempest-CinderUnicodeTest-1100710175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a2df16e7-25be-467b-90ab-406d5dfcfabf 1073741824" returned: 0 in 0.594s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b961b7e2-f61d-4dba-a693-3eb3fbe6d39b tempest-CinderUnicodeTest-1100710175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a2df16e7-25be-467b-90ab-406d5dfcfabf {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:51 devstack sudo[108837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a2df16e7-25be-467b-90ab-406d5dfcfabf Aug 10 16:15:51 devstack sudo[108837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:51 devstack sudo[108837]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b961b7e2-f61d-4dba-a693-3eb3fbe6d39b tempest-CinderUnicodeTest-1100710175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a2df16e7-25be-467b-90ab-406d5dfcfabf" returned: 0 in 0.293s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:51 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-b961b7e2-f61d-4dba-a693-3eb3fbe6d39b tempest-CinderUnicodeTest-1100710175 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:15:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-b961b7e2-f61d-4dba-a693-3eb3fbe6d39b tempest-CinderUnicodeTest-1100710175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:15:51 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b961b7e2-f61d-4dba-a693-3eb3fbe6d39b tempest-CinderUnicodeTest-1100710175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abf90ab5-2c87-450c-9ab0-59e1648df938) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2df16e7-25be-467b-90ab-406d5dfcfabf', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:51 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b961b7e2-f61d-4dba-a693-3eb3fbe6d39b tempest-CinderUnicodeTest-1100710175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8e269c1-fed8-4a98-99ca-6e2fe205572f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:51 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-b961b7e2-f61d-4dba-a693-3eb3fbe6d39b tempest-CinderUnicodeTest-1100710175 None] Volume volume-a2df16e7-25be-467b-90ab-406d5dfcfabf (a2df16e7-25be-467b-90ab-406d5dfcfabf): created successfully Aug 10 16:15:51 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b961b7e2-f61d-4dba-a693-3eb3fbe6d39b tempest-CinderUnicodeTest-1100710175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8e269c1-fed8-4a98-99ca-6e2fe205572f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:51 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-b961b7e2-f61d-4dba-a693-3eb3fbe6d39b tempest-CinderUnicodeTest-1100710175 None] Flow 'volume_create_manager' (6d637a17-54f9-4ec9-ae63-46f2ceb97d18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:15:52 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-b961b7e2-f61d-4dba-a693-3eb3fbe6d39b tempest-CinderUnicodeTest-1100710175 None] Created volume successfully. Aug 10 16:15:52 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-27118e2a-5665-400a-82b3-efaf7989544f tempest-ProjectReaderTests-1092271699 None] Acquiring lock "cinder-6af1de3d-f80d-4f40-9445-5ebe11f8a5d1-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:15:52 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-27118e2a-5665-400a-82b3-efaf7989544f tempest-ProjectReaderTests-1092271699 None] Lock "cinder-6af1de3d-f80d-4f40-9445-5ebe11f8a5d1-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:15:52 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-27118e2a-5665-400a-82b3-efaf7989544f tempest-ProjectReaderTests-1092271699 None] Acquiring lock "cinder-quobyte-6af1de3d-f80d-4f40-9445-5ebe11f8a5d1" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:15:52 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-27118e2a-5665-400a-82b3-efaf7989544f tempest-ProjectReaderTests-1092271699 None] Lock "cinder-quobyte-6af1de3d-f80d-4f40-9445-5ebe11f8a5d1" acquired by "delete_volume" :: waited 0.020s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:15:52 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[e33327aa-7a75-48f5-afb9-472641d280c5]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:15:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-27118e2a-5665-400a-82b3-efaf7989544f tempest-ProjectReaderTests-1092271699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6af1de3d-f80d-4f40-9445-5ebe11f8a5d1 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:52 devstack sudo[108841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6af1de3d-f80d-4f40-9445-5ebe11f8a5d1 Aug 10 16:15:52 devstack sudo[108841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:52 devstack sudo[108841]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-27118e2a-5665-400a-82b3-efaf7989544f tempest-ProjectReaderTests-1092271699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6af1de3d-f80d-4f40-9445-5ebe11f8a5d1" returned: 0 in 0.512s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-27118e2a-5665-400a-82b3-efaf7989544f tempest-ProjectReaderTests-1092271699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6af1de3d-f80d-4f40-9445-5ebe11f8a5d1 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:53 devstack sudo[108846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6af1de3d-f80d-4f40-9445-5ebe11f8a5d1 Aug 10 16:15:53 devstack sudo[108846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:53 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac5bccc8-465b-403b-8fc4-e74111d6fa66 tempest-ProjectMemberTests-715789302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:15:53 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-ac5bccc8-465b-403b-8fc4-e74111d6fa66 tempest-ProjectMemberTests-715789302 None] Flow 'volume_create_manager' (a3ed3887-410d-42fa-a4de-12c540808af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:15:53 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-ac5bccc8-465b-403b-8fc4-e74111d6fa66 tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03bc6f51-c170-45ce-be01-e346617ec8b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:53 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-ac5bccc8-465b-403b-8fc4-e74111d6fa66 tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03bc6f51-c170-45ce-be01-e346617ec8b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:15:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-899630833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=684c2768-c1e1-4bba-881f-7c97a9bb5200,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8408ad471876405b8109f4d45d4a242d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:15:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:15:53Z,use_quota=True,user_id='dc958e8abfdb43a69a4609f15eb8d6d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:53 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-ac5bccc8-465b-403b-8fc4-e74111d6fa66 tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d7a1fdf-55b4-4330-843a-1173d8f0ca51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:53 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-ac5bccc8-465b-403b-8fc4-e74111d6fa66 tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d7a1fdf-55b4-4330-843a-1173d8f0ca51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:53 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-ac5bccc8-465b-403b-8fc4-e74111d6fa66 tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (441b6c4c-1d89-423d-9dea-0fba9f1baa57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:53 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-ac5bccc8-465b-403b-8fc4-e74111d6fa66 tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (441b6c4c-1d89-423d-9dea-0fba9f1baa57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '684c2768-c1e1-4bba-881f-7c97a9bb5200', 'volume_name': 'volume-684c2768-c1e1-4bba-881f-7c97a9bb5200', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:53 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-ac5bccc8-465b-403b-8fc4-e74111d6fa66 tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9775e04-4c64-43ef-91a3-978b3f4f361e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:53 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-ac5bccc8-465b-403b-8fc4-e74111d6fa66 tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9775e04-4c64-43ef-91a3-978b3f4f361e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:53 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-ac5bccc8-465b-403b-8fc4-e74111d6fa66 tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (873a5242-60d5-4a4e-b44f-41e2d340e021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:53 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-ac5bccc8-465b-403b-8fc4-e74111d6fa66 tempest-ProjectMemberTests-715789302 None] Volume 684c2768-c1e1-4bba-881f-7c97a9bb5200: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-684c2768-c1e1-4bba-881f-7c97a9bb5200', 'volume_size': 1} Aug 10 16:15:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-ac5bccc8-465b-403b-8fc4-e74111d6fa66 tempest-ProjectMemberTests-715789302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:15:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-ac5bccc8-465b-403b-8fc4-e74111d6fa66 tempest-ProjectMemberTests-715789302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:15:53 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-ac5bccc8-465b-403b-8fc4-e74111d6fa66 tempest-ProjectMemberTests-715789302 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:15:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-899630833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=684c2768-c1e1-4bba-881f-7c97a9bb5200,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8408ad471876405b8109f4d45d4a242d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:15:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:15:53Z,use_quota=True,user_id='dc958e8abfdb43a69a4609f15eb8d6d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:15:53 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-ac5bccc8-465b-403b-8fc4-e74111d6fa66 tempest-ProjectMemberTests-715789302 None] Creating volume 684c2768-c1e1-4bba-881f-7c97a9bb5200 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:15:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-ac5bccc8-465b-403b-8fc4-e74111d6fa66 tempest-ProjectMemberTests-715789302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:15:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-ac5bccc8-465b-403b-8fc4-e74111d6fa66 tempest-ProjectMemberTests-715789302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:15:53 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-ac5bccc8-465b-403b-8fc4-e74111d6fa66 tempest-ProjectMemberTests-715789302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:15:53 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-ac5bccc8-465b-403b-8fc4-e74111d6fa66 tempest-ProjectMemberTests-715789302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:15:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-ac5bccc8-465b-403b-8fc4-e74111d6fa66 tempest-ProjectMemberTests-715789302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:15:53 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-ac5bccc8-465b-403b-8fc4-e74111d6fa66 tempest-ProjectMemberTests-715789302 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:15:53 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-ac5bccc8-465b-403b-8fc4-e74111d6fa66 tempest-ProjectMemberTests-715789302 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:15:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ac5bccc8-465b-403b-8fc4-e74111d6fa66 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-684c2768-c1e1-4bba-881f-7c97a9bb5200 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:53 devstack sudo[108848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-684c2768-c1e1-4bba-881f-7c97a9bb5200 1073741824 Aug 10 16:15:53 devstack sudo[108848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:53 devstack sudo[108846]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-27118e2a-5665-400a-82b3-efaf7989544f tempest-ProjectReaderTests-1092271699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6af1de3d-f80d-4f40-9445-5ebe11f8a5d1" returned: 0 in 0.343s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:53 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-27118e2a-5665-400a-82b3-efaf7989544f tempest-ProjectReaderTests-1092271699 None] Lock "cinder-quobyte-6af1de3d-f80d-4f40-9445-5ebe11f8a5d1" released by "delete_volume" :: held 0.972s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:15:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-4de03135-bea5-48ed-be3c-74b1796189e8 tempest-CinderUnicodeTest-1100710175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:15:53 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-27118e2a-5665-400a-82b3-efaf7989544f tempest-ProjectReaderTests-1092271699 None] Created reservations ['ea4bd325-3fd7-4c96-b240-6e651820027e', '850984be-e35f-4b82-a5b2-67838d234d53', 'a01ab791-a51c-4545-8261-e956495a8a87', 'a04866be-9dd6-4d30-8076-c7aeffcb5db5'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:15:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-27118e2a-5665-400a-82b3-efaf7989544f tempest-ProjectReaderTests-1092271699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:15:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-27118e2a-5665-400a-82b3-efaf7989544f tempest-ProjectReaderTests-1092271699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:15:53 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-27118e2a-5665-400a-82b3-efaf7989544f tempest-ProjectReaderTests-1092271699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:15:53 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-27118e2a-5665-400a-82b3-efaf7989544f tempest-ProjectReaderTests-1092271699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:15:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-27118e2a-5665-400a-82b3-efaf7989544f tempest-ProjectReaderTests-1092271699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:15:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-27118e2a-5665-400a-82b3-efaf7989544f tempest-ProjectReaderTests-1092271699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:53 devstack sudo[108854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:15:53 devstack sudo[108854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:53 devstack sudo[108848]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ac5bccc8-465b-403b-8fc4-e74111d6fa66 tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-684c2768-c1e1-4bba-881f-7c97a9bb5200 1073741824" returned: 0 in 0.648s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:53 devstack sudo[108854]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-27118e2a-5665-400a-82b3-efaf7989544f tempest-ProjectReaderTests-1092271699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.313s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:53 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-27118e2a-5665-400a-82b3-efaf7989544f tempest-ProjectReaderTests-1092271699 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:15:53 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-27118e2a-5665-400a-82b3-efaf7989544f tempest-ProjectReaderTests-1092271699 None] Deleted volume successfully. Aug 10 16:15:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ac5bccc8-465b-403b-8fc4-e74111d6fa66 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-684c2768-c1e1-4bba-881f-7c97a9bb5200 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:54 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-27118e2a-5665-400a-82b3-efaf7989544f tempest-ProjectReaderTests-1092271699 None] Lock "cinder-6af1de3d-f80d-4f40-9445-5ebe11f8a5d1-delete_volume" released by "delete_volume" :: held 1.679s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:15:54 devstack sudo[108858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-684c2768-c1e1-4bba-881f-7c97a9bb5200 Aug 10 16:15:54 devstack sudo[108858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:54 devstack sudo[108858]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ac5bccc8-465b-403b-8fc4-e74111d6fa66 tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-684c2768-c1e1-4bba-881f-7c97a9bb5200" returned: 0 in 0.270s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:54 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-ac5bccc8-465b-403b-8fc4-e74111d6fa66 tempest-ProjectMemberTests-715789302 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:15:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-ac5bccc8-465b-403b-8fc4-e74111d6fa66 tempest-ProjectMemberTests-715789302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:15:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-4de03135-bea5-48ed-be3c-74b1796189e8 tempest-CinderUnicodeTest-1100710175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.822s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:15:54 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-ac5bccc8-465b-403b-8fc4-e74111d6fa66 tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (873a5242-60d5-4a4e-b44f-41e2d340e021) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-684c2768-c1e1-4bba-881f-7c97a9bb5200', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:54 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-ac5bccc8-465b-403b-8fc4-e74111d6fa66 tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (975776e5-3a9d-4990-aafa-4f176cc6285b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:54 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-4de03135-bea5-48ed-be3c-74b1796189e8 tempest-CinderUnicodeTest-1100710175 None] Creating offline snapshot 1b2da6f0-2295-4b8f-abef-c63ff54d5b53 of volume a2df16e7-25be-467b-90ab-406d5dfcfabf {{(pid=88641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 16:15:54 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-ac5bccc8-465b-403b-8fc4-e74111d6fa66 tempest-ProjectMemberTests-715789302 None] Volume volume-684c2768-c1e1-4bba-881f-7c97a9bb5200 (684c2768-c1e1-4bba-881f-7c97a9bb5200): created successfully Aug 10 16:15:54 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-ac5bccc8-465b-403b-8fc4-e74111d6fa66 tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (975776e5-3a9d-4990-aafa-4f176cc6285b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:54 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-ac5bccc8-465b-403b-8fc4-e74111d6fa66 tempest-ProjectMemberTests-715789302 None] Flow 'volume_create_manager' (a3ed3887-410d-42fa-a4de-12c540808af5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:15:54 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd88d4c7-24f8-4801-a5a4-5111242930be]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:15:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4de03135-bea5-48ed-be3c-74b1796189e8 tempest-CinderUnicodeTest-1100710175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a2df16e7-25be-467b-90ab-406d5dfcfabf {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:54 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-ac5bccc8-465b-403b-8fc4-e74111d6fa66 tempest-ProjectMemberTests-715789302 None] Created volume successfully. Aug 10 16:15:54 devstack sudo[108861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a2df16e7-25be-467b-90ab-406d5dfcfabf Aug 10 16:15:54 devstack sudo[108861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:54 devstack sudo[108861]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4de03135-bea5-48ed-be3c-74b1796189e8 tempest-CinderUnicodeTest-1100710175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a2df16e7-25be-467b-90ab-406d5dfcfabf" returned: 0 in 0.521s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4de03135-bea5-48ed-be3c-74b1796189e8 tempest-CinderUnicodeTest-1100710175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a2df16e7-25be-467b-90ab-406d5dfcfabf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a2df16e7-25be-467b-90ab-406d5dfcfabf.1b2da6f0-2295-4b8f-abef-c63ff54d5b53 1G {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:54 devstack sudo[108866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a2df16e7-25be-467b-90ab-406d5dfcfabf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a2df16e7-25be-467b-90ab-406d5dfcfabf.1b2da6f0-2295-4b8f-abef-c63ff54d5b53 1G Aug 10 16:15:54 devstack sudo[108866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:55 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a20856b-35e4-48d6-a75c-360b9e5f3878 tempest-ProjectReaderTests-1092271699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:15:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-7a20856b-35e4-48d6-a75c-360b9e5f3878 tempest-ProjectReaderTests-1092271699 None] Flow 'volume_create_manager' (765f5efc-8e23-431b-a115-6b6afc4dc5df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:15:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-7a20856b-35e4-48d6-a75c-360b9e5f3878 tempest-ProjectReaderTests-1092271699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46573415-5095-436d-8461-fa5cc0c2d16b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-7a20856b-35e4-48d6-a75c-360b9e5f3878 tempest-ProjectReaderTests-1092271699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46573415-5095-436d-8461-fa5cc0c2d16b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:15:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1795797952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00ecf061-e108-4d5e-888a-c239333b7cde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8da6b8cdad34ff69416120b23e9a25c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:15:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:15:55Z,use_quota=True,user_id='4e50367bdb2c40639a24a8a70eaa2b15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-7a20856b-35e4-48d6-a75c-360b9e5f3878 tempest-ProjectReaderTests-1092271699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed790794-20a8-4780-80c3-cf44765985ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-7a20856b-35e4-48d6-a75c-360b9e5f3878 tempest-ProjectReaderTests-1092271699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed790794-20a8-4780-80c3-cf44765985ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-7a20856b-35e4-48d6-a75c-360b9e5f3878 tempest-ProjectReaderTests-1092271699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5cd6f74-ff09-4c1d-b747-94df507280d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-7a20856b-35e4-48d6-a75c-360b9e5f3878 tempest-ProjectReaderTests-1092271699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5cd6f74-ff09-4c1d-b747-94df507280d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00ecf061-e108-4d5e-888a-c239333b7cde', 'volume_name': 'volume-00ecf061-e108-4d5e-888a-c239333b7cde', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-7a20856b-35e4-48d6-a75c-360b9e5f3878 tempest-ProjectReaderTests-1092271699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb990b88-2c9a-47fc-9ccc-cfb8d55c0f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-7a20856b-35e4-48d6-a75c-360b9e5f3878 tempest-ProjectReaderTests-1092271699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb990b88-2c9a-47fc-9ccc-cfb8d55c0f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:55 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-7a20856b-35e4-48d6-a75c-360b9e5f3878 tempest-ProjectReaderTests-1092271699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36fe7828-5e6b-4676-8a39-583b0806fb30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:55 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-7a20856b-35e4-48d6-a75c-360b9e5f3878 tempest-ProjectReaderTests-1092271699 None] Volume 00ecf061-e108-4d5e-888a-c239333b7cde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00ecf061-e108-4d5e-888a-c239333b7cde', 'volume_size': 1} Aug 10 16:15:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-7a20856b-35e4-48d6-a75c-360b9e5f3878 tempest-ProjectReaderTests-1092271699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:15:55 devstack sudo[108866]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4de03135-bea5-48ed-be3c-74b1796189e8 tempest-CinderUnicodeTest-1100710175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a2df16e7-25be-467b-90ab-406d5dfcfabf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a2df16e7-25be-467b-90ab-406d5dfcfabf.1b2da6f0-2295-4b8f-abef-c63ff54d5b53 1G" returned: 0 in 0.824s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4de03135-bea5-48ed-be3c-74b1796189e8 tempest-CinderUnicodeTest-1100710175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2df16e7-25be-467b-90ab-406d5dfcfabf -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a2df16e7-25be-467b-90ab-406d5dfcfabf.1b2da6f0-2295-4b8f-abef-c63ff54d5b53 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:55 devstack sudo[108872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2df16e7-25be-467b-90ab-406d5dfcfabf -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a2df16e7-25be-467b-90ab-406d5dfcfabf.1b2da6f0-2295-4b8f-abef-c63ff54d5b53 Aug 10 16:15:55 devstack sudo[108872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-3fdf92a1-6b84-47e1-bbda-13a5cdbfaead tempest-ProjectMemberTests-715789302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:15:56 devstack sudo[108872]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4de03135-bea5-48ed-be3c-74b1796189e8 tempest-CinderUnicodeTest-1100710175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2df16e7-25be-467b-90ab-406d5dfcfabf -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a2df16e7-25be-467b-90ab-406d5dfcfabf.1b2da6f0-2295-4b8f-abef-c63ff54d5b53" returned: 0 in 0.368s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:56 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-4de03135-bea5-48ed-be3c-74b1796189e8 tempest-CinderUnicodeTest-1100710175 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a2df16e7-25be-467b-90ab-406d5dfcfabf.1b2da6f0-2295-4b8f-abef-c63ff54d5b53 is being set with open permissions: ugo+rw Aug 10 16:15:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4de03135-bea5-48ed-be3c-74b1796189e8 tempest-CinderUnicodeTest-1100710175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a2df16e7-25be-467b-90ab-406d5dfcfabf.1b2da6f0-2295-4b8f-abef-c63ff54d5b53 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:56 devstack sudo[108878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a2df16e7-25be-467b-90ab-406d5dfcfabf.1b2da6f0-2295-4b8f-abef-c63ff54d5b53 Aug 10 16:15:56 devstack sudo[108878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:56 devstack sudo[108878]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4de03135-bea5-48ed-be3c-74b1796189e8 tempest-CinderUnicodeTest-1100710175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a2df16e7-25be-467b-90ab-406d5dfcfabf.1b2da6f0-2295-4b8f-abef-c63ff54d5b53" returned: 0 in 0.291s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4de03135-bea5-48ed-be3c-74b1796189e8 tempest-CinderUnicodeTest-1100710175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a2df16e7-25be-467b-90ab-406d5dfcfabf.info {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:56 devstack sudo[108881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a2df16e7-25be-467b-90ab-406d5dfcfabf.info Aug 10 16:15:56 devstack sudo[108881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:56 devstack sudo[108881]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4de03135-bea5-48ed-be3c-74b1796189e8 tempest-CinderUnicodeTest-1100710175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a2df16e7-25be-467b-90ab-406d5dfcfabf.info" returned: 0 in 0.328s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:56 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-4de03135-bea5-48ed-be3c-74b1796189e8 tempest-CinderUnicodeTest-1100710175 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a2df16e7-25be-467b-90ab-406d5dfcfabf.info is being set with open permissions: ugo+rw Aug 10 16:15:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4de03135-bea5-48ed-be3c-74b1796189e8 tempest-CinderUnicodeTest-1100710175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a2df16e7-25be-467b-90ab-406d5dfcfabf.info {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:56 devstack sudo[108884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a2df16e7-25be-467b-90ab-406d5dfcfabf.info Aug 10 16:15:56 devstack sudo[108884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:57 devstack sudo[108884]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4de03135-bea5-48ed-be3c-74b1796189e8 tempest-CinderUnicodeTest-1100710175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a2df16e7-25be-467b-90ab-406d5dfcfabf.info" returned: 0 in 0.285s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-4de03135-bea5-48ed-be3c-74b1796189e8 tempest-CinderUnicodeTest-1100710175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.792s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:15:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-7a20856b-35e4-48d6-a75c-360b9e5f3878 tempest-ProjectReaderTests-1092271699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.582s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:15:57 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-7a20856b-35e4-48d6-a75c-360b9e5f3878 tempest-ProjectReaderTests-1092271699 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:15:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1795797952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00ecf061-e108-4d5e-888a-c239333b7cde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8da6b8cdad34ff69416120b23e9a25c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:15:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:15:55Z,use_quota=True,user_id='4e50367bdb2c40639a24a8a70eaa2b15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:15:57 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-7a20856b-35e4-48d6-a75c-360b9e5f3878 tempest-ProjectReaderTests-1092271699 None] Creating volume 00ecf061-e108-4d5e-888a-c239333b7cde {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:15:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-7a20856b-35e4-48d6-a75c-360b9e5f3878 tempest-ProjectReaderTests-1092271699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:15:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-7a20856b-35e4-48d6-a75c-360b9e5f3878 tempest-ProjectReaderTests-1092271699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:15:57 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-7a20856b-35e4-48d6-a75c-360b9e5f3878 tempest-ProjectReaderTests-1092271699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:15:57 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-7a20856b-35e4-48d6-a75c-360b9e5f3878 tempest-ProjectReaderTests-1092271699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:15:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-7a20856b-35e4-48d6-a75c-360b9e5f3878 tempest-ProjectReaderTests-1092271699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:15:57 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-7a20856b-35e4-48d6-a75c-360b9e5f3878 tempest-ProjectReaderTests-1092271699 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:15:57 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-7a20856b-35e4-48d6-a75c-360b9e5f3878 tempest-ProjectReaderTests-1092271699 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:15:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7a20856b-35e4-48d6-a75c-360b9e5f3878 tempest-ProjectReaderTests-1092271699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-00ecf061-e108-4d5e-888a-c239333b7cde 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:57 devstack sudo[108887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-00ecf061-e108-4d5e-888a-c239333b7cde 1073741824 Aug 10 16:15:57 devstack sudo[108887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:57 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-4de03135-bea5-48ed-be3c-74b1796189e8 tempest-CinderUnicodeTest-1100710175 None] Create snapshot completed successfully Aug 10 16:15:57 devstack sudo[108887]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7a20856b-35e4-48d6-a75c-360b9e5f3878 tempest-ProjectReaderTests-1092271699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-00ecf061-e108-4d5e-888a-c239333b7cde 1073741824" returned: 0 in 0.514s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7a20856b-35e4-48d6-a75c-360b9e5f3878 tempest-ProjectReaderTests-1092271699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-00ecf061-e108-4d5e-888a-c239333b7cde {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:57 devstack sudo[108892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-00ecf061-e108-4d5e-888a-c239333b7cde Aug 10 16:15:57 devstack sudo[108892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:57 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-55ea3270-ccde-43fa-ace7-fae3e6d58592 tempest-CinderUnicodeTest-1100710175 None] Acquiring lock "cinder-1b2da6f0-2295-4b8f-abef-c63ff54d5b53-delete_snapshot" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:15:57 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-55ea3270-ccde-43fa-ace7-fae3e6d58592 tempest-CinderUnicodeTest-1100710175 None] Lock "cinder-1b2da6f0-2295-4b8f-abef-c63ff54d5b53-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:15:57 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-55ea3270-ccde-43fa-ace7-fae3e6d58592 tempest-CinderUnicodeTest-1100710175 None] Acquiring lock "cinder-quobyte-a2df16e7-25be-467b-90ab-406d5dfcfabf" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:15:57 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-55ea3270-ccde-43fa-ace7-fae3e6d58592 tempest-CinderUnicodeTest-1100710175 None] Lock "cinder-quobyte-a2df16e7-25be-467b-90ab-406d5dfcfabf" acquired by "delete_snapshot" :: waited 0.042s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:15:57 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-55ea3270-ccde-43fa-ace7-fae3e6d58592 tempest-CinderUnicodeTest-1100710175 None] Acquiring lock "cinder-quobyte-1b2da6f0-2295-4b8f-abef-c63ff54d5b53" by "_delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:15:57 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-55ea3270-ccde-43fa-ace7-fae3e6d58592 tempest-CinderUnicodeTest-1100710175 None] Lock "cinder-quobyte-1b2da6f0-2295-4b8f-abef-c63ff54d5b53" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:15:57 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-55ea3270-ccde-43fa-ace7-fae3e6d58592 tempest-CinderUnicodeTest-1100710175 None] Deleting offline snapshot 1b2da6f0-2295-4b8f-abef-c63ff54d5b53 of volume a2df16e7-25be-467b-90ab-406d5dfcfabf {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 16:15:57 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-55ea3270-ccde-43fa-ace7-fae3e6d58592 tempest-CinderUnicodeTest-1100710175 None] snapshot_file for this snap is: volume-a2df16e7-25be-467b-90ab-406d5dfcfabf.1b2da6f0-2295-4b8f-abef-c63ff54d5b53 {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 16:15:57 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[59c57f66-64c9-48e7-aa2b-1975bb0b8fa4]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:15:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-55ea3270-ccde-43fa-ace7-fae3e6d58592 tempest-CinderUnicodeTest-1100710175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a2df16e7-25be-467b-90ab-406d5dfcfabf.1b2da6f0-2295-4b8f-abef-c63ff54d5b53 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:57 devstack sudo[108892]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-7a20856b-35e4-48d6-a75c-360b9e5f3878 tempest-ProjectReaderTests-1092271699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-00ecf061-e108-4d5e-888a-c239333b7cde" returned: 0 in 0.329s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:57 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-7a20856b-35e4-48d6-a75c-360b9e5f3878 tempest-ProjectReaderTests-1092271699 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:15:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-7a20856b-35e4-48d6-a75c-360b9e5f3878 tempest-ProjectReaderTests-1092271699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:15:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-3fdf92a1-6b84-47e1-bbda-13a5cdbfaead tempest-ProjectMemberTests-715789302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.213s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:15:57 devstack sudo[108894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a2df16e7-25be-467b-90ab-406d5dfcfabf.1b2da6f0-2295-4b8f-abef-c63ff54d5b53 Aug 10 16:15:57 devstack sudo[108894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:57 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-7a20856b-35e4-48d6-a75c-360b9e5f3878 tempest-ProjectReaderTests-1092271699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36fe7828-5e6b-4676-8a39-583b0806fb30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00ecf061-e108-4d5e-888a-c239333b7cde', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:57 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-7a20856b-35e4-48d6-a75c-360b9e5f3878 tempest-ProjectReaderTests-1092271699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ede255a-a577-458c-9d87-2641d5ad38d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:57 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-3fdf92a1-6b84-47e1-bbda-13a5cdbfaead tempest-ProjectMemberTests-715789302 None] Creating offline snapshot b1d7b9c0-dcf4-49db-94be-3bc009b6dfc4 of volume 684c2768-c1e1-4bba-881f-7c97a9bb5200 {{(pid=88641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 16:15:58 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-209bccb0-2f9e-4349-9bfd-980d23edcff6 tempest-SnapshotDependencyTests-34318094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:15:58 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-209bccb0-2f9e-4349-9bfd-980d23edcff6 tempest-SnapshotDependencyTests-34318094 None] Flow 'volume_create_manager' (5729a4e9-ec9b-454b-9b33-7cf3cb045c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:15:58 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-209bccb0-2f9e-4349-9bfd-980d23edcff6 tempest-SnapshotDependencyTests-34318094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28be92df-515b-4611-8388-a21d2aa46cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:58 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aecac92-7976-4dfb-8bb9-4560217dff04]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:15:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-3fdf92a1-6b84-47e1-bbda-13a5cdbfaead tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-684c2768-c1e1-4bba-881f-7c97a9bb5200 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:58 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-7a20856b-35e4-48d6-a75c-360b9e5f3878 tempest-ProjectReaderTests-1092271699 None] Volume volume-00ecf061-e108-4d5e-888a-c239333b7cde (00ecf061-e108-4d5e-888a-c239333b7cde): created successfully Aug 10 16:15:58 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-7a20856b-35e4-48d6-a75c-360b9e5f3878 tempest-ProjectReaderTests-1092271699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ede255a-a577-458c-9d87-2641d5ad38d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:58 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-7a20856b-35e4-48d6-a75c-360b9e5f3878 tempest-ProjectReaderTests-1092271699 None] Flow 'volume_create_manager' (765f5efc-8e23-431b-a115-6b6afc4dc5df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:15:58 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-209bccb0-2f9e-4349-9bfd-980d23edcff6 tempest-SnapshotDependencyTests-34318094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28be92df-515b-4611-8388-a21d2aa46cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:15:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1265611264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfe61a71-8201-489b-9afa-70e9c7baeebd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b924fc2e27e47b089913a324591d46e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:15:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:15:58Z,use_quota=True,user_id='b08e56dfda95455d8d749706f0f9e4bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:58 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-209bccb0-2f9e-4349-9bfd-980d23edcff6 tempest-SnapshotDependencyTests-34318094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f61eb54d-1d3f-4ada-896e-01fac2595cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:58 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-209bccb0-2f9e-4349-9bfd-980d23edcff6 tempest-SnapshotDependencyTests-34318094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f61eb54d-1d3f-4ada-896e-01fac2595cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:58 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-209bccb0-2f9e-4349-9bfd-980d23edcff6 tempest-SnapshotDependencyTests-34318094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eeb83298-dddb-4862-8d15-55a466fcb872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:58 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-209bccb0-2f9e-4349-9bfd-980d23edcff6 tempest-SnapshotDependencyTests-34318094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eeb83298-dddb-4862-8d15-55a466fcb872) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfe61a71-8201-489b-9afa-70e9c7baeebd', 'volume_name': 'volume-dfe61a71-8201-489b-9afa-70e9c7baeebd', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:58 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-209bccb0-2f9e-4349-9bfd-980d23edcff6 tempest-SnapshotDependencyTests-34318094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf4a1dd6-f322-40dc-a001-990189ddbf4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:58 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-209bccb0-2f9e-4349-9bfd-980d23edcff6 tempest-SnapshotDependencyTests-34318094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf4a1dd6-f322-40dc-a001-990189ddbf4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:15:58 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-209bccb0-2f9e-4349-9bfd-980d23edcff6 tempest-SnapshotDependencyTests-34318094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f88077e3-bf8c-4ce3-a6bb-299e34d4ce3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:15:58 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-209bccb0-2f9e-4349-9bfd-980d23edcff6 tempest-SnapshotDependencyTests-34318094 None] Volume dfe61a71-8201-489b-9afa-70e9c7baeebd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfe61a71-8201-489b-9afa-70e9c7baeebd', 'volume_size': 1} Aug 10 16:15:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-209bccb0-2f9e-4349-9bfd-980d23edcff6 tempest-SnapshotDependencyTests-34318094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:15:58 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-7a20856b-35e4-48d6-a75c-360b9e5f3878 tempest-ProjectReaderTests-1092271699 None] Created volume successfully. Aug 10 16:15:58 devstack sudo[108897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-684c2768-c1e1-4bba-881f-7c97a9bb5200 Aug 10 16:15:58 devstack sudo[108897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:58 devstack sudo[108894]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-55ea3270-ccde-43fa-ace7-fae3e6d58592 tempest-CinderUnicodeTest-1100710175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a2df16e7-25be-467b-90ab-406d5dfcfabf.1b2da6f0-2295-4b8f-abef-c63ff54d5b53" returned: 0 in 0.396s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:58 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-55ea3270-ccde-43fa-ace7-fae3e6d58592 tempest-CinderUnicodeTest-1100710175 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2df16e7-25be-467b-90ab-406d5dfcfabf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 16:15:58 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[a17b8c6c-e6d0-4d69-8eb9-bd6e984c7948]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:15:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-55ea3270-ccde-43fa-ace7-fae3e6d58592 tempest-CinderUnicodeTest-1100710175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a2df16e7-25be-467b-90ab-406d5dfcfabf {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:58 devstack sudo[108902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a2df16e7-25be-467b-90ab-406d5dfcfabf Aug 10 16:15:58 devstack sudo[108902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:58 devstack sudo[108897]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-3fdf92a1-6b84-47e1-bbda-13a5cdbfaead tempest-ProjectMemberTests-715789302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-684c2768-c1e1-4bba-881f-7c97a9bb5200" returned: 0 in 0.414s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-3fdf92a1-6b84-47e1-bbda-13a5cdbfaead tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-684c2768-c1e1-4bba-881f-7c97a9bb5200,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-684c2768-c1e1-4bba-881f-7c97a9bb5200.b1d7b9c0-dcf4-49db-94be-3bc009b6dfc4 1G {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:58 devstack sudo[108907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-684c2768-c1e1-4bba-881f-7c97a9bb5200,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-684c2768-c1e1-4bba-881f-7c97a9bb5200.b1d7b9c0-dcf4-49db-94be-3bc009b6dfc4 1G Aug 10 16:15:58 devstack sudo[108907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-ae828335-6707-425e-b646-fe066f454897 tempest-ProjectReaderTests-1092271699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:15:58 devstack sudo[108902]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-55ea3270-ccde-43fa-ace7-fae3e6d58592 tempest-CinderUnicodeTest-1100710175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a2df16e7-25be-467b-90ab-406d5dfcfabf" returned: 0 in 0.431s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-55ea3270-ccde-43fa-ace7-fae3e6d58592 tempest-CinderUnicodeTest-1100710175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a2df16e7-25be-467b-90ab-406d5dfcfabf.1b2da6f0-2295-4b8f-abef-c63ff54d5b53 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:58 devstack sudo[108914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a2df16e7-25be-467b-90ab-406d5dfcfabf.1b2da6f0-2295-4b8f-abef-c63ff54d5b53 Aug 10 16:15:58 devstack sudo[108914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:58 devstack sudo[108907]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-3fdf92a1-6b84-47e1-bbda-13a5cdbfaead tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-684c2768-c1e1-4bba-881f-7c97a9bb5200,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-684c2768-c1e1-4bba-881f-7c97a9bb5200.b1d7b9c0-dcf4-49db-94be-3bc009b6dfc4 1G" returned: 0 in 0.482s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-3fdf92a1-6b84-47e1-bbda-13a5cdbfaead tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-684c2768-c1e1-4bba-881f-7c97a9bb5200 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-684c2768-c1e1-4bba-881f-7c97a9bb5200.b1d7b9c0-dcf4-49db-94be-3bc009b6dfc4 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:58 devstack sudo[108920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-684c2768-c1e1-4bba-881f-7c97a9bb5200 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-684c2768-c1e1-4bba-881f-7c97a9bb5200.b1d7b9c0-dcf4-49db-94be-3bc009b6dfc4 Aug 10 16:15:58 devstack sudo[108920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:59 devstack sudo[108914]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:59 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-55ea3270-ccde-43fa-ace7-fae3e6d58592 tempest-CinderUnicodeTest-1100710175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a2df16e7-25be-467b-90ab-406d5dfcfabf.1b2da6f0-2295-4b8f-abef-c63ff54d5b53" returned: 0 in 0.380s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:59 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-55ea3270-ccde-43fa-ace7-fae3e6d58592 tempest-CinderUnicodeTest-1100710175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a2df16e7-25be-467b-90ab-406d5dfcfabf.1b2da6f0-2295-4b8f-abef-c63ff54d5b53 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:59 devstack sudo[108923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a2df16e7-25be-467b-90ab-406d5dfcfabf.1b2da6f0-2295-4b8f-abef-c63ff54d5b53 Aug 10 16:15:59 devstack sudo[108923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:59 devstack sudo[108920]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:59 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-3fdf92a1-6b84-47e1-bbda-13a5cdbfaead tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-684c2768-c1e1-4bba-881f-7c97a9bb5200 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-684c2768-c1e1-4bba-881f-7c97a9bb5200.b1d7b9c0-dcf4-49db-94be-3bc009b6dfc4" returned: 0 in 0.330s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:59 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-3fdf92a1-6b84-47e1-bbda-13a5cdbfaead tempest-ProjectMemberTests-715789302 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-684c2768-c1e1-4bba-881f-7c97a9bb5200.b1d7b9c0-dcf4-49db-94be-3bc009b6dfc4 is being set with open permissions: ugo+rw Aug 10 16:15:59 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-3fdf92a1-6b84-47e1-bbda-13a5cdbfaead tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-684c2768-c1e1-4bba-881f-7c97a9bb5200.b1d7b9c0-dcf4-49db-94be-3bc009b6dfc4 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:59 devstack sudo[108963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-684c2768-c1e1-4bba-881f-7c97a9bb5200.b1d7b9c0-dcf4-49db-94be-3bc009b6dfc4 Aug 10 16:15:59 devstack sudo[108963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:59 devstack sudo[108923]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:59 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-55ea3270-ccde-43fa-ace7-fae3e6d58592 tempest-CinderUnicodeTest-1100710175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a2df16e7-25be-467b-90ab-406d5dfcfabf.1b2da6f0-2295-4b8f-abef-c63ff54d5b53" returned: 0 in 0.277s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:59 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-55ea3270-ccde-43fa-ace7-fae3e6d58592 tempest-CinderUnicodeTest-1100710175 None] Lock "cinder-quobyte-1b2da6f0-2295-4b8f-abef-c63ff54d5b53" released by "_delete_snapshot" :: held 1.628s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:15:59 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-55ea3270-ccde-43fa-ace7-fae3e6d58592 tempest-CinderUnicodeTest-1100710175 None] Lock "cinder-quobyte-a2df16e7-25be-467b-90ab-406d5dfcfabf" released by "delete_snapshot" :: held 1.667s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:15:59 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-55ea3270-ccde-43fa-ace7-fae3e6d58592 tempest-CinderUnicodeTest-1100710175 None] Created reservations ['f1253fc0-9aeb-4edd-a528-150e373beacd', '9f6ed0e8-fc24-47ff-88b2-9ca3c541a265', '396b5b26-5da6-4b91-a431-cfdc8d834f46', '68521dd6-2e68-4371-aa22-441943576b5d'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:15:59 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-55ea3270-ccde-43fa-ace7-fae3e6d58592 tempest-CinderUnicodeTest-1100710175 None] Delete snapshot completed successfully. Aug 10 16:15:59 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-55ea3270-ccde-43fa-ace7-fae3e6d58592 tempest-CinderUnicodeTest-1100710175 None] Lock "cinder-1b2da6f0-2295-4b8f-abef-c63ff54d5b53-delete_snapshot" released by "delete_snapshot" :: held 1.843s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:15:59 devstack sudo[108963]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:59 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-3fdf92a1-6b84-47e1-bbda-13a5cdbfaead tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-684c2768-c1e1-4bba-881f-7c97a9bb5200.b1d7b9c0-dcf4-49db-94be-3bc009b6dfc4" returned: 0 in 0.297s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:59 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-3fdf92a1-6b84-47e1-bbda-13a5cdbfaead tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-684c2768-c1e1-4bba-881f-7c97a9bb5200.info {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:59 devstack sudo[108969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-684c2768-c1e1-4bba-881f-7c97a9bb5200.info Aug 10 16:15:59 devstack sudo[108969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:59 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-e6a366b2-baa0-4ffd-9639-ddd12d0ac16f tempest-CinderUnicodeTest-1100710175 None] Acquiring lock "cinder-a2df16e7-25be-467b-90ab-406d5dfcfabf-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:15:59 devstack sudo[108969]: pam_unix(sudo:session): session closed for user root Aug 10 16:15:59 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-3fdf92a1-6b84-47e1-bbda-13a5cdbfaead tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-684c2768-c1e1-4bba-881f-7c97a9bb5200.info" returned: 0 in 0.270s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:15:59 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-3fdf92a1-6b84-47e1-bbda-13a5cdbfaead tempest-ProjectMemberTests-715789302 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-684c2768-c1e1-4bba-881f-7c97a9bb5200.info is being set with open permissions: ugo+rw Aug 10 16:15:59 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-3fdf92a1-6b84-47e1-bbda-13a5cdbfaead tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-684c2768-c1e1-4bba-881f-7c97a9bb5200.info {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:15:59 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-e6a366b2-baa0-4ffd-9639-ddd12d0ac16f tempest-CinderUnicodeTest-1100710175 None] Lock "cinder-a2df16e7-25be-467b-90ab-406d5dfcfabf-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:15:59 devstack sudo[108972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-684c2768-c1e1-4bba-881f-7c97a9bb5200.info Aug 10 16:15:59 devstack sudo[108972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:15:59 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-e6a366b2-baa0-4ffd-9639-ddd12d0ac16f tempest-CinderUnicodeTest-1100710175 None] Acquiring lock "cinder-quobyte-a2df16e7-25be-467b-90ab-406d5dfcfabf" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:15:59 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-e6a366b2-baa0-4ffd-9639-ddd12d0ac16f tempest-CinderUnicodeTest-1100710175 None] Lock "cinder-quobyte-a2df16e7-25be-467b-90ab-406d5dfcfabf" acquired by "delete_volume" :: waited 0.017s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:16:00 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[764b26e2-d9e9-498f-9789-1dd8ba6ec299]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:16:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e6a366b2-baa0-4ffd-9639-ddd12d0ac16f tempest-CinderUnicodeTest-1100710175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a2df16e7-25be-467b-90ab-406d5dfcfabf {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:00 devstack sudo[108974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a2df16e7-25be-467b-90ab-406d5dfcfabf Aug 10 16:16:00 devstack sudo[108974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:00 devstack sudo[108972]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-3fdf92a1-6b84-47e1-bbda-13a5cdbfaead tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-684c2768-c1e1-4bba-881f-7c97a9bb5200.info" returned: 0 in 0.293s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-3fdf92a1-6b84-47e1-bbda-13a5cdbfaead tempest-ProjectMemberTests-715789302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.219s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:16:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-209bccb0-2f9e-4349-9bfd-980d23edcff6 tempest-SnapshotDependencyTests-34318094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.064s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:16:00 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-209bccb0-2f9e-4349-9bfd-980d23edcff6 tempest-SnapshotDependencyTests-34318094 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:15:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1265611264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfe61a71-8201-489b-9afa-70e9c7baeebd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b924fc2e27e47b089913a324591d46e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:15:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:15:58Z,use_quota=True,user_id='b08e56dfda95455d8d749706f0f9e4bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:16:00 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-209bccb0-2f9e-4349-9bfd-980d23edcff6 tempest-SnapshotDependencyTests-34318094 None] Creating volume dfe61a71-8201-489b-9afa-70e9c7baeebd {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:16:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-209bccb0-2f9e-4349-9bfd-980d23edcff6 tempest-SnapshotDependencyTests-34318094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:16:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-209bccb0-2f9e-4349-9bfd-980d23edcff6 tempest-SnapshotDependencyTests-34318094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:16:00 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-209bccb0-2f9e-4349-9bfd-980d23edcff6 tempest-SnapshotDependencyTests-34318094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:16:00 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-209bccb0-2f9e-4349-9bfd-980d23edcff6 tempest-SnapshotDependencyTests-34318094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:16:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-209bccb0-2f9e-4349-9bfd-980d23edcff6 tempest-SnapshotDependencyTests-34318094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:16:00 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-209bccb0-2f9e-4349-9bfd-980d23edcff6 tempest-SnapshotDependencyTests-34318094 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:16:00 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-209bccb0-2f9e-4349-9bfd-980d23edcff6 tempest-SnapshotDependencyTests-34318094 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:16:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-209bccb0-2f9e-4349-9bfd-980d23edcff6 tempest-SnapshotDependencyTests-34318094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-dfe61a71-8201-489b-9afa-70e9c7baeebd 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:00 devstack sudo[108977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-dfe61a71-8201-489b-9afa-70e9c7baeebd 1073741824 Aug 10 16:16:00 devstack sudo[108977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:00 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-3fdf92a1-6b84-47e1-bbda-13a5cdbfaead tempest-ProjectMemberTests-715789302 None] Create snapshot completed successfully Aug 10 16:16:00 devstack sudo[108974]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e6a366b2-baa0-4ffd-9639-ddd12d0ac16f tempest-CinderUnicodeTest-1100710175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a2df16e7-25be-467b-90ab-406d5dfcfabf" returned: 0 in 0.405s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e6a366b2-baa0-4ffd-9639-ddd12d0ac16f tempest-CinderUnicodeTest-1100710175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a2df16e7-25be-467b-90ab-406d5dfcfabf {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:00 devstack sudo[108984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a2df16e7-25be-467b-90ab-406d5dfcfabf Aug 10 16:16:00 devstack sudo[108984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:00 devstack sudo[108977]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-209bccb0-2f9e-4349-9bfd-980d23edcff6 tempest-SnapshotDependencyTests-34318094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-dfe61a71-8201-489b-9afa-70e9c7baeebd 1073741824" returned: 0 in 0.430s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-209bccb0-2f9e-4349-9bfd-980d23edcff6 tempest-SnapshotDependencyTests-34318094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-dfe61a71-8201-489b-9afa-70e9c7baeebd {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:00 devstack sudo[108984]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e6a366b2-baa0-4ffd-9639-ddd12d0ac16f tempest-CinderUnicodeTest-1100710175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a2df16e7-25be-467b-90ab-406d5dfcfabf" returned: 0 in 0.260s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:00 devstack sudo[108988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-dfe61a71-8201-489b-9afa-70e9c7baeebd Aug 10 16:16:00 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-e6a366b2-baa0-4ffd-9639-ddd12d0ac16f tempest-CinderUnicodeTest-1100710175 None] Lock "cinder-quobyte-a2df16e7-25be-467b-90ab-406d5dfcfabf" released by "delete_volume" :: held 0.736s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:16:00 devstack sudo[108988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:00 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-e6a366b2-baa0-4ffd-9639-ddd12d0ac16f tempest-CinderUnicodeTest-1100710175 None] Created reservations ['1437d228-b136-4d6c-8bc0-e5cd3faa4d28', '5b8913cb-2a68-444b-8a1f-d70c53ee2967', 'faaee78a-3554-4fb7-b352-88ab14bd063b', '021bfad2-ed6a-4a4c-9759-dc5a122cb859'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:16:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-e6a366b2-baa0-4ffd-9639-ddd12d0ac16f tempest-CinderUnicodeTest-1100710175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:16:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-e6a366b2-baa0-4ffd-9639-ddd12d0ac16f tempest-CinderUnicodeTest-1100710175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:16:00 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-e6a366b2-baa0-4ffd-9639-ddd12d0ac16f tempest-CinderUnicodeTest-1100710175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:16:00 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-e6a366b2-baa0-4ffd-9639-ddd12d0ac16f tempest-CinderUnicodeTest-1100710175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:16:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-e6a366b2-baa0-4ffd-9639-ddd12d0ac16f tempest-CinderUnicodeTest-1100710175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:16:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e6a366b2-baa0-4ffd-9639-ddd12d0ac16f tempest-CinderUnicodeTest-1100710175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:00 devstack sudo[108990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:16:00 devstack sudo[108990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:00 devstack sudo[108988]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-209bccb0-2f9e-4349-9bfd-980d23edcff6 tempest-SnapshotDependencyTests-34318094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-dfe61a71-8201-489b-9afa-70e9c7baeebd" returned: 0 in 0.293s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:00 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-209bccb0-2f9e-4349-9bfd-980d23edcff6 tempest-SnapshotDependencyTests-34318094 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:16:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-209bccb0-2f9e-4349-9bfd-980d23edcff6 tempest-SnapshotDependencyTests-34318094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:16:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-ae828335-6707-425e-b646-fe066f454897 tempest-ProjectReaderTests-1092271699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.373s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:16:00 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-209bccb0-2f9e-4349-9bfd-980d23edcff6 tempest-SnapshotDependencyTests-34318094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f88077e3-bf8c-4ce3-a6bb-299e34d4ce3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfe61a71-8201-489b-9afa-70e9c7baeebd', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:16:00 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-209bccb0-2f9e-4349-9bfd-980d23edcff6 tempest-SnapshotDependencyTests-34318094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18229ff9-a49b-4024-a158-1fa29aec0055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:16:01 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-ae828335-6707-425e-b646-fe066f454897 tempest-ProjectReaderTests-1092271699 None] Creating offline snapshot 1fbe5e7a-8bee-4a4b-93f1-855741afd07b of volume 00ecf061-e108-4d5e-888a-c239333b7cde {{(pid=88641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 16:16:01 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-f60a2464-9593-41ff-8bc7-a5ca99a6f510 tempest-ProjectMemberTests-715789302 None] Acquiring lock "cinder-b1d7b9c0-dcf4-49db-94be-3bc009b6dfc4-delete_snapshot" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:16:01 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-209bccb0-2f9e-4349-9bfd-980d23edcff6 tempest-SnapshotDependencyTests-34318094 None] Volume volume-dfe61a71-8201-489b-9afa-70e9c7baeebd (dfe61a71-8201-489b-9afa-70e9c7baeebd): created successfully Aug 10 16:16:01 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-209bccb0-2f9e-4349-9bfd-980d23edcff6 tempest-SnapshotDependencyTests-34318094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18229ff9-a49b-4024-a158-1fa29aec0055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:16:01 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-209bccb0-2f9e-4349-9bfd-980d23edcff6 tempest-SnapshotDependencyTests-34318094 None] Flow 'volume_create_manager' (5729a4e9-ec9b-454b-9b33-7cf3cb045c98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:16:01 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[b15242c8-5cd0-4972-a3c4-fc65f5f06714]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:16:01 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ae828335-6707-425e-b646-fe066f454897 tempest-ProjectReaderTests-1092271699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-00ecf061-e108-4d5e-888a-c239333b7cde {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:01 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-f60a2464-9593-41ff-8bc7-a5ca99a6f510 tempest-ProjectMemberTests-715789302 None] Lock "cinder-b1d7b9c0-dcf4-49db-94be-3bc009b6dfc4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.104s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:16:01 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-f60a2464-9593-41ff-8bc7-a5ca99a6f510 tempest-ProjectMemberTests-715789302 None] Acquiring lock "cinder-quobyte-684c2768-c1e1-4bba-881f-7c97a9bb5200" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:16:01 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-209bccb0-2f9e-4349-9bfd-980d23edcff6 tempest-SnapshotDependencyTests-34318094 None] Created volume successfully. Aug 10 16:16:01 devstack sudo[108990]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:01 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-293da20a-b842-429e-93b9-d453f7bd6f3c tempest-CinderUnicodeTest-1100710175 None] Acquiring lock "cinder-8af5d2d6-df92-4b4e-8f69-4002447e618e-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:16:01 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e6a366b2-baa0-4ffd-9639-ddd12d0ac16f tempest-CinderUnicodeTest-1100710175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.339s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:01 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-e6a366b2-baa0-4ffd-9639-ddd12d0ac16f tempest-CinderUnicodeTest-1100710175 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:16:01 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-f60a2464-9593-41ff-8bc7-a5ca99a6f510 tempest-ProjectMemberTests-715789302 None] Lock "cinder-quobyte-684c2768-c1e1-4bba-881f-7c97a9bb5200" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:16:01 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-f60a2464-9593-41ff-8bc7-a5ca99a6f510 tempest-ProjectMemberTests-715789302 None] Acquiring lock "cinder-quobyte-b1d7b9c0-dcf4-49db-94be-3bc009b6dfc4" by "_delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:16:01 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-e6a366b2-baa0-4ffd-9639-ddd12d0ac16f tempest-CinderUnicodeTest-1100710175 None] Deleted volume successfully. Aug 10 16:16:01 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-293da20a-b842-429e-93b9-d453f7bd6f3c tempest-CinderUnicodeTest-1100710175 None] Lock "cinder-8af5d2d6-df92-4b4e-8f69-4002447e618e-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:16:01 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-f60a2464-9593-41ff-8bc7-a5ca99a6f510 tempest-ProjectMemberTests-715789302 None] Lock "cinder-quobyte-b1d7b9c0-dcf4-49db-94be-3bc009b6dfc4" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:16:01 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-f60a2464-9593-41ff-8bc7-a5ca99a6f510 tempest-ProjectMemberTests-715789302 None] Deleting offline snapshot b1d7b9c0-dcf4-49db-94be-3bc009b6dfc4 of volume 684c2768-c1e1-4bba-881f-7c97a9bb5200 {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 16:16:01 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-f60a2464-9593-41ff-8bc7-a5ca99a6f510 tempest-ProjectMemberTests-715789302 None] snapshot_file for this snap is: volume-684c2768-c1e1-4bba-881f-7c97a9bb5200.b1d7b9c0-dcf4-49db-94be-3bc009b6dfc4 {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 16:16:01 devstack sudo[108993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-00ecf061-e108-4d5e-888a-c239333b7cde Aug 10 16:16:01 devstack sudo[108993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:01 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-e6a366b2-baa0-4ffd-9639-ddd12d0ac16f tempest-CinderUnicodeTest-1100710175 None] Lock "cinder-a2df16e7-25be-467b-90ab-406d5dfcfabf-delete_volume" released by "delete_volume" :: held 1.355s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:16:01 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[585bbc37-b709-4deb-9b2d-63473b492427]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:16:01 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-f60a2464-9593-41ff-8bc7-a5ca99a6f510 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-684c2768-c1e1-4bba-881f-7c97a9bb5200.b1d7b9c0-dcf4-49db-94be-3bc009b6dfc4 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:01 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-293da20a-b842-429e-93b9-d453f7bd6f3c tempest-CinderUnicodeTest-1100710175 None] Acquiring lock "cinder-quobyte-8af5d2d6-df92-4b4e-8f69-4002447e618e" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:16:01 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-293da20a-b842-429e-93b9-d453f7bd6f3c tempest-CinderUnicodeTest-1100710175 None] Lock "cinder-quobyte-8af5d2d6-df92-4b4e-8f69-4002447e618e" acquired by "delete_volume" :: waited 0.019s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:16:01 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a9a4889-f063-44ab-966e-1d0ac7a949da]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:16:01 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-293da20a-b842-429e-93b9-d453f7bd6f3c tempest-CinderUnicodeTest-1100710175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-8af5d2d6-df92-4b4e-8f69-4002447e618e {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:01 devstack sudo[108996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-684c2768-c1e1-4bba-881f-7c97a9bb5200.b1d7b9c0-dcf4-49db-94be-3bc009b6dfc4 Aug 10 16:16:01 devstack sudo[108996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:01 devstack sudo[108997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-8af5d2d6-df92-4b4e-8f69-4002447e618e Aug 10 16:16:01 devstack sudo[108997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:01 devstack sudo[108993]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:01 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ae828335-6707-425e-b646-fe066f454897 tempest-ProjectReaderTests-1092271699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-00ecf061-e108-4d5e-888a-c239333b7cde" returned: 0 in 0.456s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:01 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ae828335-6707-425e-b646-fe066f454897 tempest-ProjectReaderTests-1092271699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-00ecf061-e108-4d5e-888a-c239333b7cde,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-00ecf061-e108-4d5e-888a-c239333b7cde.1fbe5e7a-8bee-4a4b-93f1-855741afd07b 1G {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:01 devstack sudo[109003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-00ecf061-e108-4d5e-888a-c239333b7cde,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-00ecf061-e108-4d5e-888a-c239333b7cde.1fbe5e7a-8bee-4a4b-93f1-855741afd07b 1G Aug 10 16:16:01 devstack sudo[109003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:01 devstack sudo[108996]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:01 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-f60a2464-9593-41ff-8bc7-a5ca99a6f510 tempest-ProjectMemberTests-715789302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-684c2768-c1e1-4bba-881f-7c97a9bb5200.b1d7b9c0-dcf4-49db-94be-3bc009b6dfc4" returned: 0 in 0.433s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:01 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-f60a2464-9593-41ff-8bc7-a5ca99a6f510 tempest-ProjectMemberTests-715789302 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-684c2768-c1e1-4bba-881f-7c97a9bb5200(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 16:16:01 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d1003da-a463-4686-a086-a2d9ce0d19ef]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:16:01 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-f60a2464-9593-41ff-8bc7-a5ca99a6f510 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-684c2768-c1e1-4bba-881f-7c97a9bb5200 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:01 devstack sudo[108997]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:01 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-293da20a-b842-429e-93b9-d453f7bd6f3c tempest-CinderUnicodeTest-1100710175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-8af5d2d6-df92-4b4e-8f69-4002447e618e" returned: 0 in 0.437s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:01 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-293da20a-b842-429e-93b9-d453f7bd6f3c tempest-CinderUnicodeTest-1100710175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-8af5d2d6-df92-4b4e-8f69-4002447e618e {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:01 devstack sudo[109014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-8af5d2d6-df92-4b4e-8f69-4002447e618e Aug 10 16:16:01 devstack sudo[109014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:01 devstack sudo[109011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-684c2768-c1e1-4bba-881f-7c97a9bb5200 Aug 10 16:16:01 devstack sudo[109011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:01 devstack sudo[109003]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:01 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ae828335-6707-425e-b646-fe066f454897 tempest-ProjectReaderTests-1092271699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-00ecf061-e108-4d5e-888a-c239333b7cde,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-00ecf061-e108-4d5e-888a-c239333b7cde.1fbe5e7a-8bee-4a4b-93f1-855741afd07b 1G" returned: 0 in 0.451s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:01 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ae828335-6707-425e-b646-fe066f454897 tempest-ProjectReaderTests-1092271699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00ecf061-e108-4d5e-888a-c239333b7cde -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-00ecf061-e108-4d5e-888a-c239333b7cde.1fbe5e7a-8bee-4a4b-93f1-855741afd07b {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:02 devstack sudo[109019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00ecf061-e108-4d5e-888a-c239333b7cde -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-00ecf061-e108-4d5e-888a-c239333b7cde.1fbe5e7a-8bee-4a4b-93f1-855741afd07b Aug 10 16:16:02 devstack sudo[109019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:02 devstack sudo[109014]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-293da20a-b842-429e-93b9-d453f7bd6f3c tempest-CinderUnicodeTest-1100710175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-8af5d2d6-df92-4b4e-8f69-4002447e618e" returned: 0 in 0.271s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:02 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-293da20a-b842-429e-93b9-d453f7bd6f3c tempest-CinderUnicodeTest-1100710175 None] Lock "cinder-quobyte-8af5d2d6-df92-4b4e-8f69-4002447e618e" released by "delete_volume" :: held 0.759s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:16:02 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-293da20a-b842-429e-93b9-d453f7bd6f3c tempest-CinderUnicodeTest-1100710175 None] Created reservations ['3b030c25-07f9-4de4-8e1b-caa59b1ec15a', '08cc50b4-ea56-4007-8cd8-524ea9f35cf7', 'c6c33007-d166-4e1a-9691-3fd4a600c7e0', '839dfba8-2940-4cf3-ba5d-243e154436c9'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:16:02 devstack sudo[109011]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-f60a2464-9593-41ff-8bc7-a5ca99a6f510 tempest-ProjectMemberTests-715789302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-684c2768-c1e1-4bba-881f-7c97a9bb5200" returned: 0 in 0.426s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-f60a2464-9593-41ff-8bc7-a5ca99a6f510 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-684c2768-c1e1-4bba-881f-7c97a9bb5200.b1d7b9c0-dcf4-49db-94be-3bc009b6dfc4 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:02 devstack sudo[109026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-684c2768-c1e1-4bba-881f-7c97a9bb5200.b1d7b9c0-dcf4-49db-94be-3bc009b6dfc4 Aug 10 16:16:02 devstack sudo[109026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-293da20a-b842-429e-93b9-d453f7bd6f3c tempest-CinderUnicodeTest-1100710175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:16:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-293da20a-b842-429e-93b9-d453f7bd6f3c tempest-CinderUnicodeTest-1100710175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:16:02 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-293da20a-b842-429e-93b9-d453f7bd6f3c tempest-CinderUnicodeTest-1100710175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:16:02 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-293da20a-b842-429e-93b9-d453f7bd6f3c tempest-CinderUnicodeTest-1100710175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:16:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-293da20a-b842-429e-93b9-d453f7bd6f3c tempest-CinderUnicodeTest-1100710175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:16:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-293da20a-b842-429e-93b9-d453f7bd6f3c tempest-CinderUnicodeTest-1100710175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:02 devstack sudo[109030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:16:02 devstack sudo[109030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:02 devstack sudo[109019]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ae828335-6707-425e-b646-fe066f454897 tempest-ProjectReaderTests-1092271699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00ecf061-e108-4d5e-888a-c239333b7cde -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-00ecf061-e108-4d5e-888a-c239333b7cde.1fbe5e7a-8bee-4a4b-93f1-855741afd07b" returned: 0 in 0.391s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:02 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-ae828335-6707-425e-b646-fe066f454897 tempest-ProjectReaderTests-1092271699 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-00ecf061-e108-4d5e-888a-c239333b7cde.1fbe5e7a-8bee-4a4b-93f1-855741afd07b is being set with open permissions: ugo+rw Aug 10 16:16:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ae828335-6707-425e-b646-fe066f454897 tempest-ProjectReaderTests-1092271699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-00ecf061-e108-4d5e-888a-c239333b7cde.1fbe5e7a-8bee-4a4b-93f1-855741afd07b {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:02 devstack sudo[109033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-00ecf061-e108-4d5e-888a-c239333b7cde.1fbe5e7a-8bee-4a4b-93f1-855741afd07b Aug 10 16:16:02 devstack sudo[109033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:02 devstack sudo[109026]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-329cbbb6-5718-4d5d-8d44-cb84f902a29c tempest-SnapshotDependencyTests-34318094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:16:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-f60a2464-9593-41ff-8bc7-a5ca99a6f510 tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-684c2768-c1e1-4bba-881f-7c97a9bb5200.b1d7b9c0-dcf4-49db-94be-3bc009b6dfc4" returned: 0 in 0.577s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-f60a2464-9593-41ff-8bc7-a5ca99a6f510 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-684c2768-c1e1-4bba-881f-7c97a9bb5200.b1d7b9c0-dcf4-49db-94be-3bc009b6dfc4 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:02 devstack sudo[109030]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-293da20a-b842-429e-93b9-d453f7bd6f3c tempest-CinderUnicodeTest-1100710175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.501s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:02 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-293da20a-b842-429e-93b9-d453f7bd6f3c tempest-CinderUnicodeTest-1100710175 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:16:02 devstack sudo[109040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-684c2768-c1e1-4bba-881f-7c97a9bb5200.b1d7b9c0-dcf4-49db-94be-3bc009b6dfc4 Aug 10 16:16:02 devstack sudo[109040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:02 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-293da20a-b842-429e-93b9-d453f7bd6f3c tempest-CinderUnicodeTest-1100710175 None] Deleted volume successfully. Aug 10 16:16:02 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-293da20a-b842-429e-93b9-d453f7bd6f3c tempest-CinderUnicodeTest-1100710175 None] Lock "cinder-8af5d2d6-df92-4b4e-8f69-4002447e618e-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:16:02 devstack sudo[109033]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ae828335-6707-425e-b646-fe066f454897 tempest-ProjectReaderTests-1092271699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-00ecf061-e108-4d5e-888a-c239333b7cde.1fbe5e7a-8bee-4a4b-93f1-855741afd07b" returned: 0 in 0.452s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ae828335-6707-425e-b646-fe066f454897 tempest-ProjectReaderTests-1092271699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-00ecf061-e108-4d5e-888a-c239333b7cde.info {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:02 devstack sudo[109043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-00ecf061-e108-4d5e-888a-c239333b7cde.info Aug 10 16:16:02 devstack sudo[109043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:03 devstack sudo[109040]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-f60a2464-9593-41ff-8bc7-a5ca99a6f510 tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-684c2768-c1e1-4bba-881f-7c97a9bb5200.b1d7b9c0-dcf4-49db-94be-3bc009b6dfc4" returned: 0 in 0.285s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:03 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-f60a2464-9593-41ff-8bc7-a5ca99a6f510 tempest-ProjectMemberTests-715789302 None] Lock "cinder-quobyte-b1d7b9c0-dcf4-49db-94be-3bc009b6dfc4" released by "_delete_snapshot" :: held 1.856s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:16:03 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-f60a2464-9593-41ff-8bc7-a5ca99a6f510 tempest-ProjectMemberTests-715789302 None] Lock "cinder-quobyte-684c2768-c1e1-4bba-881f-7c97a9bb5200" released by "delete_snapshot" :: held 1.905s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:16:03 devstack sudo[109043]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ae828335-6707-425e-b646-fe066f454897 tempest-ProjectReaderTests-1092271699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-00ecf061-e108-4d5e-888a-c239333b7cde.info" returned: 0 in 0.292s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:03 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-ae828335-6707-425e-b646-fe066f454897 tempest-ProjectReaderTests-1092271699 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-00ecf061-e108-4d5e-888a-c239333b7cde.info is being set with open permissions: ugo+rw Aug 10 16:16:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ae828335-6707-425e-b646-fe066f454897 tempest-ProjectReaderTests-1092271699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-00ecf061-e108-4d5e-888a-c239333b7cde.info {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:03 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-f60a2464-9593-41ff-8bc7-a5ca99a6f510 tempest-ProjectMemberTests-715789302 None] Created reservations ['cb56483e-a6a1-4a8c-a136-447fc78f2b44', '2e849a53-0668-4ee2-b23a-dd53addb7c6a', '1d1bc961-e229-4ef2-b94a-d83d03d76a51', 'bb2422a1-dc83-431e-89ed-caab93cf91c7'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:16:03 devstack sudo[109047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-00ecf061-e108-4d5e-888a-c239333b7cde.info Aug 10 16:16:03 devstack sudo[109047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:03 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-f60a2464-9593-41ff-8bc7-a5ca99a6f510 tempest-ProjectMemberTests-715789302 None] Delete snapshot completed successfully. Aug 10 16:16:03 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-f60a2464-9593-41ff-8bc7-a5ca99a6f510 tempest-ProjectMemberTests-715789302 None] Lock "cinder-b1d7b9c0-dcf4-49db-94be-3bc009b6dfc4-delete_snapshot" released by "delete_snapshot" :: held 2.126s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:16:03 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-105781f4-6103-4767-8f49-270eaa3332ed tempest-ProjectMemberTests-715789302 None] Acquiring lock "cinder-684c2768-c1e1-4bba-881f-7c97a9bb5200-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:16:03 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-105781f4-6103-4767-8f49-270eaa3332ed tempest-ProjectMemberTests-715789302 None] Lock "cinder-684c2768-c1e1-4bba-881f-7c97a9bb5200-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:16:03 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-105781f4-6103-4767-8f49-270eaa3332ed tempest-ProjectMemberTests-715789302 None] Acquiring lock "cinder-quobyte-684c2768-c1e1-4bba-881f-7c97a9bb5200" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:16:03 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-105781f4-6103-4767-8f49-270eaa3332ed tempest-ProjectMemberTests-715789302 None] Lock "cinder-quobyte-684c2768-c1e1-4bba-881f-7c97a9bb5200" acquired by "delete_volume" :: waited 0.019s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:16:03 devstack sudo[109047]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ae828335-6707-425e-b646-fe066f454897 tempest-ProjectReaderTests-1092271699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-00ecf061-e108-4d5e-888a-c239333b7cde.info" returned: 0 in 0.319s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-ae828335-6707-425e-b646-fe066f454897 tempest-ProjectReaderTests-1092271699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.521s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:16:03 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ec573a-87f2-4b5c-b8a3-9640208f9d93]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:16:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-329cbbb6-5718-4d5d-8d44-cb84f902a29c tempest-SnapshotDependencyTests-34318094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.770s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:16:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-105781f4-6103-4767-8f49-270eaa3332ed tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-684c2768-c1e1-4bba-881f-7c97a9bb5200 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:03 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-329cbbb6-5718-4d5d-8d44-cb84f902a29c tempest-SnapshotDependencyTests-34318094 None] Creating offline snapshot b8d17c58-e1b9-4c72-ab15-c6b78a1ef232 of volume dfe61a71-8201-489b-9afa-70e9c7baeebd {{(pid=88641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 16:16:03 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-ae828335-6707-425e-b646-fe066f454897 tempest-ProjectReaderTests-1092271699 None] Create snapshot completed successfully Aug 10 16:16:03 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[3abfddfa-1b70-4bbd-b974-f1d50a60358e]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:16:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-329cbbb6-5718-4d5d-8d44-cb84f902a29c tempest-SnapshotDependencyTests-34318094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-dfe61a71-8201-489b-9afa-70e9c7baeebd {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:03 devstack sudo[109050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-684c2768-c1e1-4bba-881f-7c97a9bb5200 Aug 10 16:16:03 devstack sudo[109050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:03 devstack sudo[109051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-dfe61a71-8201-489b-9afa-70e9c7baeebd Aug 10 16:16:03 devstack sudo[109051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:03 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-4999189e-9b02-43f3-8a6c-a843889235fc tempest-ProjectReaderTests-1092271699 None] Acquiring lock "cinder-1fbe5e7a-8bee-4a4b-93f1-855741afd07b-delete_snapshot" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:16:03 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-4999189e-9b02-43f3-8a6c-a843889235fc tempest-ProjectReaderTests-1092271699 None] Lock "cinder-1fbe5e7a-8bee-4a4b-93f1-855741afd07b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:16:03 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-4999189e-9b02-43f3-8a6c-a843889235fc tempest-ProjectReaderTests-1092271699 None] Acquiring lock "cinder-quobyte-00ecf061-e108-4d5e-888a-c239333b7cde" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:16:03 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-4999189e-9b02-43f3-8a6c-a843889235fc tempest-ProjectReaderTests-1092271699 None] Lock "cinder-quobyte-00ecf061-e108-4d5e-888a-c239333b7cde" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:16:03 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-4999189e-9b02-43f3-8a6c-a843889235fc tempest-ProjectReaderTests-1092271699 None] Acquiring lock "cinder-quobyte-1fbe5e7a-8bee-4a4b-93f1-855741afd07b" by "_delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:16:03 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-4999189e-9b02-43f3-8a6c-a843889235fc tempest-ProjectReaderTests-1092271699 None] Lock "cinder-quobyte-1fbe5e7a-8bee-4a4b-93f1-855741afd07b" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:16:04 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-4999189e-9b02-43f3-8a6c-a843889235fc tempest-ProjectReaderTests-1092271699 None] Deleting offline snapshot 1fbe5e7a-8bee-4a4b-93f1-855741afd07b of volume 00ecf061-e108-4d5e-888a-c239333b7cde {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 16:16:04 devstack sudo[109050]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:04 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-4999189e-9b02-43f3-8a6c-a843889235fc tempest-ProjectReaderTests-1092271699 None] snapshot_file for this snap is: volume-00ecf061-e108-4d5e-888a-c239333b7cde.1fbe5e7a-8bee-4a4b-93f1-855741afd07b {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 16:16:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-105781f4-6103-4767-8f49-270eaa3332ed tempest-ProjectMemberTests-715789302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-684c2768-c1e1-4bba-881f-7c97a9bb5200" returned: 0 in 0.540s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-105781f4-6103-4767-8f49-270eaa3332ed tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-684c2768-c1e1-4bba-881f-7c97a9bb5200 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:04 devstack sudo[109051]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:04 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e24491-e2fc-488b-877a-445c46cd8060]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:16:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4999189e-9b02-43f3-8a6c-a843889235fc tempest-ProjectReaderTests-1092271699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-00ecf061-e108-4d5e-888a-c239333b7cde.1fbe5e7a-8bee-4a4b-93f1-855741afd07b {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-329cbbb6-5718-4d5d-8d44-cb84f902a29c tempest-SnapshotDependencyTests-34318094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-dfe61a71-8201-489b-9afa-70e9c7baeebd" returned: 0 in 0.510s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-329cbbb6-5718-4d5d-8d44-cb84f902a29c tempest-SnapshotDependencyTests-34318094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-dfe61a71-8201-489b-9afa-70e9c7baeebd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-dfe61a71-8201-489b-9afa-70e9c7baeebd.b8d17c58-e1b9-4c72-ab15-c6b78a1ef232 1G {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:04 devstack sudo[109061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-684c2768-c1e1-4bba-881f-7c97a9bb5200 Aug 10 16:16:04 devstack sudo[109061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:04 devstack sudo[109064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-dfe61a71-8201-489b-9afa-70e9c7baeebd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-dfe61a71-8201-489b-9afa-70e9c7baeebd.b8d17c58-e1b9-4c72-ab15-c6b78a1ef232 1G Aug 10 16:16:04 devstack sudo[109064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:04 devstack sudo[109062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-00ecf061-e108-4d5e-888a-c239333b7cde.1fbe5e7a-8bee-4a4b-93f1-855741afd07b Aug 10 16:16:04 devstack sudo[109062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:04 devstack sudo[109061]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-105781f4-6103-4767-8f49-270eaa3332ed tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-684c2768-c1e1-4bba-881f-7c97a9bb5200" returned: 0 in 0.328s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:04 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-105781f4-6103-4767-8f49-270eaa3332ed tempest-ProjectMemberTests-715789302 None] Lock "cinder-quobyte-684c2768-c1e1-4bba-881f-7c97a9bb5200" released by "delete_volume" :: held 0.959s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:16:04 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-105781f4-6103-4767-8f49-270eaa3332ed tempest-ProjectMemberTests-715789302 None] Created reservations ['f81ee162-5d05-4396-9733-361ab6679322', '5002c62f-96c9-40ba-826c-0e9fb9aba1d7', 'a82bf962-4437-4fc3-9828-48bd01fa6641', '0ff6e43c-0970-4718-97dd-89a71f3b25a2'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:16:04 devstack sudo[109062]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4999189e-9b02-43f3-8a6c-a843889235fc tempest-ProjectReaderTests-1092271699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-00ecf061-e108-4d5e-888a-c239333b7cde.1fbe5e7a-8bee-4a4b-93f1-855741afd07b" returned: 0 in 0.478s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:04 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-4999189e-9b02-43f3-8a6c-a843889235fc tempest-ProjectReaderTests-1092271699 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-00ecf061-e108-4d5e-888a-c239333b7cde(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 16:16:04 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[691e325a-2ecd-470c-9101-62b604352d5e]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:16:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4999189e-9b02-43f3-8a6c-a843889235fc tempest-ProjectReaderTests-1092271699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-00ecf061-e108-4d5e-888a-c239333b7cde {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:04 devstack sudo[109064]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-329cbbb6-5718-4d5d-8d44-cb84f902a29c tempest-SnapshotDependencyTests-34318094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-dfe61a71-8201-489b-9afa-70e9c7baeebd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-dfe61a71-8201-489b-9afa-70e9c7baeebd.b8d17c58-e1b9-4c72-ab15-c6b78a1ef232 1G" returned: 0 in 0.519s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-329cbbb6-5718-4d5d-8d44-cb84f902a29c tempest-SnapshotDependencyTests-34318094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfe61a71-8201-489b-9afa-70e9c7baeebd -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-dfe61a71-8201-489b-9afa-70e9c7baeebd.b8d17c58-e1b9-4c72-ab15-c6b78a1ef232 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-105781f4-6103-4767-8f49-270eaa3332ed tempest-ProjectMemberTests-715789302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:16:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-105781f4-6103-4767-8f49-270eaa3332ed tempest-ProjectMemberTests-715789302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:16:04 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-105781f4-6103-4767-8f49-270eaa3332ed tempest-ProjectMemberTests-715789302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:16:04 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-105781f4-6103-4767-8f49-270eaa3332ed tempest-ProjectMemberTests-715789302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:16:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-105781f4-6103-4767-8f49-270eaa3332ed tempest-ProjectMemberTests-715789302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:16:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-105781f4-6103-4767-8f49-270eaa3332ed tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:04 devstack sudo[109076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfe61a71-8201-489b-9afa-70e9c7baeebd -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-dfe61a71-8201-489b-9afa-70e9c7baeebd.b8d17c58-e1b9-4c72-ab15-c6b78a1ef232 Aug 10 16:16:04 devstack sudo[109076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:04 devstack sudo[109077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:16:04 devstack sudo[109077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:04 devstack sudo[109075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-00ecf061-e108-4d5e-888a-c239333b7cde Aug 10 16:16:04 devstack sudo[109075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:04 devstack sudo[109077]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-105781f4-6103-4767-8f49-270eaa3332ed tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.307s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:04 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-105781f4-6103-4767-8f49-270eaa3332ed tempest-ProjectMemberTests-715789302 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:16:04 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-105781f4-6103-4767-8f49-270eaa3332ed tempest-ProjectMemberTests-715789302 None] Deleted volume successfully. Aug 10 16:16:04 devstack sudo[109076]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:04 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-105781f4-6103-4767-8f49-270eaa3332ed tempest-ProjectMemberTests-715789302 None] Lock "cinder-684c2768-c1e1-4bba-881f-7c97a9bb5200-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:16:05 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-329cbbb6-5718-4d5d-8d44-cb84f902a29c tempest-SnapshotDependencyTests-34318094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfe61a71-8201-489b-9afa-70e9c7baeebd -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-dfe61a71-8201-489b-9afa-70e9c7baeebd.b8d17c58-e1b9-4c72-ab15-c6b78a1ef232" returned: 0 in 0.410s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:05 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-329cbbb6-5718-4d5d-8d44-cb84f902a29c tempest-SnapshotDependencyTests-34318094 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-dfe61a71-8201-489b-9afa-70e9c7baeebd.b8d17c58-e1b9-4c72-ab15-c6b78a1ef232 is being set with open permissions: ugo+rw Aug 10 16:16:05 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-329cbbb6-5718-4d5d-8d44-cb84f902a29c tempest-SnapshotDependencyTests-34318094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-dfe61a71-8201-489b-9afa-70e9c7baeebd.b8d17c58-e1b9-4c72-ab15-c6b78a1ef232 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:05 devstack sudo[109075]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:05 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4999189e-9b02-43f3-8a6c-a843889235fc tempest-ProjectReaderTests-1092271699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-00ecf061-e108-4d5e-888a-c239333b7cde" returned: 0 in 0.443s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:05 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4999189e-9b02-43f3-8a6c-a843889235fc tempest-ProjectReaderTests-1092271699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-00ecf061-e108-4d5e-888a-c239333b7cde.1fbe5e7a-8bee-4a4b-93f1-855741afd07b {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:05 devstack sudo[109089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-dfe61a71-8201-489b-9afa-70e9c7baeebd.b8d17c58-e1b9-4c72-ab15-c6b78a1ef232 Aug 10 16:16:05 devstack sudo[109089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:05 devstack sudo[109091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-00ecf061-e108-4d5e-888a-c239333b7cde.1fbe5e7a-8bee-4a4b-93f1-855741afd07b Aug 10 16:16:05 devstack sudo[109091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:05 devstack sudo[109089]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:05 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-329cbbb6-5718-4d5d-8d44-cb84f902a29c tempest-SnapshotDependencyTests-34318094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-dfe61a71-8201-489b-9afa-70e9c7baeebd.b8d17c58-e1b9-4c72-ab15-c6b78a1ef232" returned: 0 in 0.289s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:05 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-329cbbb6-5718-4d5d-8d44-cb84f902a29c tempest-SnapshotDependencyTests-34318094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-dfe61a71-8201-489b-9afa-70e9c7baeebd.info {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:05 devstack sudo[109098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-dfe61a71-8201-489b-9afa-70e9c7baeebd.info Aug 10 16:16:05 devstack sudo[109098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:05 devstack sudo[109091]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:05 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4999189e-9b02-43f3-8a6c-a843889235fc tempest-ProjectReaderTests-1092271699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-00ecf061-e108-4d5e-888a-c239333b7cde.1fbe5e7a-8bee-4a4b-93f1-855741afd07b" returned: 0 in 0.414s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:05 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4999189e-9b02-43f3-8a6c-a843889235fc tempest-ProjectReaderTests-1092271699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-00ecf061-e108-4d5e-888a-c239333b7cde.1fbe5e7a-8bee-4a4b-93f1-855741afd07b {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:05 devstack sudo[109100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-00ecf061-e108-4d5e-888a-c239333b7cde.1fbe5e7a-8bee-4a4b-93f1-855741afd07b Aug 10 16:16:05 devstack sudo[109100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:05 devstack sudo[109098]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:05 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-329cbbb6-5718-4d5d-8d44-cb84f902a29c tempest-SnapshotDependencyTests-34318094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-dfe61a71-8201-489b-9afa-70e9c7baeebd.info" returned: 0 in 0.312s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:05 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-329cbbb6-5718-4d5d-8d44-cb84f902a29c tempest-SnapshotDependencyTests-34318094 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-dfe61a71-8201-489b-9afa-70e9c7baeebd.info is being set with open permissions: ugo+rw Aug 10 16:16:05 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-329cbbb6-5718-4d5d-8d44-cb84f902a29c tempest-SnapshotDependencyTests-34318094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-dfe61a71-8201-489b-9afa-70e9c7baeebd.info {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:05 devstack sudo[109103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-dfe61a71-8201-489b-9afa-70e9c7baeebd.info Aug 10 16:16:05 devstack sudo[109103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:05 devstack sudo[109100]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:05 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4999189e-9b02-43f3-8a6c-a843889235fc tempest-ProjectReaderTests-1092271699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-00ecf061-e108-4d5e-888a-c239333b7cde.1fbe5e7a-8bee-4a4b-93f1-855741afd07b" returned: 0 in 0.308s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:05 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-4999189e-9b02-43f3-8a6c-a843889235fc tempest-ProjectReaderTests-1092271699 None] Lock "cinder-quobyte-1fbe5e7a-8bee-4a4b-93f1-855741afd07b" released by "_delete_snapshot" :: held 1.792s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:16:05 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-4999189e-9b02-43f3-8a6c-a843889235fc tempest-ProjectReaderTests-1092271699 None] Lock "cinder-quobyte-00ecf061-e108-4d5e-888a-c239333b7cde" released by "delete_snapshot" :: held 1.831s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:16:05 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-4999189e-9b02-43f3-8a6c-a843889235fc tempest-ProjectReaderTests-1092271699 None] Created reservations ['df228f52-7606-40ff-9b19-9e27e8048b23', '94483bb4-c4c9-4318-ac4f-678683cda1d9', 'c4938d72-f406-4557-a6fc-77dbf2ba385f', '0b48c9c7-ccdb-4246-a67d-c49b78b9a6b4'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:16:06 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-4999189e-9b02-43f3-8a6c-a843889235fc tempest-ProjectReaderTests-1092271699 None] Delete snapshot completed successfully. Aug 10 16:16:06 devstack sudo[109103]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:06 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-4999189e-9b02-43f3-8a6c-a843889235fc tempest-ProjectReaderTests-1092271699 None] Lock "cinder-1fbe5e7a-8bee-4a4b-93f1-855741afd07b-delete_snapshot" released by "delete_snapshot" :: held 2.113s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:16:06 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-329cbbb6-5718-4d5d-8d44-cb84f902a29c tempest-SnapshotDependencyTests-34318094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-dfe61a71-8201-489b-9afa-70e9c7baeebd.info" returned: 0 in 0.414s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:06 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-329cbbb6-5718-4d5d-8d44-cb84f902a29c tempest-SnapshotDependencyTests-34318094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.590s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:16:06 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-329cbbb6-5718-4d5d-8d44-cb84f902a29c tempest-SnapshotDependencyTests-34318094 None] Create snapshot completed successfully Aug 10 16:16:06 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a73632b-f1f3-4aca-9a04-0b4270992493 tempest-ProjectMemberTests-715789302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:16:06 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-8a73632b-f1f3-4aca-9a04-0b4270992493 tempest-ProjectMemberTests-715789302 None] Flow 'volume_create_manager' (a6f73a07-ead1-47e4-b719-30e35aa779f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:16:06 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-8a73632b-f1f3-4aca-9a04-0b4270992493 tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b87eb22a-426a-4d11-950a-33b6a95ba742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:16:06 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-cef74811-3506-436e-892a-3804d6ebf0f5 tempest-ProjectReaderTests-1092271699 None] Acquiring lock "cinder-00ecf061-e108-4d5e-888a-c239333b7cde-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:16:06 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-8a73632b-f1f3-4aca-9a04-0b4270992493 tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b87eb22a-426a-4d11-950a-33b6a95ba742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:16:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2122537465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=981d08c9-1150-4603-b14e-05ed00ceaa98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8408ad471876405b8109f4d45d4a242d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:16:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:16:06Z,use_quota=True,user_id='dc958e8abfdb43a69a4609f15eb8d6d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:16:06 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-8a73632b-f1f3-4aca-9a04-0b4270992493 tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4724b1d-2efb-4d8f-8b82-e3dc1fab44da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:16:06 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-8a73632b-f1f3-4aca-9a04-0b4270992493 tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4724b1d-2efb-4d8f-8b82-e3dc1fab44da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:16:06 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-8a73632b-f1f3-4aca-9a04-0b4270992493 tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (338c03ec-7215-4fe4-a3c6-3884afc66a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:16:06 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-8a73632b-f1f3-4aca-9a04-0b4270992493 tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (338c03ec-7215-4fe4-a3c6-3884afc66a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '981d08c9-1150-4603-b14e-05ed00ceaa98', 'volume_name': 'volume-981d08c9-1150-4603-b14e-05ed00ceaa98', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:16:06 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-8a73632b-f1f3-4aca-9a04-0b4270992493 tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b643b2d-f71b-4940-874d-94195e587de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:16:06 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-8a73632b-f1f3-4aca-9a04-0b4270992493 tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b643b2d-f71b-4940-874d-94195e587de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:16:06 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-8a73632b-f1f3-4aca-9a04-0b4270992493 tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9343198-a0cb-408a-affa-470f5e94b264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:16:06 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-8a73632b-f1f3-4aca-9a04-0b4270992493 tempest-ProjectMemberTests-715789302 None] Volume 981d08c9-1150-4603-b14e-05ed00ceaa98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-981d08c9-1150-4603-b14e-05ed00ceaa98', 'volume_size': 1} Aug 10 16:16:06 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-8a73632b-f1f3-4aca-9a04-0b4270992493 tempest-ProjectMemberTests-715789302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:16:06 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-8a73632b-f1f3-4aca-9a04-0b4270992493 tempest-ProjectMemberTests-715789302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:16:06 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-8a73632b-f1f3-4aca-9a04-0b4270992493 tempest-ProjectMemberTests-715789302 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:16:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2122537465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=981d08c9-1150-4603-b14e-05ed00ceaa98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8408ad471876405b8109f4d45d4a242d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:16:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:16:06Z,use_quota=True,user_id='dc958e8abfdb43a69a4609f15eb8d6d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:16:06 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-8a73632b-f1f3-4aca-9a04-0b4270992493 tempest-ProjectMemberTests-715789302 None] Creating volume 981d08c9-1150-4603-b14e-05ed00ceaa98 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:16:06 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-8a73632b-f1f3-4aca-9a04-0b4270992493 tempest-ProjectMemberTests-715789302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:16:06 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-8a73632b-f1f3-4aca-9a04-0b4270992493 tempest-ProjectMemberTests-715789302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:16:06 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-8a73632b-f1f3-4aca-9a04-0b4270992493 tempest-ProjectMemberTests-715789302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:16:06 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-8a73632b-f1f3-4aca-9a04-0b4270992493 tempest-ProjectMemberTests-715789302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:16:06 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-8a73632b-f1f3-4aca-9a04-0b4270992493 tempest-ProjectMemberTests-715789302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:16:06 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-8a73632b-f1f3-4aca-9a04-0b4270992493 tempest-ProjectMemberTests-715789302 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:16:06 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-8a73632b-f1f3-4aca-9a04-0b4270992493 tempest-ProjectMemberTests-715789302 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:16:06 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-8a73632b-f1f3-4aca-9a04-0b4270992493 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-981d08c9-1150-4603-b14e-05ed00ceaa98 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:06 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-cef74811-3506-436e-892a-3804d6ebf0f5 tempest-ProjectReaderTests-1092271699 None] Lock "cinder-00ecf061-e108-4d5e-888a-c239333b7cde-delete_volume" acquired by "delete_volume" :: waited 0.114s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:16:06 devstack sudo[109110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-981d08c9-1150-4603-b14e-05ed00ceaa98 1073741824 Aug 10 16:16:06 devstack sudo[109110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:06 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-cef74811-3506-436e-892a-3804d6ebf0f5 tempest-ProjectReaderTests-1092271699 None] Acquiring lock "cinder-quobyte-00ecf061-e108-4d5e-888a-c239333b7cde" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:16:06 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-cef74811-3506-436e-892a-3804d6ebf0f5 tempest-ProjectReaderTests-1092271699 None] Lock "cinder-quobyte-00ecf061-e108-4d5e-888a-c239333b7cde" acquired by "delete_volume" :: waited 0.024s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:16:06 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[81dbf5d8-144f-42e7-826e-6389aca8a48b]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:16:06 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-cef74811-3506-436e-892a-3804d6ebf0f5 tempest-ProjectReaderTests-1092271699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-00ecf061-e108-4d5e-888a-c239333b7cde {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:06 devstack sudo[109115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-00ecf061-e108-4d5e-888a-c239333b7cde Aug 10 16:16:06 devstack sudo[109115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:06 devstack sudo[109110]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:06 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-8a73632b-f1f3-4aca-9a04-0b4270992493 tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-981d08c9-1150-4603-b14e-05ed00ceaa98 1073741824" returned: 0 in 0.505s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:06 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-8a73632b-f1f3-4aca-9a04-0b4270992493 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-981d08c9-1150-4603-b14e-05ed00ceaa98 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:06 devstack sudo[109115]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:06 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-cef74811-3506-436e-892a-3804d6ebf0f5 tempest-ProjectReaderTests-1092271699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-00ecf061-e108-4d5e-888a-c239333b7cde" returned: 0 in 0.406s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:06 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-cef74811-3506-436e-892a-3804d6ebf0f5 tempest-ProjectReaderTests-1092271699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-00ecf061-e108-4d5e-888a-c239333b7cde {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:06 devstack sudo[109123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-981d08c9-1150-4603-b14e-05ed00ceaa98 Aug 10 16:16:06 devstack sudo[109123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:06 devstack sudo[109124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-00ecf061-e108-4d5e-888a-c239333b7cde Aug 10 16:16:06 devstack sudo[109124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:07 devstack sudo[109124]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-cef74811-3506-436e-892a-3804d6ebf0f5 tempest-ProjectReaderTests-1092271699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-00ecf061-e108-4d5e-888a-c239333b7cde" returned: 0 in 0.333s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:07 devstack sudo[109123]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-8a73632b-f1f3-4aca-9a04-0b4270992493 tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-981d08c9-1150-4603-b14e-05ed00ceaa98" returned: 0 in 0.369s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:07 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-8a73632b-f1f3-4aca-9a04-0b4270992493 tempest-ProjectMemberTests-715789302 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:16:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-8a73632b-f1f3-4aca-9a04-0b4270992493 tempest-ProjectMemberTests-715789302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:16:07 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-cef74811-3506-436e-892a-3804d6ebf0f5 tempest-ProjectReaderTests-1092271699 None] Lock "cinder-quobyte-00ecf061-e108-4d5e-888a-c239333b7cde" released by "delete_volume" :: held 0.818s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:16:07 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-8a73632b-f1f3-4aca-9a04-0b4270992493 tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9343198-a0cb-408a-affa-470f5e94b264) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-981d08c9-1150-4603-b14e-05ed00ceaa98', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:16:07 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-8a73632b-f1f3-4aca-9a04-0b4270992493 tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb8ea57c-5401-47eb-8a8e-7d9bba212f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:16:07 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-8a73632b-f1f3-4aca-9a04-0b4270992493 tempest-ProjectMemberTests-715789302 None] Volume volume-981d08c9-1150-4603-b14e-05ed00ceaa98 (981d08c9-1150-4603-b14e-05ed00ceaa98): created successfully Aug 10 16:16:07 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-8a73632b-f1f3-4aca-9a04-0b4270992493 tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb8ea57c-5401-47eb-8a8e-7d9bba212f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:16:07 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-8a73632b-f1f3-4aca-9a04-0b4270992493 tempest-ProjectMemberTests-715789302 None] Flow 'volume_create_manager' (a6f73a07-ead1-47e4-b719-30e35aa779f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:16:07 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-8a73632b-f1f3-4aca-9a04-0b4270992493 tempest-ProjectMemberTests-715789302 None] Created volume successfully. Aug 10 16:16:07 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-cef74811-3506-436e-892a-3804d6ebf0f5 tempest-ProjectReaderTests-1092271699 None] Created reservations ['0242abcc-d39f-4d1b-a3c5-6af036123764', '79f90eea-3f5c-40e0-be26-2b00562b5446', '20797f9e-fca2-4aa1-9990-08c2067d7204', '89aa994e-b353-46dc-ac1f-49ef301dbed4'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:16:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-cef74811-3506-436e-892a-3804d6ebf0f5 tempest-ProjectReaderTests-1092271699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:16:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-cef74811-3506-436e-892a-3804d6ebf0f5 tempest-ProjectReaderTests-1092271699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:16:07 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-cef74811-3506-436e-892a-3804d6ebf0f5 tempest-ProjectReaderTests-1092271699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:16:07 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-cef74811-3506-436e-892a-3804d6ebf0f5 tempest-ProjectReaderTests-1092271699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:16:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-cef74811-3506-436e-892a-3804d6ebf0f5 tempest-ProjectReaderTests-1092271699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:16:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-cef74811-3506-436e-892a-3804d6ebf0f5 tempest-ProjectReaderTests-1092271699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:07 devstack sudo[109129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:16:07 devstack sudo[109129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:07 devstack sudo[109129]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-cef74811-3506-436e-892a-3804d6ebf0f5 tempest-ProjectReaderTests-1092271699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.270s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:07 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-cef74811-3506-436e-892a-3804d6ebf0f5 tempest-ProjectReaderTests-1092271699 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:16:07 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-cef74811-3506-436e-892a-3804d6ebf0f5 tempest-ProjectReaderTests-1092271699 None] Deleted volume successfully. Aug 10 16:16:07 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-cef74811-3506-436e-892a-3804d6ebf0f5 tempest-ProjectReaderTests-1092271699 None] Lock "cinder-00ecf061-e108-4d5e-888a-c239333b7cde-delete_volume" released by "delete_volume" :: held 1.416s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:16:07 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-72420daf-9547-4cc0-8b68-a10d6751ef53 tempest-SnapshotDependencyTests-34318094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:16:07 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-72420daf-9547-4cc0-8b68-a10d6751ef53 tempest-SnapshotDependencyTests-34318094 None] Flow 'volume_create_manager' (d8013088-86f5-4471-bc0d-425c96499518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:16:07 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-72420daf-9547-4cc0-8b68-a10d6751ef53 tempest-SnapshotDependencyTests-34318094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71ac3ce7-38b4-4767-91bb-d878445e5674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:16:07 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-72420daf-9547-4cc0-8b68-a10d6751ef53 tempest-SnapshotDependencyTests-34318094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71ac3ce7-38b4-4767-91bb-d878445e5674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:16:07Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5da13b5a-356a-490e-9374-87b405a4843e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b924fc2e27e47b089913a324591d46e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:16:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b8d17c58-e1b9-4c72-ab15-c6b78a1ef232,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:16:08Z,use_quota=True,user_id='b08e56dfda95455d8d749706f0f9e4bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:16:07 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-72420daf-9547-4cc0-8b68-a10d6751ef53 tempest-SnapshotDependencyTests-34318094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c99be9e0-29d4-4d89-a331-b4746a74a093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:16:07 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-72420daf-9547-4cc0-8b68-a10d6751ef53 tempest-SnapshotDependencyTests-34318094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c99be9e0-29d4-4d89-a331-b4746a74a093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:16:07 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-72420daf-9547-4cc0-8b68-a10d6751ef53 tempest-SnapshotDependencyTests-34318094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49db1270-1421-4b3b-b1d4-c620522b4aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:16:07 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-72420daf-9547-4cc0-8b68-a10d6751ef53 tempest-SnapshotDependencyTests-34318094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49db1270-1421-4b3b-b1d4-c620522b4aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5da13b5a-356a-490e-9374-87b405a4843e', 'volume_name': 'volume-5da13b5a-356a-490e-9374-87b405a4843e', 'volume_size': 1, 'snapshot_id': 'b8d17c58-e1b9-4c72-ab15-c6b78a1ef232'}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:16:07 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-72420daf-9547-4cc0-8b68-a10d6751ef53 tempest-SnapshotDependencyTests-34318094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27539eda-19ba-43ca-b863-668393a59a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:16:07 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-72420daf-9547-4cc0-8b68-a10d6751ef53 tempest-SnapshotDependencyTests-34318094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27539eda-19ba-43ca-b863-668393a59a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:16:07 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-72420daf-9547-4cc0-8b68-a10d6751ef53 tempest-SnapshotDependencyTests-34318094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d59c2cd7-b895-4914-a0c7-0bd9bb82255c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:16:07 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-72420daf-9547-4cc0-8b68-a10d6751ef53 tempest-SnapshotDependencyTests-34318094 None] Volume 5da13b5a-356a-490e-9374-87b405a4843e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5da13b5a-356a-490e-9374-87b405a4843e', 'volume_size': 1, 'snapshot_id': 'b8d17c58-e1b9-4c72-ab15-c6b78a1ef232'} Aug 10 16:16:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-72420daf-9547-4cc0-8b68-a10d6751ef53 tempest-SnapshotDependencyTests-34318094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:16:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-72420daf-9547-4cc0-8b68-a10d6751ef53 tempest-SnapshotDependencyTests-34318094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:16:07 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-72420daf-9547-4cc0-8b68-a10d6751ef53 tempest-SnapshotDependencyTests-34318094 None] Acquiring lock "cinder-quobyte-b8d17c58-e1b9-4c72-ab15-c6b78a1ef232-5da13b5a-356a-490e-9374-87b405a4843e" by "_create_volume_from_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:16:07 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-72420daf-9547-4cc0-8b68-a10d6751ef53 tempest-SnapshotDependencyTests-34318094 None] Lock "cinder-quobyte-b8d17c58-e1b9-4c72-ab15-c6b78a1ef232-5da13b5a-356a-490e-9374-87b405a4843e" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:16:07 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-72420daf-9547-4cc0-8b68-a10d6751ef53 tempest-SnapshotDependencyTests-34318094 None] Creating volume 5da13b5a-356a-490e-9374-87b405a4843e from snapshot b8d17c58-e1b9-4c72-ab15-c6b78a1ef232 {{(pid=88641) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 10 16:16:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-72420daf-9547-4cc0-8b68-a10d6751ef53 tempest-SnapshotDependencyTests-34318094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:16:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-72420daf-9547-4cc0-8b68-a10d6751ef53 tempest-SnapshotDependencyTests-34318094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:16:07 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-72420daf-9547-4cc0-8b68-a10d6751ef53 tempest-SnapshotDependencyTests-34318094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:16:07 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-72420daf-9547-4cc0-8b68-a10d6751ef53 tempest-SnapshotDependencyTests-34318094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:16:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-72420daf-9547-4cc0-8b68-a10d6751ef53 tempest-SnapshotDependencyTests-34318094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:16:07 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-72420daf-9547-4cc0-8b68-a10d6751ef53 tempest-SnapshotDependencyTests-34318094 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:16:07 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-72420daf-9547-4cc0-8b68-a10d6751ef53 tempest-SnapshotDependencyTests-34318094 None] Acquiring lock "cinder-quobyte-5da13b5a-356a-490e-9374-87b405a4843e" by "_copy_volume_from_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:16:07 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-72420daf-9547-4cc0-8b68-a10d6751ef53 tempest-SnapshotDependencyTests-34318094 None] Lock "cinder-quobyte-5da13b5a-356a-490e-9374-87b405a4843e" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:16:07 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-72420daf-9547-4cc0-8b68-a10d6751ef53 tempest-SnapshotDependencyTests-34318094 None] snapshot: b8d17c58-e1b9-4c72-ab15-c6b78a1ef232, volume: 5da13b5a-356a-490e-9374-87b405a4843e, {{(pid=88641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 10 16:16:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-72420daf-9547-4cc0-8b68-a10d6751ef53 tempest-SnapshotDependencyTests-34318094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:16:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-72420daf-9547-4cc0-8b68-a10d6751ef53 tempest-SnapshotDependencyTests-34318094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:16:07 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-72420daf-9547-4cc0-8b68-a10d6751ef53 tempest-SnapshotDependencyTests-34318094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:16:07 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-72420daf-9547-4cc0-8b68-a10d6751ef53 tempest-SnapshotDependencyTests-34318094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:16:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-72420daf-9547-4cc0-8b68-a10d6751ef53 tempest-SnapshotDependencyTests-34318094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:16:07 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[47dc7848-294c-4d98-b792-111d3d78ea71]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:16:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-72420daf-9547-4cc0-8b68-a10d6751ef53 tempest-SnapshotDependencyTests-34318094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-dfe61a71-8201-489b-9afa-70e9c7baeebd.b8d17c58-e1b9-4c72-ab15-c6b78a1ef232 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:08 devstack sudo[109132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-dfe61a71-8201-489b-9afa-70e9c7baeebd.b8d17c58-e1b9-4c72-ab15-c6b78a1ef232 Aug 10 16:16:08 devstack sudo[109132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:08 devstack sudo[109132]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-72420daf-9547-4cc0-8b68-a10d6751ef53 tempest-SnapshotDependencyTests-34318094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-dfe61a71-8201-489b-9afa-70e9c7baeebd.b8d17c58-e1b9-4c72-ab15-c6b78a1ef232" returned: 0 in 0.417s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:08 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-72420daf-9547-4cc0-8b68-a10d6751ef53 tempest-SnapshotDependencyTests-34318094 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dfe61a71-8201-489b-9afa-70e9c7baeebd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 16:16:08 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[715d71cb-0842-4480-b6d3-e1bf6f5925f0]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:16:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-72420daf-9547-4cc0-8b68-a10d6751ef53 tempest-SnapshotDependencyTests-34318094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-dfe61a71-8201-489b-9afa-70e9c7baeebd {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-54bec0f2-942f-4b50-85c8-7406c9af92f7 tempest-ProjectMemberTests-715789302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:16:08 devstack sudo[109137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-dfe61a71-8201-489b-9afa-70e9c7baeebd Aug 10 16:16:08 devstack sudo[109137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:08 devstack sudo[109137]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-72420daf-9547-4cc0-8b68-a10d6751ef53 tempest-SnapshotDependencyTests-34318094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-dfe61a71-8201-489b-9afa-70e9c7baeebd" returned: 0 in 0.501s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:08 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-72420daf-9547-4cc0-8b68-a10d6751ef53 tempest-SnapshotDependencyTests-34318094 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-dfe61a71-8201-489b-9afa-70e9c7baeebd {{(pid=88641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 10 16:16:08 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-72420daf-9547-4cc0-8b68-a10d6751ef53 tempest-SnapshotDependencyTests-34318094 None] Creating direct copy from snapshot {{(pid=88641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 10 16:16:08 devstack cinder-volume[88641]: DEBUG cinder.utils [None req-72420daf-9547-4cc0-8b68-a10d6751ef53 tempest-SnapshotDependencyTests-34318094 None] Path /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-5da13b5a-356a-490e-9374-87b405a4843e not found in is_blk_device check {{(pid=88641) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 10 16:16:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-72420daf-9547-4cc0-8b68-a10d6751ef53 tempest-SnapshotDependencyTests-34318094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-dfe61a71-8201-489b-9afa-70e9c7baeebd /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-5da13b5a-356a-490e-9374-87b405a4843e {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:08 devstack sudo[109142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-dfe61a71-8201-489b-9afa-70e9c7baeebd /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-5da13b5a-356a-490e-9374-87b405a4843e Aug 10 16:16:08 devstack sudo[109142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:09 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-33f3b3b2-3227-4813-9985-cc6be5e33acc tempest-ProjectReaderTests-1092271699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:16:09 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-33f3b3b2-3227-4813-9985-cc6be5e33acc tempest-ProjectReaderTests-1092271699 None] Flow 'volume_create_manager' (980b9165-a7f5-4f0c-8610-ca32c9d7e5e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:16:09 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-33f3b3b2-3227-4813-9985-cc6be5e33acc tempest-ProjectReaderTests-1092271699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (849a9054-e598-4bc5-ae51-525f623e4a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:16:09 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-33f3b3b2-3227-4813-9985-cc6be5e33acc tempest-ProjectReaderTests-1092271699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (849a9054-e598-4bc5-ae51-525f623e4a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:16:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-12975703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=515d41d8-2658-4d8e-83fd-677e40ff1d44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8da6b8cdad34ff69416120b23e9a25c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:16:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:16:09Z,use_quota=True,user_id='4e50367bdb2c40639a24a8a70eaa2b15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:16:09 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-33f3b3b2-3227-4813-9985-cc6be5e33acc tempest-ProjectReaderTests-1092271699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53c37028-9155-4c48-a22b-d5844f1f4686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:16:09 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-33f3b3b2-3227-4813-9985-cc6be5e33acc tempest-ProjectReaderTests-1092271699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53c37028-9155-4c48-a22b-d5844f1f4686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:16:09 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-33f3b3b2-3227-4813-9985-cc6be5e33acc tempest-ProjectReaderTests-1092271699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97bf2d8b-fb9a-4953-b76e-6b6516394cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:16:09 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-33f3b3b2-3227-4813-9985-cc6be5e33acc tempest-ProjectReaderTests-1092271699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97bf2d8b-fb9a-4953-b76e-6b6516394cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '515d41d8-2658-4d8e-83fd-677e40ff1d44', 'volume_name': 'volume-515d41d8-2658-4d8e-83fd-677e40ff1d44', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:16:09 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-33f3b3b2-3227-4813-9985-cc6be5e33acc tempest-ProjectReaderTests-1092271699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fdbc4f5-9e60-4850-8eff-b559e7028c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:16:09 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-33f3b3b2-3227-4813-9985-cc6be5e33acc tempest-ProjectReaderTests-1092271699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fdbc4f5-9e60-4850-8eff-b559e7028c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:16:09 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-33f3b3b2-3227-4813-9985-cc6be5e33acc tempest-ProjectReaderTests-1092271699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (337e874c-422f-4b65-8a4d-62c8b2abe190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:16:09 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-33f3b3b2-3227-4813-9985-cc6be5e33acc tempest-ProjectReaderTests-1092271699 None] Volume 515d41d8-2658-4d8e-83fd-677e40ff1d44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-515d41d8-2658-4d8e-83fd-677e40ff1d44', 'volume_size': 1} Aug 10 16:16:09 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-33f3b3b2-3227-4813-9985-cc6be5e33acc tempest-ProjectReaderTests-1092271699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:16:13 devstack sudo[109142]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:13 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-72420daf-9547-4cc0-8b68-a10d6751ef53 tempest-SnapshotDependencyTests-34318094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-dfe61a71-8201-489b-9afa-70e9c7baeebd /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-5da13b5a-356a-490e-9374-87b405a4843e" returned: 0 in 4.839s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:13 devstack cinder-volume[88641]: DEBUG cinder.image.image_utils [None req-72420daf-9547-4cc0-8b68-a10d6751ef53 tempest-SnapshotDependencyTests-34318094 None] Image conversion details: src /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-dfe61a71-8201-489b-9afa-70e9c7baeebd, size 1024.00 MB, duration 4.84 sec, destination /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-5da13b5a-356a-490e-9374-87b405a4843e {{(pid=88641) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 10 16:16:13 devstack cinder-volume[88641]: INFO cinder.image.image_utils [None req-72420daf-9547-4cc0-8b68-a10d6751ef53 tempest-SnapshotDependencyTests-34318094 None] Converted 1024.00 MB image at 211.59 MB/s Aug 10 16:16:13 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-72420daf-9547-4cc0-8b68-a10d6751ef53 tempest-SnapshotDependencyTests-34318094 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-5da13b5a-356a-490e-9374-87b405a4843e is being set with open permissions: ugo+rw Aug 10 16:16:13 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-72420daf-9547-4cc0-8b68-a10d6751ef53 tempest-SnapshotDependencyTests-34318094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-5da13b5a-356a-490e-9374-87b405a4843e {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:13 devstack sudo[109155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-5da13b5a-356a-490e-9374-87b405a4843e Aug 10 16:16:13 devstack sudo[109155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:14 devstack sudo[109155]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:14 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-72420daf-9547-4cc0-8b68-a10d6751ef53 tempest-SnapshotDependencyTests-34318094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-5da13b5a-356a-490e-9374-87b405a4843e" returned: 0 in 0.236s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:14 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-72420daf-9547-4cc0-8b68-a10d6751ef53 tempest-SnapshotDependencyTests-34318094 None] Lock "cinder-quobyte-5da13b5a-356a-490e-9374-87b405a4843e" released by "_copy_volume_from_snapshot" :: held 6.102s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:16:14 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-72420daf-9547-4cc0-8b68-a10d6751ef53 tempest-SnapshotDependencyTests-34318094 None] Lock "cinder-quobyte-b8d17c58-e1b9-4c72-ab15-c6b78a1ef232-5da13b5a-356a-490e-9374-87b405a4843e" released by "_create_volume_from_snapshot" :: held 6.173s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:16:14 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-72420daf-9547-4cc0-8b68-a10d6751ef53 tempest-SnapshotDependencyTests-34318094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.191s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:16:14 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-54bec0f2-942f-4b50-85c8-7406c9af92f7 tempest-ProjectMemberTests-715789302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.600s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:16:14 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-54bec0f2-942f-4b50-85c8-7406c9af92f7 tempest-ProjectMemberTests-715789302 None] Creating offline snapshot 1ad3aaf5-0733-473d-a3ba-79fd52907876 of volume 981d08c9-1150-4603-b14e-05ed00ceaa98 {{(pid=88641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 16:16:14 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-72420daf-9547-4cc0-8b68-a10d6751ef53 tempest-SnapshotDependencyTests-34318094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d59c2cd7-b895-4914-a0c7-0bd9bb82255c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5da13b5a-356a-490e-9374-87b405a4843e', 'volume_size': 1, 'snapshot_id': 'b8d17c58-e1b9-4c72-ab15-c6b78a1ef232'}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:16:14 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-72420daf-9547-4cc0-8b68-a10d6751ef53 tempest-SnapshotDependencyTests-34318094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b31c741d-6812-42f5-b951-f21fb81f4ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:16:14 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[29768a89-3812-4fc1-9877-a6af8cb978d4]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:16:14 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-54bec0f2-942f-4b50-85c8-7406c9af92f7 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-981d08c9-1150-4603-b14e-05ed00ceaa98 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:14 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-72420daf-9547-4cc0-8b68-a10d6751ef53 tempest-SnapshotDependencyTests-34318094 None] Volume volume-5da13b5a-356a-490e-9374-87b405a4843e (5da13b5a-356a-490e-9374-87b405a4843e): created successfully Aug 10 16:16:14 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-72420daf-9547-4cc0-8b68-a10d6751ef53 tempest-SnapshotDependencyTests-34318094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b31c741d-6812-42f5-b951-f21fb81f4ce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:16:14 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-72420daf-9547-4cc0-8b68-a10d6751ef53 tempest-SnapshotDependencyTests-34318094 None] Flow 'volume_create_manager' (d8013088-86f5-4471-bc0d-425c96499518) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:16:14 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-72420daf-9547-4cc0-8b68-a10d6751ef53 tempest-SnapshotDependencyTests-34318094 None] Created volume successfully. Aug 10 16:16:14 devstack sudo[109158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-981d08c9-1150-4603-b14e-05ed00ceaa98 Aug 10 16:16:14 devstack sudo[109158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:14 devstack sudo[109158]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:14 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-ab4110c6-ada6-4189-9e4f-45dc4066b153 tempest-SnapshotDependencyTests-34318094 None] Acquiring lock "cinder-b8d17c58-e1b9-4c72-ab15-c6b78a1ef232-delete_snapshot" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:16:14 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-54bec0f2-942f-4b50-85c8-7406c9af92f7 tempest-ProjectMemberTests-715789302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-981d08c9-1150-4603-b14e-05ed00ceaa98" returned: 0 in 0.422s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:14 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-54bec0f2-942f-4b50-85c8-7406c9af92f7 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-981d08c9-1150-4603-b14e-05ed00ceaa98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-981d08c9-1150-4603-b14e-05ed00ceaa98.1ad3aaf5-0733-473d-a3ba-79fd52907876 1G {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:14 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-ab4110c6-ada6-4189-9e4f-45dc4066b153 tempest-SnapshotDependencyTests-34318094 None] Lock "cinder-b8d17c58-e1b9-4c72-ab15-c6b78a1ef232-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:16:14 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-ab4110c6-ada6-4189-9e4f-45dc4066b153 tempest-SnapshotDependencyTests-34318094 None] Acquiring lock "cinder-quobyte-dfe61a71-8201-489b-9afa-70e9c7baeebd" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:16:14 devstack sudo[109163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-981d08c9-1150-4603-b14e-05ed00ceaa98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-981d08c9-1150-4603-b14e-05ed00ceaa98.1ad3aaf5-0733-473d-a3ba-79fd52907876 1G Aug 10 16:16:14 devstack sudo[109163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:14 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-ab4110c6-ada6-4189-9e4f-45dc4066b153 tempest-SnapshotDependencyTests-34318094 None] Lock "cinder-quobyte-dfe61a71-8201-489b-9afa-70e9c7baeebd" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:16:14 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-ab4110c6-ada6-4189-9e4f-45dc4066b153 tempest-SnapshotDependencyTests-34318094 None] Acquiring lock "cinder-quobyte-b8d17c58-e1b9-4c72-ab15-c6b78a1ef232" by "_delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:16:14 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-ab4110c6-ada6-4189-9e4f-45dc4066b153 tempest-SnapshotDependencyTests-34318094 None] Lock "cinder-quobyte-b8d17c58-e1b9-4c72-ab15-c6b78a1ef232" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:16:14 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-ab4110c6-ada6-4189-9e4f-45dc4066b153 tempest-SnapshotDependencyTests-34318094 None] Deleting offline snapshot b8d17c58-e1b9-4c72-ab15-c6b78a1ef232 of volume dfe61a71-8201-489b-9afa-70e9c7baeebd {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 16:16:14 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-ab4110c6-ada6-4189-9e4f-45dc4066b153 tempest-SnapshotDependencyTests-34318094 None] snapshot_file for this snap is: volume-dfe61a71-8201-489b-9afa-70e9c7baeebd.b8d17c58-e1b9-4c72-ab15-c6b78a1ef232 {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 16:16:14 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f76f59-238f-4165-9bc1-180aabe993de]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:16:14 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ab4110c6-ada6-4189-9e4f-45dc4066b153 tempest-SnapshotDependencyTests-34318094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-dfe61a71-8201-489b-9afa-70e9c7baeebd.b8d17c58-e1b9-4c72-ab15-c6b78a1ef232 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:14 devstack sudo[109165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-dfe61a71-8201-489b-9afa-70e9c7baeebd.b8d17c58-e1b9-4c72-ab15-c6b78a1ef232 Aug 10 16:16:14 devstack sudo[109165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:15 devstack sudo[109165]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:15 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ab4110c6-ada6-4189-9e4f-45dc4066b153 tempest-SnapshotDependencyTests-34318094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-dfe61a71-8201-489b-9afa-70e9c7baeebd.b8d17c58-e1b9-4c72-ab15-c6b78a1ef232" returned: 0 in 0.394s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:15 devstack sudo[109163]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:15 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-ab4110c6-ada6-4189-9e4f-45dc4066b153 tempest-SnapshotDependencyTests-34318094 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dfe61a71-8201-489b-9afa-70e9c7baeebd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 16:16:15 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-54bec0f2-942f-4b50-85c8-7406c9af92f7 tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-981d08c9-1150-4603-b14e-05ed00ceaa98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-981d08c9-1150-4603-b14e-05ed00ceaa98.1ad3aaf5-0733-473d-a3ba-79fd52907876 1G" returned: 0 in 0.518s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:15 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-54bec0f2-942f-4b50-85c8-7406c9af92f7 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-981d08c9-1150-4603-b14e-05ed00ceaa98 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-981d08c9-1150-4603-b14e-05ed00ceaa98.1ad3aaf5-0733-473d-a3ba-79fd52907876 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:15 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[6310e9b2-dcde-43ad-afe1-065a7dcf1f2c]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:16:15 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ab4110c6-ada6-4189-9e4f-45dc4066b153 tempest-SnapshotDependencyTests-34318094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-dfe61a71-8201-489b-9afa-70e9c7baeebd {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:15 devstack sudo[109173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-981d08c9-1150-4603-b14e-05ed00ceaa98 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-981d08c9-1150-4603-b14e-05ed00ceaa98.1ad3aaf5-0733-473d-a3ba-79fd52907876 Aug 10 16:16:15 devstack sudo[109173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:15 devstack sudo[109174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-dfe61a71-8201-489b-9afa-70e9c7baeebd Aug 10 16:16:15 devstack sudo[109174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:15 devstack sudo[109173]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:15 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-54bec0f2-942f-4b50-85c8-7406c9af92f7 tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-981d08c9-1150-4603-b14e-05ed00ceaa98 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-981d08c9-1150-4603-b14e-05ed00ceaa98.1ad3aaf5-0733-473d-a3ba-79fd52907876" returned: 0 in 0.283s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:15 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-54bec0f2-942f-4b50-85c8-7406c9af92f7 tempest-ProjectMemberTests-715789302 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-981d08c9-1150-4603-b14e-05ed00ceaa98.1ad3aaf5-0733-473d-a3ba-79fd52907876 is being set with open permissions: ugo+rw Aug 10 16:16:15 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-54bec0f2-942f-4b50-85c8-7406c9af92f7 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-981d08c9-1150-4603-b14e-05ed00ceaa98.1ad3aaf5-0733-473d-a3ba-79fd52907876 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:15 devstack sudo[109180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-981d08c9-1150-4603-b14e-05ed00ceaa98.1ad3aaf5-0733-473d-a3ba-79fd52907876 Aug 10 16:16:15 devstack sudo[109180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:15 devstack sudo[109180]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:15 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-54bec0f2-942f-4b50-85c8-7406c9af92f7 tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-981d08c9-1150-4603-b14e-05ed00ceaa98.1ad3aaf5-0733-473d-a3ba-79fd52907876" returned: 0 in 0.254s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:15 devstack sudo[109174]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:15 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ab4110c6-ada6-4189-9e4f-45dc4066b153 tempest-SnapshotDependencyTests-34318094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-dfe61a71-8201-489b-9afa-70e9c7baeebd" returned: 0 in 0.540s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:15 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ab4110c6-ada6-4189-9e4f-45dc4066b153 tempest-SnapshotDependencyTests-34318094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-dfe61a71-8201-489b-9afa-70e9c7baeebd.b8d17c58-e1b9-4c72-ab15-c6b78a1ef232 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:15 devstack sudo[109187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-dfe61a71-8201-489b-9afa-70e9c7baeebd.b8d17c58-e1b9-4c72-ab15-c6b78a1ef232 Aug 10 16:16:15 devstack sudo[109187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:15 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-54bec0f2-942f-4b50-85c8-7406c9af92f7 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-981d08c9-1150-4603-b14e-05ed00ceaa98.info {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:15 devstack sudo[109189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-981d08c9-1150-4603-b14e-05ed00ceaa98.info Aug 10 16:16:15 devstack sudo[109189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:15 devstack sudo[109189]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:15 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-54bec0f2-942f-4b50-85c8-7406c9af92f7 tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-981d08c9-1150-4603-b14e-05ed00ceaa98.info" returned: 0 in 0.255s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:15 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-54bec0f2-942f-4b50-85c8-7406c9af92f7 tempest-ProjectMemberTests-715789302 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-981d08c9-1150-4603-b14e-05ed00ceaa98.info is being set with open permissions: ugo+rw Aug 10 16:16:15 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-54bec0f2-942f-4b50-85c8-7406c9af92f7 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-981d08c9-1150-4603-b14e-05ed00ceaa98.info {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:15 devstack sudo[109195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-981d08c9-1150-4603-b14e-05ed00ceaa98.info Aug 10 16:16:15 devstack sudo[109195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:15 devstack sudo[109187]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:15 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ab4110c6-ada6-4189-9e4f-45dc4066b153 tempest-SnapshotDependencyTests-34318094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-dfe61a71-8201-489b-9afa-70e9c7baeebd.b8d17c58-e1b9-4c72-ab15-c6b78a1ef232" returned: 0 in 0.355s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:15 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ab4110c6-ada6-4189-9e4f-45dc4066b153 tempest-SnapshotDependencyTests-34318094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-dfe61a71-8201-489b-9afa-70e9c7baeebd.b8d17c58-e1b9-4c72-ab15-c6b78a1ef232 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:15 devstack sudo[109198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-dfe61a71-8201-489b-9afa-70e9c7baeebd.b8d17c58-e1b9-4c72-ab15-c6b78a1ef232 Aug 10 16:16:15 devstack sudo[109198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:16 devstack sudo[109195]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:16 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-54bec0f2-942f-4b50-85c8-7406c9af92f7 tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-981d08c9-1150-4603-b14e-05ed00ceaa98.info" returned: 0 in 0.259s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:16 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-54bec0f2-942f-4b50-85c8-7406c9af92f7 tempest-ProjectMemberTests-715789302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.105s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:16:16 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-33f3b3b2-3227-4813-9985-cc6be5e33acc tempest-ProjectReaderTests-1092271699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.031s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:16:16 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-33f3b3b2-3227-4813-9985-cc6be5e33acc tempest-ProjectReaderTests-1092271699 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:16:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-12975703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=515d41d8-2658-4d8e-83fd-677e40ff1d44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8da6b8cdad34ff69416120b23e9a25c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:16:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:16:09Z,use_quota=True,user_id='4e50367bdb2c40639a24a8a70eaa2b15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:16:16 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-33f3b3b2-3227-4813-9985-cc6be5e33acc tempest-ProjectReaderTests-1092271699 None] Creating volume 515d41d8-2658-4d8e-83fd-677e40ff1d44 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:16:16 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-33f3b3b2-3227-4813-9985-cc6be5e33acc tempest-ProjectReaderTests-1092271699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:16:16 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-33f3b3b2-3227-4813-9985-cc6be5e33acc tempest-ProjectReaderTests-1092271699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:16:16 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-33f3b3b2-3227-4813-9985-cc6be5e33acc tempest-ProjectReaderTests-1092271699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:16:16 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-33f3b3b2-3227-4813-9985-cc6be5e33acc tempest-ProjectReaderTests-1092271699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:16:16 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-33f3b3b2-3227-4813-9985-cc6be5e33acc tempest-ProjectReaderTests-1092271699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:16:16 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-33f3b3b2-3227-4813-9985-cc6be5e33acc tempest-ProjectReaderTests-1092271699 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:16:16 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-33f3b3b2-3227-4813-9985-cc6be5e33acc tempest-ProjectReaderTests-1092271699 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:16:16 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-33f3b3b2-3227-4813-9985-cc6be5e33acc tempest-ProjectReaderTests-1092271699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-515d41d8-2658-4d8e-83fd-677e40ff1d44 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:16 devstack sudo[109202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-515d41d8-2658-4d8e-83fd-677e40ff1d44 1073741824 Aug 10 16:16:16 devstack sudo[109202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:16 devstack sudo[109198]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:16 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ab4110c6-ada6-4189-9e4f-45dc4066b153 tempest-SnapshotDependencyTests-34318094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-dfe61a71-8201-489b-9afa-70e9c7baeebd.b8d17c58-e1b9-4c72-ab15-c6b78a1ef232" returned: 0 in 0.276s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:16 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-54bec0f2-942f-4b50-85c8-7406c9af92f7 tempest-ProjectMemberTests-715789302 None] Create snapshot completed successfully Aug 10 16:16:16 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-ab4110c6-ada6-4189-9e4f-45dc4066b153 tempest-SnapshotDependencyTests-34318094 None] Lock "cinder-quobyte-b8d17c58-e1b9-4c72-ab15-c6b78a1ef232" released by "_delete_snapshot" :: held 1.700s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:16:16 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-ab4110c6-ada6-4189-9e4f-45dc4066b153 tempest-SnapshotDependencyTests-34318094 None] Lock "cinder-quobyte-dfe61a71-8201-489b-9afa-70e9c7baeebd" released by "delete_snapshot" :: held 1.728s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:16:16 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-ab4110c6-ada6-4189-9e4f-45dc4066b153 tempest-SnapshotDependencyTests-34318094 None] Created reservations ['12e6abf8-e3aa-4107-8e51-34c4a64512e5', 'e1289583-c759-48fb-b00b-f1dc2353a839', '1cd307a0-925a-4378-9dea-722c6e2a6288', '1a83aab6-061b-4461-ad55-cd1c6cbac43e'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:16:16 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-ab4110c6-ada6-4189-9e4f-45dc4066b153 tempest-SnapshotDependencyTests-34318094 None] Delete snapshot completed successfully. Aug 10 16:16:16 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-ab4110c6-ada6-4189-9e4f-45dc4066b153 tempest-SnapshotDependencyTests-34318094 None] Lock "cinder-b8d17c58-e1b9-4c72-ab15-c6b78a1ef232-delete_snapshot" released by "delete_snapshot" :: held 1.891s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:16:16 devstack sudo[109202]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:16 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-33f3b3b2-3227-4813-9985-cc6be5e33acc tempest-ProjectReaderTests-1092271699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-515d41d8-2658-4d8e-83fd-677e40ff1d44 1073741824" returned: 0 in 0.496s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:16 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-5cdcf4c0-f140-4f69-8453-9c55a049c5db tempest-SnapshotDependencyTests-34318094 None] Acquiring lock "cinder-dfe61a71-8201-489b-9afa-70e9c7baeebd-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:16:16 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-5cdcf4c0-f140-4f69-8453-9c55a049c5db tempest-SnapshotDependencyTests-34318094 None] Lock "cinder-dfe61a71-8201-489b-9afa-70e9c7baeebd-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:16:16 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-33f3b3b2-3227-4813-9985-cc6be5e33acc tempest-ProjectReaderTests-1092271699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-515d41d8-2658-4d8e-83fd-677e40ff1d44 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:16 devstack sudo[109208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-515d41d8-2658-4d8e-83fd-677e40ff1d44 Aug 10 16:16:16 devstack sudo[109208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:16 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-5cdcf4c0-f140-4f69-8453-9c55a049c5db tempest-SnapshotDependencyTests-34318094 None] Acquiring lock "cinder-quobyte-dfe61a71-8201-489b-9afa-70e9c7baeebd" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:16:16 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-5cdcf4c0-f140-4f69-8453-9c55a049c5db tempest-SnapshotDependencyTests-34318094 None] Lock "cinder-quobyte-dfe61a71-8201-489b-9afa-70e9c7baeebd" acquired by "delete_volume" :: waited 0.017s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:16:16 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[0178799a-0244-4445-9898-73a55a22b294]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:16:16 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5cdcf4c0-f140-4f69-8453-9c55a049c5db tempest-SnapshotDependencyTests-34318094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-dfe61a71-8201-489b-9afa-70e9c7baeebd {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:17 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-fd5cd53d-cd12-4e6a-ae12-505303b845fb tempest-ProjectMemberTests-715789302 None] Acquiring lock "cinder-1ad3aaf5-0733-473d-a3ba-79fd52907876-delete_snapshot" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:16:17 devstack sudo[109210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-dfe61a71-8201-489b-9afa-70e9c7baeebd Aug 10 16:16:17 devstack sudo[109210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:17 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-fd5cd53d-cd12-4e6a-ae12-505303b845fb tempest-ProjectMemberTests-715789302 None] Lock "cinder-1ad3aaf5-0733-473d-a3ba-79fd52907876-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:16:17 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-fd5cd53d-cd12-4e6a-ae12-505303b845fb tempest-ProjectMemberTests-715789302 None] Acquiring lock "cinder-quobyte-981d08c9-1150-4603-b14e-05ed00ceaa98" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:16:17 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-fd5cd53d-cd12-4e6a-ae12-505303b845fb tempest-ProjectMemberTests-715789302 None] Lock "cinder-quobyte-981d08c9-1150-4603-b14e-05ed00ceaa98" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:16:17 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-fd5cd53d-cd12-4e6a-ae12-505303b845fb tempest-ProjectMemberTests-715789302 None] Acquiring lock "cinder-quobyte-1ad3aaf5-0733-473d-a3ba-79fd52907876" by "_delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:16:17 devstack sudo[109208]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-33f3b3b2-3227-4813-9985-cc6be5e33acc tempest-ProjectReaderTests-1092271699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-515d41d8-2658-4d8e-83fd-677e40ff1d44" returned: 0 in 0.342s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:17 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-33f3b3b2-3227-4813-9985-cc6be5e33acc tempest-ProjectReaderTests-1092271699 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:16:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-33f3b3b2-3227-4813-9985-cc6be5e33acc tempest-ProjectReaderTests-1092271699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:16:17 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-fd5cd53d-cd12-4e6a-ae12-505303b845fb tempest-ProjectMemberTests-715789302 None] Lock "cinder-quobyte-1ad3aaf5-0733-473d-a3ba-79fd52907876" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:16:17 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-fd5cd53d-cd12-4e6a-ae12-505303b845fb tempest-ProjectMemberTests-715789302 None] Deleting offline snapshot 1ad3aaf5-0733-473d-a3ba-79fd52907876 of volume 981d08c9-1150-4603-b14e-05ed00ceaa98 {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 16:16:17 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-fd5cd53d-cd12-4e6a-ae12-505303b845fb tempest-ProjectMemberTests-715789302 None] snapshot_file for this snap is: volume-981d08c9-1150-4603-b14e-05ed00ceaa98.1ad3aaf5-0733-473d-a3ba-79fd52907876 {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 16:16:17 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-33f3b3b2-3227-4813-9985-cc6be5e33acc tempest-ProjectReaderTests-1092271699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (337e874c-422f-4b65-8a4d-62c8b2abe190) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-515d41d8-2658-4d8e-83fd-677e40ff1d44', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:16:17 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-33f3b3b2-3227-4813-9985-cc6be5e33acc tempest-ProjectReaderTests-1092271699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbd007b4-9545-4a0e-9267-53e48fb055e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:16:17 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[d43c8f3f-acd2-4fc4-85d7-0e0c11946563]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:16:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fd5cd53d-cd12-4e6a-ae12-505303b845fb tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-981d08c9-1150-4603-b14e-05ed00ceaa98.1ad3aaf5-0733-473d-a3ba-79fd52907876 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:17 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-33f3b3b2-3227-4813-9985-cc6be5e33acc tempest-ProjectReaderTests-1092271699 None] Volume volume-515d41d8-2658-4d8e-83fd-677e40ff1d44 (515d41d8-2658-4d8e-83fd-677e40ff1d44): created successfully Aug 10 16:16:17 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-33f3b3b2-3227-4813-9985-cc6be5e33acc tempest-ProjectReaderTests-1092271699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbd007b4-9545-4a0e-9267-53e48fb055e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:16:17 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-33f3b3b2-3227-4813-9985-cc6be5e33acc tempest-ProjectReaderTests-1092271699 None] Flow 'volume_create_manager' (980b9165-a7f5-4f0c-8610-ca32c9d7e5e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:16:17 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-33f3b3b2-3227-4813-9985-cc6be5e33acc tempest-ProjectReaderTests-1092271699 None] Created volume successfully. Aug 10 16:16:17 devstack sudo[109213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-981d08c9-1150-4603-b14e-05ed00ceaa98.1ad3aaf5-0733-473d-a3ba-79fd52907876 Aug 10 16:16:17 devstack sudo[109213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:17 devstack sudo[109210]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5cdcf4c0-f140-4f69-8453-9c55a049c5db tempest-SnapshotDependencyTests-34318094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-dfe61a71-8201-489b-9afa-70e9c7baeebd" returned: 0 in 0.456s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5cdcf4c0-f140-4f69-8453-9c55a049c5db tempest-SnapshotDependencyTests-34318094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-dfe61a71-8201-489b-9afa-70e9c7baeebd {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:17 devstack sudo[109219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-dfe61a71-8201-489b-9afa-70e9c7baeebd Aug 10 16:16:17 devstack sudo[109219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:17 devstack sudo[109213]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fd5cd53d-cd12-4e6a-ae12-505303b845fb tempest-ProjectMemberTests-715789302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-981d08c9-1150-4603-b14e-05ed00ceaa98.1ad3aaf5-0733-473d-a3ba-79fd52907876" returned: 0 in 0.394s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:17 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-fd5cd53d-cd12-4e6a-ae12-505303b845fb tempest-ProjectMemberTests-715789302 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-981d08c9-1150-4603-b14e-05ed00ceaa98(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 16:16:17 devstack sudo[109219]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5cdcf4c0-f140-4f69-8453-9c55a049c5db tempest-SnapshotDependencyTests-34318094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-dfe61a71-8201-489b-9afa-70e9c7baeebd" returned: 0 in 0.264s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:17 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ebb6d86-1816-4dcb-b6d0-b6947b4ca58a]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:16:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fd5cd53d-cd12-4e6a-ae12-505303b845fb tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-981d08c9-1150-4603-b14e-05ed00ceaa98 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:17 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-5cdcf4c0-f140-4f69-8453-9c55a049c5db tempest-SnapshotDependencyTests-34318094 None] Lock "cinder-quobyte-dfe61a71-8201-489b-9afa-70e9c7baeebd" released by "delete_volume" :: held 0.796s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:16:17 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-5cdcf4c0-f140-4f69-8453-9c55a049c5db tempest-SnapshotDependencyTests-34318094 None] Created reservations ['56adce82-d75b-4d29-8c09-21b4a3db87d1', '235b4b9f-e588-4813-afe8-9472cde5b9d3', '1959ddce-1e2b-4f73-8a3b-cccc3848c0cf', 'ae6413a2-26ed-4756-ad0c-c5570bc7d17e'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:16:17 devstack sudo[109225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-981d08c9-1150-4603-b14e-05ed00ceaa98 Aug 10 16:16:17 devstack sudo[109225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-5cdcf4c0-f140-4f69-8453-9c55a049c5db tempest-SnapshotDependencyTests-34318094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:16:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-5cdcf4c0-f140-4f69-8453-9c55a049c5db tempest-SnapshotDependencyTests-34318094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:16:17 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-5cdcf4c0-f140-4f69-8453-9c55a049c5db tempest-SnapshotDependencyTests-34318094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:16:17 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-5cdcf4c0-f140-4f69-8453-9c55a049c5db tempest-SnapshotDependencyTests-34318094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:16:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-5cdcf4c0-f140-4f69-8453-9c55a049c5db tempest-SnapshotDependencyTests-34318094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:16:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5cdcf4c0-f140-4f69-8453-9c55a049c5db tempest-SnapshotDependencyTests-34318094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:17 devstack sudo[109227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:16:17 devstack sudo[109227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:17 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-775283e2-abd3-43b7-9e07-538e5e87f210 tempest-SnapshotDependencyTests-34318094 None] Acquiring lock "cinder-5da13b5a-356a-490e-9374-87b405a4843e-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:16:17 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-775283e2-abd3-43b7-9e07-538e5e87f210 tempest-SnapshotDependencyTests-34318094 None] Lock "cinder-5da13b5a-356a-490e-9374-87b405a4843e-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:16:18 devstack sudo[109225]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:18 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fd5cd53d-cd12-4e6a-ae12-505303b845fb tempest-ProjectMemberTests-715789302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-981d08c9-1150-4603-b14e-05ed00ceaa98" returned: 0 in 0.450s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:18 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fd5cd53d-cd12-4e6a-ae12-505303b845fb tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-981d08c9-1150-4603-b14e-05ed00ceaa98.1ad3aaf5-0733-473d-a3ba-79fd52907876 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:18 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-008d5a1b-c597-464c-95fd-ff2655d5d9d8 tempest-ProjectReaderTests-1092271699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:16:18 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-008d5a1b-c597-464c-95fd-ff2655d5d9d8 tempest-ProjectReaderTests-1092271699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:16:18 devstack sudo[109227]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:18 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-5cdcf4c0-f140-4f69-8453-9c55a049c5db tempest-SnapshotDependencyTests-34318094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.332s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:18 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-5cdcf4c0-f140-4f69-8453-9c55a049c5db tempest-SnapshotDependencyTests-34318094 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:16:18 devstack sudo[109233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-981d08c9-1150-4603-b14e-05ed00ceaa98.1ad3aaf5-0733-473d-a3ba-79fd52907876 Aug 10 16:16:18 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-5cdcf4c0-f140-4f69-8453-9c55a049c5db tempest-SnapshotDependencyTests-34318094 None] Deleted volume successfully. Aug 10 16:16:18 devstack sudo[109233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:18 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-008d5a1b-c597-464c-95fd-ff2655d5d9d8 tempest-ProjectReaderTests-1092271699 None] Creating offline snapshot 3fba6c28-1f07-481e-9001-82f4f34f260c of volume 515d41d8-2658-4d8e-83fd-677e40ff1d44 {{(pid=88641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 16:16:18 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-775283e2-abd3-43b7-9e07-538e5e87f210 tempest-SnapshotDependencyTests-34318094 None] Acquiring lock "cinder-quobyte-5da13b5a-356a-490e-9374-87b405a4843e" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:16:18 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-5cdcf4c0-f140-4f69-8453-9c55a049c5db tempest-SnapshotDependencyTests-34318094 None] Lock "cinder-dfe61a71-8201-489b-9afa-70e9c7baeebd-delete_volume" released by "delete_volume" :: held 1.392s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:16:18 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-775283e2-abd3-43b7-9e07-538e5e87f210 tempest-SnapshotDependencyTests-34318094 None] Lock "cinder-quobyte-5da13b5a-356a-490e-9374-87b405a4843e" acquired by "delete_volume" :: waited 0.027s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:16:18 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[748f30a5-067a-448b-a307-340b5f909ab9]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:16:18 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-008d5a1b-c597-464c-95fd-ff2655d5d9d8 tempest-ProjectReaderTests-1092271699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-515d41d8-2658-4d8e-83fd-677e40ff1d44 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:18 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[331c9ad9-c527-499e-98a2-454d83a90393]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:16:18 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-775283e2-abd3-43b7-9e07-538e5e87f210 tempest-SnapshotDependencyTests-34318094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-5da13b5a-356a-490e-9374-87b405a4843e {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:18 devstack sudo[109235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-515d41d8-2658-4d8e-83fd-677e40ff1d44 Aug 10 16:16:18 devstack sudo[109235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:18 devstack sudo[109236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-5da13b5a-356a-490e-9374-87b405a4843e Aug 10 16:16:18 devstack sudo[109236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:18 devstack sudo[109233]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:18 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fd5cd53d-cd12-4e6a-ae12-505303b845fb tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-981d08c9-1150-4603-b14e-05ed00ceaa98.1ad3aaf5-0733-473d-a3ba-79fd52907876" returned: 0 in 0.463s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:18 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fd5cd53d-cd12-4e6a-ae12-505303b845fb tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-981d08c9-1150-4603-b14e-05ed00ceaa98.1ad3aaf5-0733-473d-a3ba-79fd52907876 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:18 devstack sudo[109244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-981d08c9-1150-4603-b14e-05ed00ceaa98.1ad3aaf5-0733-473d-a3ba-79fd52907876 Aug 10 16:16:18 devstack sudo[109244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:18 devstack sudo[109235]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:18 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-008d5a1b-c597-464c-95fd-ff2655d5d9d8 tempest-ProjectReaderTests-1092271699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-515d41d8-2658-4d8e-83fd-677e40ff1d44" returned: 0 in 0.454s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:18 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-008d5a1b-c597-464c-95fd-ff2655d5d9d8 tempest-ProjectReaderTests-1092271699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-515d41d8-2658-4d8e-83fd-677e40ff1d44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-515d41d8-2658-4d8e-83fd-677e40ff1d44.3fba6c28-1f07-481e-9001-82f4f34f260c 1G {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:18 devstack sudo[109249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-515d41d8-2658-4d8e-83fd-677e40ff1d44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-515d41d8-2658-4d8e-83fd-677e40ff1d44.3fba6c28-1f07-481e-9001-82f4f34f260c 1G Aug 10 16:16:18 devstack sudo[109249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:18 devstack sudo[109236]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:18 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-775283e2-abd3-43b7-9e07-538e5e87f210 tempest-SnapshotDependencyTests-34318094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-5da13b5a-356a-490e-9374-87b405a4843e" returned: 0 in 0.530s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:18 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-775283e2-abd3-43b7-9e07-538e5e87f210 tempest-SnapshotDependencyTests-34318094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-5da13b5a-356a-490e-9374-87b405a4843e {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:18 devstack sudo[109254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-5da13b5a-356a-490e-9374-87b405a4843e Aug 10 16:16:18 devstack sudo[109254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:18 devstack sudo[109244]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:18 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fd5cd53d-cd12-4e6a-ae12-505303b845fb tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-981d08c9-1150-4603-b14e-05ed00ceaa98.1ad3aaf5-0733-473d-a3ba-79fd52907876" returned: 0 in 0.333s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:18 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-fd5cd53d-cd12-4e6a-ae12-505303b845fb tempest-ProjectMemberTests-715789302 None] Lock "cinder-quobyte-1ad3aaf5-0733-473d-a3ba-79fd52907876" released by "_delete_snapshot" :: held 1.795s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:16:18 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-fd5cd53d-cd12-4e6a-ae12-505303b845fb tempest-ProjectMemberTests-715789302 None] Lock "cinder-quobyte-981d08c9-1150-4603-b14e-05ed00ceaa98" released by "delete_snapshot" :: held 1.833s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:16:19 devstack sudo[109254]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-775283e2-abd3-43b7-9e07-538e5e87f210 tempest-SnapshotDependencyTests-34318094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-5da13b5a-356a-490e-9374-87b405a4843e" returned: 0 in 0.324s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:19 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-fd5cd53d-cd12-4e6a-ae12-505303b845fb tempest-ProjectMemberTests-715789302 None] Created reservations ['1fc31982-7a2c-40b8-83a2-2e8cf3df9853', 'b232c8c5-1432-43be-9127-5d0cf10a2f60', 'd00f5dd9-0a42-4c37-88a4-bd020cb872f4', 'aae850d6-76aa-45d5-a406-b23a7f5f1172'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:16:19 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-775283e2-abd3-43b7-9e07-538e5e87f210 tempest-SnapshotDependencyTests-34318094 None] Lock "cinder-quobyte-5da13b5a-356a-490e-9374-87b405a4843e" released by "delete_volume" :: held 0.918s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:16:19 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-fd5cd53d-cd12-4e6a-ae12-505303b845fb tempest-ProjectMemberTests-715789302 None] Delete snapshot completed successfully. Aug 10 16:16:19 devstack sudo[109249]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-008d5a1b-c597-464c-95fd-ff2655d5d9d8 tempest-ProjectReaderTests-1092271699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-515d41d8-2658-4d8e-83fd-677e40ff1d44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-515d41d8-2658-4d8e-83fd-677e40ff1d44.3fba6c28-1f07-481e-9001-82f4f34f260c 1G" returned: 0 in 0.618s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-008d5a1b-c597-464c-95fd-ff2655d5d9d8 tempest-ProjectReaderTests-1092271699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-515d41d8-2658-4d8e-83fd-677e40ff1d44 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-515d41d8-2658-4d8e-83fd-677e40ff1d44.3fba6c28-1f07-481e-9001-82f4f34f260c {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:19 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-fd5cd53d-cd12-4e6a-ae12-505303b845fb tempest-ProjectMemberTests-715789302 None] Lock "cinder-1ad3aaf5-0733-473d-a3ba-79fd52907876-delete_snapshot" released by "delete_snapshot" :: held 2.198s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:16:19 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-775283e2-abd3-43b7-9e07-538e5e87f210 tempest-SnapshotDependencyTests-34318094 None] Created reservations ['c00364f9-f49d-4c5c-80b8-cc6703db125d', '7747cb58-4bbf-4757-ac35-d40bc294579c', '0fefc55e-7fda-4e75-8c6e-fa9971b29072', '691d7ea0-e23f-4e9a-b02f-cd0f056ac265'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:16:19 devstack sudo[109263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-515d41d8-2658-4d8e-83fd-677e40ff1d44 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-515d41d8-2658-4d8e-83fd-677e40ff1d44.3fba6c28-1f07-481e-9001-82f4f34f260c Aug 10 16:16:19 devstack sudo[109263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:19 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-862c5d7f-98c0-426b-9e97-81824406b49e tempest-ProjectMemberTests-715789302 None] Acquiring lock "cinder-981d08c9-1150-4603-b14e-05ed00ceaa98-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:16:19 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-862c5d7f-98c0-426b-9e97-81824406b49e tempest-ProjectMemberTests-715789302 None] Lock "cinder-981d08c9-1150-4603-b14e-05ed00ceaa98-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:16:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-775283e2-abd3-43b7-9e07-538e5e87f210 tempest-SnapshotDependencyTests-34318094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:16:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-775283e2-abd3-43b7-9e07-538e5e87f210 tempest-SnapshotDependencyTests-34318094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:16:19 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-775283e2-abd3-43b7-9e07-538e5e87f210 tempest-SnapshotDependencyTests-34318094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:16:19 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-775283e2-abd3-43b7-9e07-538e5e87f210 tempest-SnapshotDependencyTests-34318094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:16:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-775283e2-abd3-43b7-9e07-538e5e87f210 tempest-SnapshotDependencyTests-34318094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:16:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-775283e2-abd3-43b7-9e07-538e5e87f210 tempest-SnapshotDependencyTests-34318094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:19 devstack sudo[109265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:16:19 devstack sudo[109265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:19 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-862c5d7f-98c0-426b-9e97-81824406b49e tempest-ProjectMemberTests-715789302 None] Acquiring lock "cinder-quobyte-981d08c9-1150-4603-b14e-05ed00ceaa98" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:16:19 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-862c5d7f-98c0-426b-9e97-81824406b49e tempest-ProjectMemberTests-715789302 None] Lock "cinder-quobyte-981d08c9-1150-4603-b14e-05ed00ceaa98" acquired by "delete_volume" :: waited 0.019s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:16:19 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[361f86ef-076e-40a2-b058-2c2e33e5d19a]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:16:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-862c5d7f-98c0-426b-9e97-81824406b49e tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-981d08c9-1150-4603-b14e-05ed00ceaa98 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:19 devstack sudo[109263]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-008d5a1b-c597-464c-95fd-ff2655d5d9d8 tempest-ProjectReaderTests-1092271699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-515d41d8-2658-4d8e-83fd-677e40ff1d44 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-515d41d8-2658-4d8e-83fd-677e40ff1d44.3fba6c28-1f07-481e-9001-82f4f34f260c" returned: 0 in 0.420s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:19 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-008d5a1b-c597-464c-95fd-ff2655d5d9d8 tempest-ProjectReaderTests-1092271699 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-515d41d8-2658-4d8e-83fd-677e40ff1d44.3fba6c28-1f07-481e-9001-82f4f34f260c is being set with open permissions: ugo+rw Aug 10 16:16:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-008d5a1b-c597-464c-95fd-ff2655d5d9d8 tempest-ProjectReaderTests-1092271699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-515d41d8-2658-4d8e-83fd-677e40ff1d44.3fba6c28-1f07-481e-9001-82f4f34f260c {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:19 devstack sudo[109269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-981d08c9-1150-4603-b14e-05ed00ceaa98 Aug 10 16:16:19 devstack sudo[109269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:19 devstack sudo[109271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-515d41d8-2658-4d8e-83fd-677e40ff1d44.3fba6c28-1f07-481e-9001-82f4f34f260c Aug 10 16:16:19 devstack sudo[109271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:19 devstack sudo[109265]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-775283e2-abd3-43b7-9e07-538e5e87f210 tempest-SnapshotDependencyTests-34318094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.330s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:19 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-775283e2-abd3-43b7-9e07-538e5e87f210 tempest-SnapshotDependencyTests-34318094 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:16:19 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-775283e2-abd3-43b7-9e07-538e5e87f210 tempest-SnapshotDependencyTests-34318094 None] Deleted volume successfully. Aug 10 16:16:19 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-775283e2-abd3-43b7-9e07-538e5e87f210 tempest-SnapshotDependencyTests-34318094 None] Lock "cinder-5da13b5a-356a-490e-9374-87b405a4843e-delete_volume" released by "delete_volume" :: held 1.778s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:16:19 devstack sudo[109271]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-008d5a1b-c597-464c-95fd-ff2655d5d9d8 tempest-ProjectReaderTests-1092271699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-515d41d8-2658-4d8e-83fd-677e40ff1d44.3fba6c28-1f07-481e-9001-82f4f34f260c" returned: 0 in 0.276s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-008d5a1b-c597-464c-95fd-ff2655d5d9d8 tempest-ProjectReaderTests-1092271699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-515d41d8-2658-4d8e-83fd-677e40ff1d44.info {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:19 devstack sudo[109269]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-862c5d7f-98c0-426b-9e97-81824406b49e tempest-ProjectMemberTests-715789302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-981d08c9-1150-4603-b14e-05ed00ceaa98" returned: 0 in 0.441s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:19 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-862c5d7f-98c0-426b-9e97-81824406b49e tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-981d08c9-1150-4603-b14e-05ed00ceaa98 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:19 devstack sudo[109279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-515d41d8-2658-4d8e-83fd-677e40ff1d44.info Aug 10 16:16:19 devstack sudo[109279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:19 devstack sudo[109280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-981d08c9-1150-4603-b14e-05ed00ceaa98 Aug 10 16:16:19 devstack sudo[109280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:20 devstack sudo[109280]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:20 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-862c5d7f-98c0-426b-9e97-81824406b49e tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-981d08c9-1150-4603-b14e-05ed00ceaa98" returned: 0 in 0.339s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:20 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-862c5d7f-98c0-426b-9e97-81824406b49e tempest-ProjectMemberTests-715789302 None] Lock "cinder-quobyte-981d08c9-1150-4603-b14e-05ed00ceaa98" released by "delete_volume" :: held 0.868s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:16:20 devstack sudo[109279]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:20 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-008d5a1b-c597-464c-95fd-ff2655d5d9d8 tempest-ProjectReaderTests-1092271699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-515d41d8-2658-4d8e-83fd-677e40ff1d44.info" returned: 0 in 0.406s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:20 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-008d5a1b-c597-464c-95fd-ff2655d5d9d8 tempest-ProjectReaderTests-1092271699 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-515d41d8-2658-4d8e-83fd-677e40ff1d44.info is being set with open permissions: ugo+rw Aug 10 16:16:20 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-008d5a1b-c597-464c-95fd-ff2655d5d9d8 tempest-ProjectReaderTests-1092271699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-515d41d8-2658-4d8e-83fd-677e40ff1d44.info {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:20 devstack sudo[109285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-515d41d8-2658-4d8e-83fd-677e40ff1d44.info Aug 10 16:16:20 devstack sudo[109285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:20 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-862c5d7f-98c0-426b-9e97-81824406b49e tempest-ProjectMemberTests-715789302 None] Created reservations ['3d758666-aa35-4b46-b978-d923d04dcfb6', '9c111d5f-cfa5-43ca-b987-5ed911884f95', '36481b64-70ca-4b8c-98b2-b5b224dca82f', '23575ed5-8e7a-4bdf-b5e2-347bac351106'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:16:20 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-862c5d7f-98c0-426b-9e97-81824406b49e tempest-ProjectMemberTests-715789302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:16:20 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-862c5d7f-98c0-426b-9e97-81824406b49e tempest-ProjectMemberTests-715789302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:16:20 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-862c5d7f-98c0-426b-9e97-81824406b49e tempest-ProjectMemberTests-715789302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:16:20 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-862c5d7f-98c0-426b-9e97-81824406b49e tempest-ProjectMemberTests-715789302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:16:20 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-862c5d7f-98c0-426b-9e97-81824406b49e tempest-ProjectMemberTests-715789302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:16:20 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-862c5d7f-98c0-426b-9e97-81824406b49e tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:20 devstack sudo[109287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:16:20 devstack sudo[109287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:20 devstack sudo[109285]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:20 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-008d5a1b-c597-464c-95fd-ff2655d5d9d8 tempest-ProjectReaderTests-1092271699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-515d41d8-2658-4d8e-83fd-677e40ff1d44.info" returned: 0 in 0.386s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:20 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-008d5a1b-c597-464c-95fd-ff2655d5d9d8 tempest-ProjectReaderTests-1092271699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.712s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:16:20 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-008d5a1b-c597-464c-95fd-ff2655d5d9d8 tempest-ProjectReaderTests-1092271699 None] Create snapshot completed successfully Aug 10 16:16:20 devstack sudo[109287]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:20 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-862c5d7f-98c0-426b-9e97-81824406b49e tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.342s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:20 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-862c5d7f-98c0-426b-9e97-81824406b49e tempest-ProjectMemberTests-715789302 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:16:20 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-862c5d7f-98c0-426b-9e97-81824406b49e tempest-ProjectMemberTests-715789302 None] Deleted volume successfully. Aug 10 16:16:20 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-862c5d7f-98c0-426b-9e97-81824406b49e tempest-ProjectMemberTests-715789302 None] Lock "cinder-981d08c9-1150-4603-b14e-05ed00ceaa98-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:16:21 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-20bbd37c-9992-4351-9942-6a8b41d65219 tempest-ProjectReaderTests-1092271699 None] Acquiring lock "cinder-3fba6c28-1f07-481e-9001-82f4f34f260c-delete_snapshot" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:16:21 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-20bbd37c-9992-4351-9942-6a8b41d65219 tempest-ProjectReaderTests-1092271699 None] Lock "cinder-3fba6c28-1f07-481e-9001-82f4f34f260c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:16:21 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-20bbd37c-9992-4351-9942-6a8b41d65219 tempest-ProjectReaderTests-1092271699 None] Acquiring lock "cinder-quobyte-515d41d8-2658-4d8e-83fd-677e40ff1d44" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:16:21 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-20bbd37c-9992-4351-9942-6a8b41d65219 tempest-ProjectReaderTests-1092271699 None] Lock "cinder-quobyte-515d41d8-2658-4d8e-83fd-677e40ff1d44" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:16:21 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-20bbd37c-9992-4351-9942-6a8b41d65219 tempest-ProjectReaderTests-1092271699 None] Acquiring lock "cinder-quobyte-3fba6c28-1f07-481e-9001-82f4f34f260c" by "_delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:16:21 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-20bbd37c-9992-4351-9942-6a8b41d65219 tempest-ProjectReaderTests-1092271699 None] Lock "cinder-quobyte-3fba6c28-1f07-481e-9001-82f4f34f260c" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:16:21 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-20bbd37c-9992-4351-9942-6a8b41d65219 tempest-ProjectReaderTests-1092271699 None] Deleting offline snapshot 3fba6c28-1f07-481e-9001-82f4f34f260c of volume 515d41d8-2658-4d8e-83fd-677e40ff1d44 {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 16:16:21 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-20bbd37c-9992-4351-9942-6a8b41d65219 tempest-ProjectReaderTests-1092271699 None] snapshot_file for this snap is: volume-515d41d8-2658-4d8e-83fd-677e40ff1d44.3fba6c28-1f07-481e-9001-82f4f34f260c {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 16:16:21 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec4a498-4457-4d75-9c4e-68b4ccd3a93c]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:16:21 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-20bbd37c-9992-4351-9942-6a8b41d65219 tempest-ProjectReaderTests-1092271699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-515d41d8-2658-4d8e-83fd-677e40ff1d44.3fba6c28-1f07-481e-9001-82f4f34f260c {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:21 devstack sudo[109291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-515d41d8-2658-4d8e-83fd-677e40ff1d44.3fba6c28-1f07-481e-9001-82f4f34f260c Aug 10 16:16:21 devstack sudo[109291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:21 devstack sudo[109291]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:21 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-20bbd37c-9992-4351-9942-6a8b41d65219 tempest-ProjectReaderTests-1092271699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-515d41d8-2658-4d8e-83fd-677e40ff1d44.3fba6c28-1f07-481e-9001-82f4f34f260c" returned: 0 in 0.456s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:21 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-20bbd37c-9992-4351-9942-6a8b41d65219 tempest-ProjectReaderTests-1092271699 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-515d41d8-2658-4d8e-83fd-677e40ff1d44(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 16:16:21 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd506287-2085-4363-a73c-e41bb9326ca1]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:16:21 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-20bbd37c-9992-4351-9942-6a8b41d65219 tempest-ProjectReaderTests-1092271699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-515d41d8-2658-4d8e-83fd-677e40ff1d44 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:21 devstack sudo[109298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-515d41d8-2658-4d8e-83fd-677e40ff1d44 Aug 10 16:16:21 devstack sudo[109298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:22 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-86ae885c-52f3-4e70-ac85-fccbe0427eae tempest-ProjectMemberTests-715789302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:16:22 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-86ae885c-52f3-4e70-ac85-fccbe0427eae tempest-ProjectMemberTests-715789302 None] Flow 'volume_create_manager' (3e91d2c0-f074-423b-8561-554087cc1591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:16:22 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-86ae885c-52f3-4e70-ac85-fccbe0427eae tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff42cf33-fa95-48cb-b720-93f3b2f3c1c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:16:22 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-86ae885c-52f3-4e70-ac85-fccbe0427eae tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff42cf33-fa95-48cb-b720-93f3b2f3c1c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:16:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1084941582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6cfa05f-7ae8-4e69-8fc3-6be4766f9c78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8408ad471876405b8109f4d45d4a242d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:16:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:16:22Z,use_quota=True,user_id='dc958e8abfdb43a69a4609f15eb8d6d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:16:22 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-86ae885c-52f3-4e70-ac85-fccbe0427eae tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5f70996-bf25-4364-a8b4-ccc007390ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:16:22 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-86ae885c-52f3-4e70-ac85-fccbe0427eae tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5f70996-bf25-4364-a8b4-ccc007390ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:16:22 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-86ae885c-52f3-4e70-ac85-fccbe0427eae tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b40e7ae5-e230-4d15-a5b3-0980b37f1cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:16:22 devstack sudo[109298]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:22 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-86ae885c-52f3-4e70-ac85-fccbe0427eae tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b40e7ae5-e230-4d15-a5b3-0980b37f1cbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6cfa05f-7ae8-4e69-8fc3-6be4766f9c78', 'volume_name': 'volume-b6cfa05f-7ae8-4e69-8fc3-6be4766f9c78', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:16:22 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-86ae885c-52f3-4e70-ac85-fccbe0427eae tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f95d8898-a039-4000-89e4-6e9276f9769d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:16:22 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-86ae885c-52f3-4e70-ac85-fccbe0427eae tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f95d8898-a039-4000-89e4-6e9276f9769d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:16:22 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-86ae885c-52f3-4e70-ac85-fccbe0427eae tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61816383-b6c6-458f-a4bc-041940761114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:16:22 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-86ae885c-52f3-4e70-ac85-fccbe0427eae tempest-ProjectMemberTests-715789302 None] Volume b6cfa05f-7ae8-4e69-8fc3-6be4766f9c78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6cfa05f-7ae8-4e69-8fc3-6be4766f9c78', 'volume_size': 1} Aug 10 16:16:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-86ae885c-52f3-4e70-ac85-fccbe0427eae tempest-ProjectMemberTests-715789302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:16:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-86ae885c-52f3-4e70-ac85-fccbe0427eae tempest-ProjectMemberTests-715789302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:16:22 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-86ae885c-52f3-4e70-ac85-fccbe0427eae tempest-ProjectMemberTests-715789302 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:16:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1084941582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6cfa05f-7ae8-4e69-8fc3-6be4766f9c78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8408ad471876405b8109f4d45d4a242d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:16:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:16:22Z,use_quota=True,user_id='dc958e8abfdb43a69a4609f15eb8d6d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:16:22 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-86ae885c-52f3-4e70-ac85-fccbe0427eae tempest-ProjectMemberTests-715789302 None] Creating volume b6cfa05f-7ae8-4e69-8fc3-6be4766f9c78 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:16:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-86ae885c-52f3-4e70-ac85-fccbe0427eae tempest-ProjectMemberTests-715789302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:16:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-86ae885c-52f3-4e70-ac85-fccbe0427eae tempest-ProjectMemberTests-715789302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:16:22 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-86ae885c-52f3-4e70-ac85-fccbe0427eae tempest-ProjectMemberTests-715789302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:16:22 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-86ae885c-52f3-4e70-ac85-fccbe0427eae tempest-ProjectMemberTests-715789302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:16:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-86ae885c-52f3-4e70-ac85-fccbe0427eae tempest-ProjectMemberTests-715789302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:16:22 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-86ae885c-52f3-4e70-ac85-fccbe0427eae tempest-ProjectMemberTests-715789302 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:16:22 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-86ae885c-52f3-4e70-ac85-fccbe0427eae tempest-ProjectMemberTests-715789302 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:16:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-86ae885c-52f3-4e70-ac85-fccbe0427eae tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6cfa05f-7ae8-4e69-8fc3-6be4766f9c78 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-20bbd37c-9992-4351-9942-6a8b41d65219 tempest-ProjectReaderTests-1092271699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-515d41d8-2658-4d8e-83fd-677e40ff1d44" returned: 0 in 0.619s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-20bbd37c-9992-4351-9942-6a8b41d65219 tempest-ProjectReaderTests-1092271699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-515d41d8-2658-4d8e-83fd-677e40ff1d44.3fba6c28-1f07-481e-9001-82f4f34f260c {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:22 devstack sudo[109305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6cfa05f-7ae8-4e69-8fc3-6be4766f9c78 1073741824 Aug 10 16:16:22 devstack sudo[109305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:22 devstack sudo[109306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-515d41d8-2658-4d8e-83fd-677e40ff1d44.3fba6c28-1f07-481e-9001-82f4f34f260c Aug 10 16:16:22 devstack sudo[109306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:22 devstack sudo[109306]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-20bbd37c-9992-4351-9942-6a8b41d65219 tempest-ProjectReaderTests-1092271699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-515d41d8-2658-4d8e-83fd-677e40ff1d44.3fba6c28-1f07-481e-9001-82f4f34f260c" returned: 0 in 0.461s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-20bbd37c-9992-4351-9942-6a8b41d65219 tempest-ProjectReaderTests-1092271699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-515d41d8-2658-4d8e-83fd-677e40ff1d44.3fba6c28-1f07-481e-9001-82f4f34f260c {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:22 devstack sudo[109318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-515d41d8-2658-4d8e-83fd-677e40ff1d44.3fba6c28-1f07-481e-9001-82f4f34f260c Aug 10 16:16:22 devstack sudo[109305]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:22 devstack sudo[109318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-86ae885c-52f3-4e70-ac85-fccbe0427eae tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6cfa05f-7ae8-4e69-8fc3-6be4766f9c78 1073741824" returned: 0 in 0.522s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:22 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-86ae885c-52f3-4e70-ac85-fccbe0427eae tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6cfa05f-7ae8-4e69-8fc3-6be4766f9c78 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:23 devstack sudo[109320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6cfa05f-7ae8-4e69-8fc3-6be4766f9c78 Aug 10 16:16:23 devstack sudo[109320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:23 devstack sudo[109318]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:23 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-20bbd37c-9992-4351-9942-6a8b41d65219 tempest-ProjectReaderTests-1092271699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-515d41d8-2658-4d8e-83fd-677e40ff1d44.3fba6c28-1f07-481e-9001-82f4f34f260c" returned: 0 in 0.362s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:23 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-20bbd37c-9992-4351-9942-6a8b41d65219 tempest-ProjectReaderTests-1092271699 None] Lock "cinder-quobyte-3fba6c28-1f07-481e-9001-82f4f34f260c" released by "_delete_snapshot" :: held 2.036s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:16:23 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-20bbd37c-9992-4351-9942-6a8b41d65219 tempest-ProjectReaderTests-1092271699 None] Lock "cinder-quobyte-515d41d8-2658-4d8e-83fd-677e40ff1d44" released by "delete_snapshot" :: held 2.077s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:16:23 devstack sudo[109320]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:23 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-86ae885c-52f3-4e70-ac85-fccbe0427eae tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6cfa05f-7ae8-4e69-8fc3-6be4766f9c78" returned: 0 in 0.396s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:23 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-86ae885c-52f3-4e70-ac85-fccbe0427eae tempest-ProjectMemberTests-715789302 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:16:23 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-86ae885c-52f3-4e70-ac85-fccbe0427eae tempest-ProjectMemberTests-715789302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:16:23 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-86ae885c-52f3-4e70-ac85-fccbe0427eae tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61816383-b6c6-458f-a4bc-041940761114) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6cfa05f-7ae8-4e69-8fc3-6be4766f9c78', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:16:23 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-86ae885c-52f3-4e70-ac85-fccbe0427eae tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b675a242-3768-49f9-a555-3b0cf94c937e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:16:23 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-86ae885c-52f3-4e70-ac85-fccbe0427eae tempest-ProjectMemberTests-715789302 None] Volume volume-b6cfa05f-7ae8-4e69-8fc3-6be4766f9c78 (b6cfa05f-7ae8-4e69-8fc3-6be4766f9c78): created successfully Aug 10 16:16:23 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-86ae885c-52f3-4e70-ac85-fccbe0427eae tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b675a242-3768-49f9-a555-3b0cf94c937e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:16:23 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-86ae885c-52f3-4e70-ac85-fccbe0427eae tempest-ProjectMemberTests-715789302 None] Flow 'volume_create_manager' (3e91d2c0-f074-423b-8561-554087cc1591) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:16:23 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-20bbd37c-9992-4351-9942-6a8b41d65219 tempest-ProjectReaderTests-1092271699 None] Created reservations ['aa478d27-2511-4309-adbb-7f32cdb90e8f', 'eca6010c-b408-45e9-962a-bd414b534de3', 'c98c0ff0-87aa-448d-909f-3498f41b322e', '6c0d4841-409b-4945-88a1-4db50c5e663b'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:16:23 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-86ae885c-52f3-4e70-ac85-fccbe0427eae tempest-ProjectMemberTests-715789302 None] Created volume successfully. Aug 10 16:16:23 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-20bbd37c-9992-4351-9942-6a8b41d65219 tempest-ProjectReaderTests-1092271699 None] Delete snapshot completed successfully. Aug 10 16:16:23 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-20bbd37c-9992-4351-9942-6a8b41d65219 tempest-ProjectReaderTests-1092271699 None] Lock "cinder-3fba6c28-1f07-481e-9001-82f4f34f260c-delete_snapshot" released by "delete_snapshot" :: held 2.314s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:16:24 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-3049f989-aa78-4963-82b4-949e0d1a9d85 tempest-ProjectReaderTests-1092271699 None] Acquiring lock "cinder-515d41d8-2658-4d8e-83fd-677e40ff1d44-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:16:24 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-f125abc5-18ac-4ba7-a1e9-e6683d0da882 tempest-ProjectMemberTests-715789302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:16:24 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-f125abc5-18ac-4ba7-a1e9-e6683d0da882 tempest-ProjectMemberTests-715789302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:16:24 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-3049f989-aa78-4963-82b4-949e0d1a9d85 tempest-ProjectReaderTests-1092271699 None] Lock "cinder-515d41d8-2658-4d8e-83fd-677e40ff1d44-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:16:24 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-f125abc5-18ac-4ba7-a1e9-e6683d0da882 tempest-ProjectMemberTests-715789302 None] Creating offline snapshot e8ebe15c-4cd5-4c08-b2b4-272160209513 of volume b6cfa05f-7ae8-4e69-8fc3-6be4766f9c78 {{(pid=88641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 16:16:24 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e6ada06-2537-4fc7-953c-5907ce3d560e]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:16:24 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-f125abc5-18ac-4ba7-a1e9-e6683d0da882 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6cfa05f-7ae8-4e69-8fc3-6be4766f9c78 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:24 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-3049f989-aa78-4963-82b4-949e0d1a9d85 tempest-ProjectReaderTests-1092271699 None] Acquiring lock "cinder-quobyte-515d41d8-2658-4d8e-83fd-677e40ff1d44" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:16:24 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-3049f989-aa78-4963-82b4-949e0d1a9d85 tempest-ProjectReaderTests-1092271699 None] Lock "cinder-quobyte-515d41d8-2658-4d8e-83fd-677e40ff1d44" acquired by "delete_volume" :: waited 0.038s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:16:24 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[52fae7f6-f999-4489-a194-2e8ddc2c01be]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:16:24 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-3049f989-aa78-4963-82b4-949e0d1a9d85 tempest-ProjectReaderTests-1092271699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-515d41d8-2658-4d8e-83fd-677e40ff1d44 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:24 devstack sudo[109324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6cfa05f-7ae8-4e69-8fc3-6be4766f9c78 Aug 10 16:16:24 devstack sudo[109324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:25 devstack sudo[109325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-515d41d8-2658-4d8e-83fd-677e40ff1d44 Aug 10 16:16:25 devstack sudo[109325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:25 devstack sudo[109324]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:25 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-f125abc5-18ac-4ba7-a1e9-e6683d0da882 tempest-ProjectMemberTests-715789302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6cfa05f-7ae8-4e69-8fc3-6be4766f9c78" returned: 0 in 0.505s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:25 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-f125abc5-18ac-4ba7-a1e9-e6683d0da882 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6cfa05f-7ae8-4e69-8fc3-6be4766f9c78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6cfa05f-7ae8-4e69-8fc3-6be4766f9c78.e8ebe15c-4cd5-4c08-b2b4-272160209513 1G {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:25 devstack sudo[109333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6cfa05f-7ae8-4e69-8fc3-6be4766f9c78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6cfa05f-7ae8-4e69-8fc3-6be4766f9c78.e8ebe15c-4cd5-4c08-b2b4-272160209513 1G Aug 10 16:16:25 devstack sudo[109333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:25 devstack sudo[109325]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:25 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-3049f989-aa78-4963-82b4-949e0d1a9d85 tempest-ProjectReaderTests-1092271699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-515d41d8-2658-4d8e-83fd-677e40ff1d44" returned: 0 in 0.495s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:25 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-3049f989-aa78-4963-82b4-949e0d1a9d85 tempest-ProjectReaderTests-1092271699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-515d41d8-2658-4d8e-83fd-677e40ff1d44 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:25 devstack sudo[109337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-515d41d8-2658-4d8e-83fd-677e40ff1d44 Aug 10 16:16:25 devstack sudo[109337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:25 devstack sudo[109337]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:25 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-3049f989-aa78-4963-82b4-949e0d1a9d85 tempest-ProjectReaderTests-1092271699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-515d41d8-2658-4d8e-83fd-677e40ff1d44" returned: 0 in 0.444s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:25 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-3049f989-aa78-4963-82b4-949e0d1a9d85 tempest-ProjectReaderTests-1092271699 None] Lock "cinder-quobyte-515d41d8-2658-4d8e-83fd-677e40ff1d44" released by "delete_volume" :: held 1.024s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:16:25 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-3049f989-aa78-4963-82b4-949e0d1a9d85 tempest-ProjectReaderTests-1092271699 None] Created reservations ['7d4526af-db0c-49c3-bb7e-32cc7a7a48aa', '9ebb602b-4aa1-4bca-a15d-b17382cd322a', 'a635c805-7c52-4819-a030-8386a48ffeec', '295b997b-797a-4137-8d70-05033b391a4f'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:16:25 devstack sudo[109333]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:26 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-f125abc5-18ac-4ba7-a1e9-e6683d0da882 tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6cfa05f-7ae8-4e69-8fc3-6be4766f9c78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6cfa05f-7ae8-4e69-8fc3-6be4766f9c78.e8ebe15c-4cd5-4c08-b2b4-272160209513 1G" returned: 0 in 0.731s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:26 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-f125abc5-18ac-4ba7-a1e9-e6683d0da882 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6cfa05f-7ae8-4e69-8fc3-6be4766f9c78 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6cfa05f-7ae8-4e69-8fc3-6be4766f9c78.e8ebe15c-4cd5-4c08-b2b4-272160209513 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:26 devstack sudo[109345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6cfa05f-7ae8-4e69-8fc3-6be4766f9c78 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6cfa05f-7ae8-4e69-8fc3-6be4766f9c78.e8ebe15c-4cd5-4c08-b2b4-272160209513 Aug 10 16:16:26 devstack sudo[109345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:26 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-3049f989-aa78-4963-82b4-949e0d1a9d85 tempest-ProjectReaderTests-1092271699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:16:26 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-3049f989-aa78-4963-82b4-949e0d1a9d85 tempest-ProjectReaderTests-1092271699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:16:26 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-3049f989-aa78-4963-82b4-949e0d1a9d85 tempest-ProjectReaderTests-1092271699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:16:26 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-3049f989-aa78-4963-82b4-949e0d1a9d85 tempest-ProjectReaderTests-1092271699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:16:26 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-3049f989-aa78-4963-82b4-949e0d1a9d85 tempest-ProjectReaderTests-1092271699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:16:26 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-3049f989-aa78-4963-82b4-949e0d1a9d85 tempest-ProjectReaderTests-1092271699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:26 devstack sudo[109347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:16:26 devstack sudo[109347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:26 devstack sudo[109345]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:26 devstack sudo[109347]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:26 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-f125abc5-18ac-4ba7-a1e9-e6683d0da882 tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6cfa05f-7ae8-4e69-8fc3-6be4766f9c78 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6cfa05f-7ae8-4e69-8fc3-6be4766f9c78.e8ebe15c-4cd5-4c08-b2b4-272160209513" returned: 0 in 0.345s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:26 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-3049f989-aa78-4963-82b4-949e0d1a9d85 tempest-ProjectReaderTests-1092271699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.280s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:26 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-f125abc5-18ac-4ba7-a1e9-e6683d0da882 tempest-ProjectMemberTests-715789302 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6cfa05f-7ae8-4e69-8fc3-6be4766f9c78.e8ebe15c-4cd5-4c08-b2b4-272160209513 is being set with open permissions: ugo+rw Aug 10 16:16:26 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-f125abc5-18ac-4ba7-a1e9-e6683d0da882 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6cfa05f-7ae8-4e69-8fc3-6be4766f9c78.e8ebe15c-4cd5-4c08-b2b4-272160209513 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:26 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-3049f989-aa78-4963-82b4-949e0d1a9d85 tempest-ProjectReaderTests-1092271699 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:16:26 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-3049f989-aa78-4963-82b4-949e0d1a9d85 tempest-ProjectReaderTests-1092271699 None] Deleted volume successfully. Aug 10 16:16:26 devstack sudo[109353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6cfa05f-7ae8-4e69-8fc3-6be4766f9c78.e8ebe15c-4cd5-4c08-b2b4-272160209513 Aug 10 16:16:26 devstack sudo[109353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:26 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-3049f989-aa78-4963-82b4-949e0d1a9d85 tempest-ProjectReaderTests-1092271699 None] Lock "cinder-515d41d8-2658-4d8e-83fd-677e40ff1d44-delete_volume" released by "delete_volume" :: held 1.706s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:16:26 devstack sudo[109353]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:26 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-f125abc5-18ac-4ba7-a1e9-e6683d0da882 tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6cfa05f-7ae8-4e69-8fc3-6be4766f9c78.e8ebe15c-4cd5-4c08-b2b4-272160209513" returned: 0 in 0.283s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:26 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-f125abc5-18ac-4ba7-a1e9-e6683d0da882 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6cfa05f-7ae8-4e69-8fc3-6be4766f9c78.info {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:26 devstack sudo[109356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6cfa05f-7ae8-4e69-8fc3-6be4766f9c78.info Aug 10 16:16:26 devstack sudo[109356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:27 devstack sudo[109356]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:27 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-f125abc5-18ac-4ba7-a1e9-e6683d0da882 tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6cfa05f-7ae8-4e69-8fc3-6be4766f9c78.info" returned: 0 in 0.373s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:27 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-f125abc5-18ac-4ba7-a1e9-e6683d0da882 tempest-ProjectMemberTests-715789302 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6cfa05f-7ae8-4e69-8fc3-6be4766f9c78.info is being set with open permissions: ugo+rw Aug 10 16:16:27 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-f125abc5-18ac-4ba7-a1e9-e6683d0da882 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6cfa05f-7ae8-4e69-8fc3-6be4766f9c78.info {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:27 devstack sudo[109360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6cfa05f-7ae8-4e69-8fc3-6be4766f9c78.info Aug 10 16:16:27 devstack sudo[109360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:27 devstack sudo[109360]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:27 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-f125abc5-18ac-4ba7-a1e9-e6683d0da882 tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6cfa05f-7ae8-4e69-8fc3-6be4766f9c78.info" returned: 0 in 0.380s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:27 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-f125abc5-18ac-4ba7-a1e9-e6683d0da882 tempest-ProjectMemberTests-715789302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.750s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:16:27 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-f125abc5-18ac-4ba7-a1e9-e6683d0da882 tempest-ProjectMemberTests-715789302 None] Create snapshot completed successfully Aug 10 16:16:28 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-b9919aef-7ff2-4e78-9fe3-835bb468e117 tempest-ProjectMemberTests-715789302 None] Acquiring lock "cinder-e8ebe15c-4cd5-4c08-b2b4-272160209513-delete_snapshot" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:16:28 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-b9919aef-7ff2-4e78-9fe3-835bb468e117 tempest-ProjectMemberTests-715789302 None] Lock "cinder-e8ebe15c-4cd5-4c08-b2b4-272160209513-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:16:28 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-b9919aef-7ff2-4e78-9fe3-835bb468e117 tempest-ProjectMemberTests-715789302 None] Acquiring lock "cinder-quobyte-b6cfa05f-7ae8-4e69-8fc3-6be4766f9c78" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:16:28 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-b9919aef-7ff2-4e78-9fe3-835bb468e117 tempest-ProjectMemberTests-715789302 None] Lock "cinder-quobyte-b6cfa05f-7ae8-4e69-8fc3-6be4766f9c78" acquired by "delete_snapshot" :: waited 0.036s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:16:28 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-b9919aef-7ff2-4e78-9fe3-835bb468e117 tempest-ProjectMemberTests-715789302 None] Acquiring lock "cinder-quobyte-e8ebe15c-4cd5-4c08-b2b4-272160209513" by "_delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:16:28 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-b9919aef-7ff2-4e78-9fe3-835bb468e117 tempest-ProjectMemberTests-715789302 None] Lock "cinder-quobyte-e8ebe15c-4cd5-4c08-b2b4-272160209513" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:16:28 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-b9919aef-7ff2-4e78-9fe3-835bb468e117 tempest-ProjectMemberTests-715789302 None] Deleting offline snapshot e8ebe15c-4cd5-4c08-b2b4-272160209513 of volume b6cfa05f-7ae8-4e69-8fc3-6be4766f9c78 {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 16:16:28 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-b9919aef-7ff2-4e78-9fe3-835bb468e117 tempest-ProjectMemberTests-715789302 None] snapshot_file for this snap is: volume-b6cfa05f-7ae8-4e69-8fc3-6be4766f9c78.e8ebe15c-4cd5-4c08-b2b4-272160209513 {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 16:16:28 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbfa118d-79c0-4056-a55e-8492944d70b9]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:16:28 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b9919aef-7ff2-4e78-9fe3-835bb468e117 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6cfa05f-7ae8-4e69-8fc3-6be4766f9c78.e8ebe15c-4cd5-4c08-b2b4-272160209513 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:28 devstack sudo[109364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6cfa05f-7ae8-4e69-8fc3-6be4766f9c78.e8ebe15c-4cd5-4c08-b2b4-272160209513 Aug 10 16:16:28 devstack sudo[109364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:28 devstack sudo[109364]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:28 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b9919aef-7ff2-4e78-9fe3-835bb468e117 tempest-ProjectMemberTests-715789302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6cfa05f-7ae8-4e69-8fc3-6be4766f9c78.e8ebe15c-4cd5-4c08-b2b4-272160209513" returned: 0 in 0.423s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:28 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-b9919aef-7ff2-4e78-9fe3-835bb468e117 tempest-ProjectMemberTests-715789302 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6cfa05f-7ae8-4e69-8fc3-6be4766f9c78(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 16:16:28 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5922ffe-3ade-4174-a781-01308ef6ea4e]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:16:28 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b9919aef-7ff2-4e78-9fe3-835bb468e117 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6cfa05f-7ae8-4e69-8fc3-6be4766f9c78 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:28 devstack sudo[109369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6cfa05f-7ae8-4e69-8fc3-6be4766f9c78 Aug 10 16:16:28 devstack sudo[109369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:29 devstack sudo[109369]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:29 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b9919aef-7ff2-4e78-9fe3-835bb468e117 tempest-ProjectMemberTests-715789302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6cfa05f-7ae8-4e69-8fc3-6be4766f9c78" returned: 0 in 0.463s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:29 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b9919aef-7ff2-4e78-9fe3-835bb468e117 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6cfa05f-7ae8-4e69-8fc3-6be4766f9c78.e8ebe15c-4cd5-4c08-b2b4-272160209513 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:29 devstack sudo[109374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6cfa05f-7ae8-4e69-8fc3-6be4766f9c78.e8ebe15c-4cd5-4c08-b2b4-272160209513 Aug 10 16:16:29 devstack sudo[109374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:29 devstack sudo[109374]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:29 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b9919aef-7ff2-4e78-9fe3-835bb468e117 tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6cfa05f-7ae8-4e69-8fc3-6be4766f9c78.e8ebe15c-4cd5-4c08-b2b4-272160209513" returned: 0 in 0.381s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:29 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b9919aef-7ff2-4e78-9fe3-835bb468e117 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6cfa05f-7ae8-4e69-8fc3-6be4766f9c78.e8ebe15c-4cd5-4c08-b2b4-272160209513 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:29 devstack sudo[109380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6cfa05f-7ae8-4e69-8fc3-6be4766f9c78.e8ebe15c-4cd5-4c08-b2b4-272160209513 Aug 10 16:16:29 devstack sudo[109380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:29 devstack sudo[109380]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:29 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b9919aef-7ff2-4e78-9fe3-835bb468e117 tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6cfa05f-7ae8-4e69-8fc3-6be4766f9c78.e8ebe15c-4cd5-4c08-b2b4-272160209513" returned: 0 in 0.295s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:29 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-b9919aef-7ff2-4e78-9fe3-835bb468e117 tempest-ProjectMemberTests-715789302 None] Lock "cinder-quobyte-e8ebe15c-4cd5-4c08-b2b4-272160209513" released by "_delete_snapshot" :: held 1.714s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:16:29 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-b9919aef-7ff2-4e78-9fe3-835bb468e117 tempest-ProjectMemberTests-715789302 None] Lock "cinder-quobyte-b6cfa05f-7ae8-4e69-8fc3-6be4766f9c78" released by "delete_snapshot" :: held 1.743s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:16:29 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-b9919aef-7ff2-4e78-9fe3-835bb468e117 tempest-ProjectMemberTests-715789302 None] Created reservations ['ca1cd59a-135f-4eba-87e2-52bbdbfafca7', 'a8910de7-3cca-477f-8ae9-b0f315a978f8', '11bd5288-f980-46c5-a676-ae6b002cc1ab', 'f6c7198b-28d5-420a-82b2-c68821d6e8ec'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:16:30 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-b9919aef-7ff2-4e78-9fe3-835bb468e117 tempest-ProjectMemberTests-715789302 None] Delete snapshot completed successfully. Aug 10 16:16:30 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-b9919aef-7ff2-4e78-9fe3-835bb468e117 tempest-ProjectMemberTests-715789302 None] Lock "cinder-e8ebe15c-4cd5-4c08-b2b4-272160209513-delete_snapshot" released by "delete_snapshot" :: held 1.964s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:16:30 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-85ab24dd-31e3-4bc3-a404-0ab648b6bfe3 tempest-ProjectMemberTests-715789302 None] Acquiring lock "cinder-b6cfa05f-7ae8-4e69-8fc3-6be4766f9c78-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:16:30 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-85ab24dd-31e3-4bc3-a404-0ab648b6bfe3 tempest-ProjectMemberTests-715789302 None] Lock "cinder-b6cfa05f-7ae8-4e69-8fc3-6be4766f9c78-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:16:30 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-85ab24dd-31e3-4bc3-a404-0ab648b6bfe3 tempest-ProjectMemberTests-715789302 None] Acquiring lock "cinder-quobyte-b6cfa05f-7ae8-4e69-8fc3-6be4766f9c78" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:16:30 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-85ab24dd-31e3-4bc3-a404-0ab648b6bfe3 tempest-ProjectMemberTests-715789302 None] Lock "cinder-quobyte-b6cfa05f-7ae8-4e69-8fc3-6be4766f9c78" acquired by "delete_volume" :: waited 0.026s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:16:30 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[a47e2f2f-d2ef-4f7b-b271-6c86bbed22e5]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:16:30 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-85ab24dd-31e3-4bc3-a404-0ab648b6bfe3 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6cfa05f-7ae8-4e69-8fc3-6be4766f9c78 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:30 devstack sudo[109383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6cfa05f-7ae8-4e69-8fc3-6be4766f9c78 Aug 10 16:16:30 devstack sudo[109383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:30 devstack sudo[109383]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:30 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-85ab24dd-31e3-4bc3-a404-0ab648b6bfe3 tempest-ProjectMemberTests-715789302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6cfa05f-7ae8-4e69-8fc3-6be4766f9c78" returned: 0 in 0.457s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:30 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-85ab24dd-31e3-4bc3-a404-0ab648b6bfe3 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6cfa05f-7ae8-4e69-8fc3-6be4766f9c78 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:30 devstack sudo[109388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6cfa05f-7ae8-4e69-8fc3-6be4766f9c78 Aug 10 16:16:30 devstack sudo[109388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:31 devstack sudo[109388]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:31 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-85ab24dd-31e3-4bc3-a404-0ab648b6bfe3 tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-b6cfa05f-7ae8-4e69-8fc3-6be4766f9c78" returned: 0 in 0.330s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:31 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-85ab24dd-31e3-4bc3-a404-0ab648b6bfe3 tempest-ProjectMemberTests-715789302 None] Lock "cinder-quobyte-b6cfa05f-7ae8-4e69-8fc3-6be4766f9c78" released by "delete_volume" :: held 0.898s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:16:31 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-85ab24dd-31e3-4bc3-a404-0ab648b6bfe3 tempest-ProjectMemberTests-715789302 None] Created reservations ['01c8aab5-e7ff-49cd-932f-c8fb88f09dc4', '81aae84c-f228-44a7-b5a1-6df8d49b9ba8', '0b6c17b3-60c7-4b83-89b3-ce7c4fcd1152', '8298a359-b693-4555-a3ea-381f68791673'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:16:31 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-85ab24dd-31e3-4bc3-a404-0ab648b6bfe3 tempest-ProjectMemberTests-715789302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:16:31 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-85ab24dd-31e3-4bc3-a404-0ab648b6bfe3 tempest-ProjectMemberTests-715789302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:16:31 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-85ab24dd-31e3-4bc3-a404-0ab648b6bfe3 tempest-ProjectMemberTests-715789302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:16:31 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-85ab24dd-31e3-4bc3-a404-0ab648b6bfe3 tempest-ProjectMemberTests-715789302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:16:31 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-85ab24dd-31e3-4bc3-a404-0ab648b6bfe3 tempest-ProjectMemberTests-715789302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:16:31 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-85ab24dd-31e3-4bc3-a404-0ab648b6bfe3 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:31 devstack sudo[109392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:16:31 devstack sudo[109392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:31 devstack sudo[109392]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:31 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-85ab24dd-31e3-4bc3-a404-0ab648b6bfe3 tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.336s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:31 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-85ab24dd-31e3-4bc3-a404-0ab648b6bfe3 tempest-ProjectMemberTests-715789302 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:16:31 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-85ab24dd-31e3-4bc3-a404-0ab648b6bfe3 tempest-ProjectMemberTests-715789302 None] Deleted volume successfully. Aug 10 16:16:31 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-85ab24dd-31e3-4bc3-a404-0ab648b6bfe3 tempest-ProjectMemberTests-715789302 None] Lock "cinder-b6cfa05f-7ae8-4e69-8fc3-6be4766f9c78-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:16:32 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-49cbead3-4f9e-4629-bb95-747d80d487b3 tempest-ProjectMemberTests-715789302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:16:32 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-49cbead3-4f9e-4629-bb95-747d80d487b3 tempest-ProjectMemberTests-715789302 None] Flow 'volume_create_manager' (4e4e8a64-d923-4d44-b52d-445b08cca8e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:16:32 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-49cbead3-4f9e-4629-bb95-747d80d487b3 tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a7186d1-55ef-418c-9d5d-15d6d3ce61ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:16:32 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-49cbead3-4f9e-4629-bb95-747d80d487b3 tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a7186d1-55ef-418c-9d5d-15d6d3ce61ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:16:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2027566126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2af76e73-614c-4590-99de-bbd58113a1e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8408ad471876405b8109f4d45d4a242d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:16:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:16:32Z,use_quota=True,user_id='dc958e8abfdb43a69a4609f15eb8d6d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:16:32 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-49cbead3-4f9e-4629-bb95-747d80d487b3 tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4430660c-47da-4c84-9f1a-d5d36a6119e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:16:32 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-49cbead3-4f9e-4629-bb95-747d80d487b3 tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4430660c-47da-4c84-9f1a-d5d36a6119e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:16:32 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-49cbead3-4f9e-4629-bb95-747d80d487b3 tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7aa8b81d-3582-4c96-a202-e68d2d13255b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:16:32 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-49cbead3-4f9e-4629-bb95-747d80d487b3 tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7aa8b81d-3582-4c96-a202-e68d2d13255b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2af76e73-614c-4590-99de-bbd58113a1e9', 'volume_name': 'volume-2af76e73-614c-4590-99de-bbd58113a1e9', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:16:32 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-49cbead3-4f9e-4629-bb95-747d80d487b3 tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87759bc7-309d-4d3b-8f65-f732cb2b39a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:16:32 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-49cbead3-4f9e-4629-bb95-747d80d487b3 tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87759bc7-309d-4d3b-8f65-f732cb2b39a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:16:32 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-49cbead3-4f9e-4629-bb95-747d80d487b3 tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c8e893e-c137-4860-80e2-d06e66b6cc64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:16:32 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-49cbead3-4f9e-4629-bb95-747d80d487b3 tempest-ProjectMemberTests-715789302 None] Volume 2af76e73-614c-4590-99de-bbd58113a1e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2af76e73-614c-4590-99de-bbd58113a1e9', 'volume_size': 1} Aug 10 16:16:32 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-49cbead3-4f9e-4629-bb95-747d80d487b3 tempest-ProjectMemberTests-715789302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:16:32 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-49cbead3-4f9e-4629-bb95-747d80d487b3 tempest-ProjectMemberTests-715789302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:16:32 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-49cbead3-4f9e-4629-bb95-747d80d487b3 tempest-ProjectMemberTests-715789302 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:16:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2027566126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2af76e73-614c-4590-99de-bbd58113a1e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8408ad471876405b8109f4d45d4a242d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:16:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:16:32Z,use_quota=True,user_id='dc958e8abfdb43a69a4609f15eb8d6d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:16:32 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-49cbead3-4f9e-4629-bb95-747d80d487b3 tempest-ProjectMemberTests-715789302 None] Creating volume 2af76e73-614c-4590-99de-bbd58113a1e9 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:16:32 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-49cbead3-4f9e-4629-bb95-747d80d487b3 tempest-ProjectMemberTests-715789302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:16:32 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-49cbead3-4f9e-4629-bb95-747d80d487b3 tempest-ProjectMemberTests-715789302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:16:32 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-49cbead3-4f9e-4629-bb95-747d80d487b3 tempest-ProjectMemberTests-715789302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:16:32 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-49cbead3-4f9e-4629-bb95-747d80d487b3 tempest-ProjectMemberTests-715789302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:16:32 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-49cbead3-4f9e-4629-bb95-747d80d487b3 tempest-ProjectMemberTests-715789302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:16:32 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-49cbead3-4f9e-4629-bb95-747d80d487b3 tempest-ProjectMemberTests-715789302 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:16:32 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-49cbead3-4f9e-4629-bb95-747d80d487b3 tempest-ProjectMemberTests-715789302 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:16:32 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-49cbead3-4f9e-4629-bb95-747d80d487b3 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2af76e73-614c-4590-99de-bbd58113a1e9 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:32 devstack sudo[109395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2af76e73-614c-4590-99de-bbd58113a1e9 1073741824 Aug 10 16:16:32 devstack sudo[109395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:32 devstack sudo[109395]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:32 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-49cbead3-4f9e-4629-bb95-747d80d487b3 tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2af76e73-614c-4590-99de-bbd58113a1e9 1073741824" returned: 0 in 0.576s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:32 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-49cbead3-4f9e-4629-bb95-747d80d487b3 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2af76e73-614c-4590-99de-bbd58113a1e9 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:32 devstack sudo[109402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2af76e73-614c-4590-99de-bbd58113a1e9 Aug 10 16:16:32 devstack sudo[109402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:33 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-e105b8bc-a942-4d34-aab6-a0b64908e564 tempest-ProjectReaderTests-1586271177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:16:33 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-e105b8bc-a942-4d34-aab6-a0b64908e564 tempest-ProjectReaderTests-1586271177 None] Flow 'volume_create_manager' (96fb199c-0057-4ac4-aee4-c8c1e7446366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:16:33 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-e105b8bc-a942-4d34-aab6-a0b64908e564 tempest-ProjectReaderTests-1586271177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64a10b52-d10a-4933-9219-885973f9788f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:16:33 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-e105b8bc-a942-4d34-aab6-a0b64908e564 tempest-ProjectReaderTests-1586271177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64a10b52-d10a-4933-9219-885973f9788f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:16:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1558052940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d206f4eb-891f-467e-83e4-1188ee427b12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53aab7478843407697fb167d35e29d43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:16:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:16:33Z,use_quota=True,user_id='09496d3eeb39485892584a6b8ffc7e97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:16:33 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-e105b8bc-a942-4d34-aab6-a0b64908e564 tempest-ProjectReaderTests-1586271177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (656b018d-77d6-409b-a8c4-48dc19a66a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:16:33 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-e105b8bc-a942-4d34-aab6-a0b64908e564 tempest-ProjectReaderTests-1586271177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (656b018d-77d6-409b-a8c4-48dc19a66a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:16:33 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-e105b8bc-a942-4d34-aab6-a0b64908e564 tempest-ProjectReaderTests-1586271177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0db9206-a9d8-4aa9-8e07-aae5bf0291c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:16:33 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-e105b8bc-a942-4d34-aab6-a0b64908e564 tempest-ProjectReaderTests-1586271177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0db9206-a9d8-4aa9-8e07-aae5bf0291c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd206f4eb-891f-467e-83e4-1188ee427b12', 'volume_name': 'volume-d206f4eb-891f-467e-83e4-1188ee427b12', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:16:33 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-e105b8bc-a942-4d34-aab6-a0b64908e564 tempest-ProjectReaderTests-1586271177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0edcb77d-6cfd-44d9-a319-311c55418b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:16:33 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-e105b8bc-a942-4d34-aab6-a0b64908e564 tempest-ProjectReaderTests-1586271177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0edcb77d-6cfd-44d9-a319-311c55418b0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:16:33 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-e105b8bc-a942-4d34-aab6-a0b64908e564 tempest-ProjectReaderTests-1586271177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62c8b3d0-449e-457d-b095-194a47aaa13d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:16:33 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-e105b8bc-a942-4d34-aab6-a0b64908e564 tempest-ProjectReaderTests-1586271177 None] Volume d206f4eb-891f-467e-83e4-1188ee427b12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d206f4eb-891f-467e-83e4-1188ee427b12', 'volume_size': 1} Aug 10 16:16:33 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-e105b8bc-a942-4d34-aab6-a0b64908e564 tempest-ProjectReaderTests-1586271177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:16:33 devstack sudo[109402]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:33 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-49cbead3-4f9e-4629-bb95-747d80d487b3 tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2af76e73-614c-4590-99de-bbd58113a1e9" returned: 0 in 0.318s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:33 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-49cbead3-4f9e-4629-bb95-747d80d487b3 tempest-ProjectMemberTests-715789302 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:16:33 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-49cbead3-4f9e-4629-bb95-747d80d487b3 tempest-ProjectMemberTests-715789302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:16:33 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-e105b8bc-a942-4d34-aab6-a0b64908e564 tempest-ProjectReaderTests-1586271177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.096s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:16:33 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-e105b8bc-a942-4d34-aab6-a0b64908e564 tempest-ProjectReaderTests-1586271177 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:16:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1558052940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d206f4eb-891f-467e-83e4-1188ee427b12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53aab7478843407697fb167d35e29d43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:16:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:16:33Z,use_quota=True,user_id='09496d3eeb39485892584a6b8ffc7e97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:16:33 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-e105b8bc-a942-4d34-aab6-a0b64908e564 tempest-ProjectReaderTests-1586271177 None] Creating volume d206f4eb-891f-467e-83e4-1188ee427b12 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:16:33 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-e105b8bc-a942-4d34-aab6-a0b64908e564 tempest-ProjectReaderTests-1586271177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:16:33 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-e105b8bc-a942-4d34-aab6-a0b64908e564 tempest-ProjectReaderTests-1586271177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:16:33 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-e105b8bc-a942-4d34-aab6-a0b64908e564 tempest-ProjectReaderTests-1586271177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:16:33 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-e105b8bc-a942-4d34-aab6-a0b64908e564 tempest-ProjectReaderTests-1586271177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:16:33 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-e105b8bc-a942-4d34-aab6-a0b64908e564 tempest-ProjectReaderTests-1586271177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:16:33 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-e105b8bc-a942-4d34-aab6-a0b64908e564 tempest-ProjectReaderTests-1586271177 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:16:33 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-e105b8bc-a942-4d34-aab6-a0b64908e564 tempest-ProjectReaderTests-1586271177 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:16:33 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e105b8bc-a942-4d34-aab6-a0b64908e564 tempest-ProjectReaderTests-1586271177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d206f4eb-891f-467e-83e4-1188ee427b12 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:33 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-49cbead3-4f9e-4629-bb95-747d80d487b3 tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c8e893e-c137-4860-80e2-d06e66b6cc64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2af76e73-614c-4590-99de-bbd58113a1e9', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:16:33 devstack sudo[109405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d206f4eb-891f-467e-83e4-1188ee427b12 1073741824 Aug 10 16:16:33 devstack sudo[109405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:33 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-49cbead3-4f9e-4629-bb95-747d80d487b3 tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da16b47f-f582-4c45-8c95-f43e49d04b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:16:33 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-49cbead3-4f9e-4629-bb95-747d80d487b3 tempest-ProjectMemberTests-715789302 None] Volume volume-2af76e73-614c-4590-99de-bbd58113a1e9 (2af76e73-614c-4590-99de-bbd58113a1e9): created successfully Aug 10 16:16:33 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-49cbead3-4f9e-4629-bb95-747d80d487b3 tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da16b47f-f582-4c45-8c95-f43e49d04b04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:16:33 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-49cbead3-4f9e-4629-bb95-747d80d487b3 tempest-ProjectMemberTests-715789302 None] Flow 'volume_create_manager' (4e4e8a64-d923-4d44-b52d-445b08cca8e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:16:33 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-49cbead3-4f9e-4629-bb95-747d80d487b3 tempest-ProjectMemberTests-715789302 None] Created volume successfully. Aug 10 16:16:33 devstack sudo[109405]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:33 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e105b8bc-a942-4d34-aab6-a0b64908e564 tempest-ProjectReaderTests-1586271177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d206f4eb-891f-467e-83e4-1188ee427b12 1073741824" returned: 0 in 0.437s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:33 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e105b8bc-a942-4d34-aab6-a0b64908e564 tempest-ProjectReaderTests-1586271177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d206f4eb-891f-467e-83e4-1188ee427b12 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:33 devstack sudo[109410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d206f4eb-891f-467e-83e4-1188ee427b12 Aug 10 16:16:33 devstack sudo[109410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:33 devstack sudo[109410]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:33 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e105b8bc-a942-4d34-aab6-a0b64908e564 tempest-ProjectReaderTests-1586271177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d206f4eb-891f-467e-83e4-1188ee427b12" returned: 0 in 0.266s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:33 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-e105b8bc-a942-4d34-aab6-a0b64908e564 tempest-ProjectReaderTests-1586271177 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:16:33 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-e105b8bc-a942-4d34-aab6-a0b64908e564 tempest-ProjectReaderTests-1586271177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:16:33 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-e105b8bc-a942-4d34-aab6-a0b64908e564 tempest-ProjectReaderTests-1586271177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62c8b3d0-449e-457d-b095-194a47aaa13d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d206f4eb-891f-467e-83e4-1188ee427b12', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:16:33 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-e105b8bc-a942-4d34-aab6-a0b64908e564 tempest-ProjectReaderTests-1586271177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96b472ea-f38c-4d68-a011-49b5ffff0211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:16:34 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-e105b8bc-a942-4d34-aab6-a0b64908e564 tempest-ProjectReaderTests-1586271177 None] Volume volume-d206f4eb-891f-467e-83e4-1188ee427b12 (d206f4eb-891f-467e-83e4-1188ee427b12): created successfully Aug 10 16:16:34 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-e105b8bc-a942-4d34-aab6-a0b64908e564 tempest-ProjectReaderTests-1586271177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96b472ea-f38c-4d68-a011-49b5ffff0211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:16:34 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-e105b8bc-a942-4d34-aab6-a0b64908e564 tempest-ProjectReaderTests-1586271177 None] Flow 'volume_create_manager' (96fb199c-0057-4ac4-aee4-c8c1e7446366) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:16:34 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-e105b8bc-a942-4d34-aab6-a0b64908e564 tempest-ProjectReaderTests-1586271177 None] Created volume successfully. Aug 10 16:16:34 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-8ef53475-040d-47f0-bdcf-e40ebc422856 tempest-ProjectMemberTests-715789302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:16:34 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-8ef53475-040d-47f0-bdcf-e40ebc422856 tempest-ProjectMemberTests-715789302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:16:34 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-8ef53475-040d-47f0-bdcf-e40ebc422856 tempest-ProjectMemberTests-715789302 None] Creating offline snapshot 4da6c44c-b93c-475e-8d6a-5b0248c41a9d of volume 2af76e73-614c-4590-99de-bbd58113a1e9 {{(pid=88641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 16:16:34 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[4814ed68-2ff0-420b-8bb2-4acb9ccc88d6]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:16:34 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-8ef53475-040d-47f0-bdcf-e40ebc422856 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2af76e73-614c-4590-99de-bbd58113a1e9 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:34 devstack sudo[109413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2af76e73-614c-4590-99de-bbd58113a1e9 Aug 10 16:16:34 devstack sudo[109413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:34 devstack sudo[109413]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:34 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-8ef53475-040d-47f0-bdcf-e40ebc422856 tempest-ProjectMemberTests-715789302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2af76e73-614c-4590-99de-bbd58113a1e9" returned: 0 in 0.362s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:34 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-8ef53475-040d-47f0-bdcf-e40ebc422856 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2af76e73-614c-4590-99de-bbd58113a1e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2af76e73-614c-4590-99de-bbd58113a1e9.4da6c44c-b93c-475e-8d6a-5b0248c41a9d 1G {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:34 devstack sudo[109418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2af76e73-614c-4590-99de-bbd58113a1e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2af76e73-614c-4590-99de-bbd58113a1e9.4da6c44c-b93c-475e-8d6a-5b0248c41a9d 1G Aug 10 16:16:34 devstack sudo[109418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:35 devstack sudo[109418]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:35 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-8ef53475-040d-47f0-bdcf-e40ebc422856 tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2af76e73-614c-4590-99de-bbd58113a1e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2af76e73-614c-4590-99de-bbd58113a1e9.4da6c44c-b93c-475e-8d6a-5b0248c41a9d 1G" returned: 0 in 0.407s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:35 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-8ef53475-040d-47f0-bdcf-e40ebc422856 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2af76e73-614c-4590-99de-bbd58113a1e9 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2af76e73-614c-4590-99de-bbd58113a1e9.4da6c44c-b93c-475e-8d6a-5b0248c41a9d {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:35 devstack sudo[109423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2af76e73-614c-4590-99de-bbd58113a1e9 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2af76e73-614c-4590-99de-bbd58113a1e9.4da6c44c-b93c-475e-8d6a-5b0248c41a9d Aug 10 16:16:35 devstack sudo[109423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:35 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-829c9dda-450a-4a84-82d6-21d28048a67b tempest-ProjectReaderTests-1586271177 None] Acquiring lock "cinder-d206f4eb-891f-467e-83e4-1188ee427b12-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:16:35 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-829c9dda-450a-4a84-82d6-21d28048a67b tempest-ProjectReaderTests-1586271177 None] Lock "cinder-d206f4eb-891f-467e-83e4-1188ee427b12-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:16:35 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-829c9dda-450a-4a84-82d6-21d28048a67b tempest-ProjectReaderTests-1586271177 None] Acquiring lock "cinder-quobyte-d206f4eb-891f-467e-83e4-1188ee427b12" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:16:35 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-829c9dda-450a-4a84-82d6-21d28048a67b tempest-ProjectReaderTests-1586271177 None] Lock "cinder-quobyte-d206f4eb-891f-467e-83e4-1188ee427b12" acquired by "delete_volume" :: waited 0.015s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:16:35 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa5ec337-3901-4b26-bcc9-d8c71e28aaf2]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:16:35 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-829c9dda-450a-4a84-82d6-21d28048a67b tempest-ProjectReaderTests-1586271177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d206f4eb-891f-467e-83e4-1188ee427b12 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:35 devstack sudo[109423]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:35 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-8ef53475-040d-47f0-bdcf-e40ebc422856 tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2af76e73-614c-4590-99de-bbd58113a1e9 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2af76e73-614c-4590-99de-bbd58113a1e9.4da6c44c-b93c-475e-8d6a-5b0248c41a9d" returned: 0 in 0.312s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:35 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-8ef53475-040d-47f0-bdcf-e40ebc422856 tempest-ProjectMemberTests-715789302 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2af76e73-614c-4590-99de-bbd58113a1e9.4da6c44c-b93c-475e-8d6a-5b0248c41a9d is being set with open permissions: ugo+rw Aug 10 16:16:35 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-8ef53475-040d-47f0-bdcf-e40ebc422856 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2af76e73-614c-4590-99de-bbd58113a1e9.4da6c44c-b93c-475e-8d6a-5b0248c41a9d {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:35 devstack sudo[109429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2af76e73-614c-4590-99de-bbd58113a1e9.4da6c44c-b93c-475e-8d6a-5b0248c41a9d Aug 10 16:16:35 devstack sudo[109429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:35 devstack sudo[109428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d206f4eb-891f-467e-83e4-1188ee427b12 Aug 10 16:16:35 devstack sudo[109428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:35 devstack sudo[109429]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:35 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-8ef53475-040d-47f0-bdcf-e40ebc422856 tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2af76e73-614c-4590-99de-bbd58113a1e9.4da6c44c-b93c-475e-8d6a-5b0248c41a9d" returned: 0 in 0.253s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:35 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-8ef53475-040d-47f0-bdcf-e40ebc422856 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2af76e73-614c-4590-99de-bbd58113a1e9.info {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:35 devstack sudo[109437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2af76e73-614c-4590-99de-bbd58113a1e9.info Aug 10 16:16:35 devstack sudo[109437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:35 devstack sudo[109428]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:35 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-829c9dda-450a-4a84-82d6-21d28048a67b tempest-ProjectReaderTests-1586271177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d206f4eb-891f-467e-83e4-1188ee427b12" returned: 0 in 0.389s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:35 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-829c9dda-450a-4a84-82d6-21d28048a67b tempest-ProjectReaderTests-1586271177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d206f4eb-891f-467e-83e4-1188ee427b12 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:35 devstack sudo[109439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d206f4eb-891f-467e-83e4-1188ee427b12 Aug 10 16:16:35 devstack sudo[109439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:36 devstack sudo[109437]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-8ef53475-040d-47f0-bdcf-e40ebc422856 tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2af76e73-614c-4590-99de-bbd58113a1e9.info" returned: 0 in 0.274s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:36 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-8ef53475-040d-47f0-bdcf-e40ebc422856 tempest-ProjectMemberTests-715789302 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2af76e73-614c-4590-99de-bbd58113a1e9.info is being set with open permissions: ugo+rw Aug 10 16:16:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-8ef53475-040d-47f0-bdcf-e40ebc422856 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2af76e73-614c-4590-99de-bbd58113a1e9.info {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:36 devstack sudo[109443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2af76e73-614c-4590-99de-bbd58113a1e9.info Aug 10 16:16:36 devstack sudo[109443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:36 devstack sudo[109439]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-829c9dda-450a-4a84-82d6-21d28048a67b tempest-ProjectReaderTests-1586271177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-d206f4eb-891f-467e-83e4-1188ee427b12" returned: 0 in 0.264s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:36 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-829c9dda-450a-4a84-82d6-21d28048a67b tempest-ProjectReaderTests-1586271177 None] Lock "cinder-quobyte-d206f4eb-891f-467e-83e4-1188ee427b12" released by "delete_volume" :: held 0.696s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:16:36 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-829c9dda-450a-4a84-82d6-21d28048a67b tempest-ProjectReaderTests-1586271177 None] Created reservations ['72466920-0a47-4408-8965-4aca93b48c28', 'b85cca9d-3dfe-4b3e-b78f-344a05e202cd', '81d2670c-3b62-44ef-bbd4-b11abb5f832d', '71747f06-4e9c-4f47-87ed-e96351692749'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:16:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-829c9dda-450a-4a84-82d6-21d28048a67b tempest-ProjectReaderTests-1586271177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:16:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-829c9dda-450a-4a84-82d6-21d28048a67b tempest-ProjectReaderTests-1586271177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:16:36 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-829c9dda-450a-4a84-82d6-21d28048a67b tempest-ProjectReaderTests-1586271177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:16:36 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-829c9dda-450a-4a84-82d6-21d28048a67b tempest-ProjectReaderTests-1586271177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:16:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-829c9dda-450a-4a84-82d6-21d28048a67b tempest-ProjectReaderTests-1586271177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:16:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-829c9dda-450a-4a84-82d6-21d28048a67b tempest-ProjectReaderTests-1586271177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:36 devstack sudo[109445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:16:36 devstack sudo[109445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:36 devstack sudo[109443]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-8ef53475-040d-47f0-bdcf-e40ebc422856 tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2af76e73-614c-4590-99de-bbd58113a1e9.info" returned: 0 in 0.255s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-8ef53475-040d-47f0-bdcf-e40ebc422856 tempest-ProjectMemberTests-715789302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.944s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:16:36 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-8ef53475-040d-47f0-bdcf-e40ebc422856 tempest-ProjectMemberTests-715789302 None] Create snapshot completed successfully Aug 10 16:16:36 devstack cinder-volume[88641]: DEBUG oslo_service.periodic_task [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88641) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 16:16:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:16:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:16:36 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:16:36 devstack sudo[109445]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:36 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:16:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:16:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:36 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-4da706da-2784-4e79-aae5-99dac2c7ac62 tempest-ProjectMemberTests-715789302 None] Acquiring lock "cinder-4da6c44c-b93c-475e-8d6a-5b0248c41a9d-delete_snapshot" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:16:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-829c9dda-450a-4a84-82d6-21d28048a67b tempest-ProjectReaderTests-1586271177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.294s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:36 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-829c9dda-450a-4a84-82d6-21d28048a67b tempest-ProjectReaderTests-1586271177 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:16:36 devstack sudo[109449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:16:36 devstack sudo[109449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:36 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-829c9dda-450a-4a84-82d6-21d28048a67b tempest-ProjectReaderTests-1586271177 None] Deleted volume successfully. Aug 10 16:16:36 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-4da706da-2784-4e79-aae5-99dac2c7ac62 tempest-ProjectMemberTests-715789302 None] Lock "cinder-4da6c44c-b93c-475e-8d6a-5b0248c41a9d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:16:36 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-4da706da-2784-4e79-aae5-99dac2c7ac62 tempest-ProjectMemberTests-715789302 None] Acquiring lock "cinder-quobyte-2af76e73-614c-4590-99de-bbd58113a1e9" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:16:36 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-4da706da-2784-4e79-aae5-99dac2c7ac62 tempest-ProjectMemberTests-715789302 None] Lock "cinder-quobyte-2af76e73-614c-4590-99de-bbd58113a1e9" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:16:36 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-4da706da-2784-4e79-aae5-99dac2c7ac62 tempest-ProjectMemberTests-715789302 None] Acquiring lock "cinder-quobyte-4da6c44c-b93c-475e-8d6a-5b0248c41a9d" by "_delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:16:36 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-829c9dda-450a-4a84-82d6-21d28048a67b tempest-ProjectReaderTests-1586271177 None] Lock "cinder-d206f4eb-891f-467e-83e4-1188ee427b12-delete_volume" released by "delete_volume" :: held 1.227s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:16:36 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-4da706da-2784-4e79-aae5-99dac2c7ac62 tempest-ProjectMemberTests-715789302 None] Lock "cinder-quobyte-4da6c44c-b93c-475e-8d6a-5b0248c41a9d" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:16:36 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-4da706da-2784-4e79-aae5-99dac2c7ac62 tempest-ProjectMemberTests-715789302 None] Deleting offline snapshot 4da6c44c-b93c-475e-8d6a-5b0248c41a9d of volume 2af76e73-614c-4590-99de-bbd58113a1e9 {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 16:16:36 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-4da706da-2784-4e79-aae5-99dac2c7ac62 tempest-ProjectMemberTests-715789302 None] snapshot_file for this snap is: volume-2af76e73-614c-4590-99de-bbd58113a1e9.4da6c44c-b93c-475e-8d6a-5b0248c41a9d {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 16:16:36 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e331da-fa82-43da-b876-c69e0e80975e]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:16:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4da706da-2784-4e79-aae5-99dac2c7ac62 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2af76e73-614c-4590-99de-bbd58113a1e9.4da6c44c-b93c-475e-8d6a-5b0248c41a9d {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:36 devstack sudo[109449]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:36 devstack sudo[109451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2af76e73-614c-4590-99de-bbd58113a1e9.4da6c44c-b93c-475e-8d6a-5b0248c41a9d Aug 10 16:16:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.300s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:36 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:16:36 devstack sudo[109451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:36 devstack cinder-volume[88641]: DEBUG oslo_service.periodic_task [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Running periodic task VolumeManager._thread_info {{(pid=88641) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 16:16:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] thread count: 28 {{(pid=88641) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 10 16:16:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] thread info: [<_MainThread(MainThread, started 127361545748608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88641) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 10 16:16:37 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-2152e29e-f922-4941-8f2a-85682d84f7a3 tempest-ProjectReaderTests-1586271177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:16:37 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2152e29e-f922-4941-8f2a-85682d84f7a3 tempest-ProjectReaderTests-1586271177 None] Flow 'volume_create_manager' (bcaa1c9c-807f-4f16-9fef-5c5059a50158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:16:37 devstack sudo[109451]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:37 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2152e29e-f922-4941-8f2a-85682d84f7a3 tempest-ProjectReaderTests-1586271177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1937c371-15a3-41b8-9841-02c1a51f1eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:16:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4da706da-2784-4e79-aae5-99dac2c7ac62 tempest-ProjectMemberTests-715789302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2af76e73-614c-4590-99de-bbd58113a1e9.4da6c44c-b93c-475e-8d6a-5b0248c41a9d" returned: 0 in 0.447s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:37 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-4da706da-2784-4e79-aae5-99dac2c7ac62 tempest-ProjectMemberTests-715789302 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2af76e73-614c-4590-99de-bbd58113a1e9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 16:16:37 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2152e29e-f922-4941-8f2a-85682d84f7a3 tempest-ProjectReaderTests-1586271177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1937c371-15a3-41b8-9841-02c1a51f1eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:16:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2144075337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02731fe7-e32d-40df-a68f-b4eb03471def,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53aab7478843407697fb167d35e29d43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:16:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:16:37Z,use_quota=True,user_id='09496d3eeb39485892584a6b8ffc7e97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:16:37 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2152e29e-f922-4941-8f2a-85682d84f7a3 tempest-ProjectReaderTests-1586271177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eec92755-a7ca-4353-8abd-c0b9202bfccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:16:37 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2152e29e-f922-4941-8f2a-85682d84f7a3 tempest-ProjectReaderTests-1586271177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eec92755-a7ca-4353-8abd-c0b9202bfccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:16:37 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2152e29e-f922-4941-8f2a-85682d84f7a3 tempest-ProjectReaderTests-1586271177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7949fac6-4af7-4636-a053-85e3da0db626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:16:37 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2152e29e-f922-4941-8f2a-85682d84f7a3 tempest-ProjectReaderTests-1586271177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7949fac6-4af7-4636-a053-85e3da0db626) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02731fe7-e32d-40df-a68f-b4eb03471def', 'volume_name': 'volume-02731fe7-e32d-40df-a68f-b4eb03471def', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:16:37 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2152e29e-f922-4941-8f2a-85682d84f7a3 tempest-ProjectReaderTests-1586271177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6017025-caae-47a8-a4fd-7fddfce67e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:16:37 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2152e29e-f922-4941-8f2a-85682d84f7a3 tempest-ProjectReaderTests-1586271177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6017025-caae-47a8-a4fd-7fddfce67e67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:16:37 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2152e29e-f922-4941-8f2a-85682d84f7a3 tempest-ProjectReaderTests-1586271177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dee82af-4733-4a79-ab19-76bb713ea06e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:16:37 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-2152e29e-f922-4941-8f2a-85682d84f7a3 tempest-ProjectReaderTests-1586271177 None] Volume 02731fe7-e32d-40df-a68f-b4eb03471def: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02731fe7-e32d-40df-a68f-b4eb03471def', 'volume_size': 1} Aug 10 16:16:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-2152e29e-f922-4941-8f2a-85682d84f7a3 tempest-ProjectReaderTests-1586271177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:16:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-2152e29e-f922-4941-8f2a-85682d84f7a3 tempest-ProjectReaderTests-1586271177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:16:37 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-2152e29e-f922-4941-8f2a-85682d84f7a3 tempest-ProjectReaderTests-1586271177 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:16:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2144075337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02731fe7-e32d-40df-a68f-b4eb03471def,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53aab7478843407697fb167d35e29d43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:16:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:16:37Z,use_quota=True,user_id='09496d3eeb39485892584a6b8ffc7e97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:16:37 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-2152e29e-f922-4941-8f2a-85682d84f7a3 tempest-ProjectReaderTests-1586271177 None] Creating volume 02731fe7-e32d-40df-a68f-b4eb03471def {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:16:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-2152e29e-f922-4941-8f2a-85682d84f7a3 tempest-ProjectReaderTests-1586271177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:16:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-2152e29e-f922-4941-8f2a-85682d84f7a3 tempest-ProjectReaderTests-1586271177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:16:37 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-2152e29e-f922-4941-8f2a-85682d84f7a3 tempest-ProjectReaderTests-1586271177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:16:37 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-2152e29e-f922-4941-8f2a-85682d84f7a3 tempest-ProjectReaderTests-1586271177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:16:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-2152e29e-f922-4941-8f2a-85682d84f7a3 tempest-ProjectReaderTests-1586271177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:16:37 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-2152e29e-f922-4941-8f2a-85682d84f7a3 tempest-ProjectReaderTests-1586271177 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:16:37 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-2152e29e-f922-4941-8f2a-85682d84f7a3 tempest-ProjectReaderTests-1586271177 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:16:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-2152e29e-f922-4941-8f2a-85682d84f7a3 tempest-ProjectReaderTests-1586271177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-02731fe7-e32d-40df-a68f-b4eb03471def 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:37 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ad141c-4620-4963-ab6f-a1e67b891f1e]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:16:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4da706da-2784-4e79-aae5-99dac2c7ac62 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2af76e73-614c-4590-99de-bbd58113a1e9 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:37 devstack sudo[109457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-02731fe7-e32d-40df-a68f-b4eb03471def 1073741824 Aug 10 16:16:37 devstack sudo[109457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:37 devstack sudo[109458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2af76e73-614c-4590-99de-bbd58113a1e9 Aug 10 16:16:37 devstack sudo[109458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:37 devstack sudo[109458]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4da706da-2784-4e79-aae5-99dac2c7ac62 tempest-ProjectMemberTests-715789302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2af76e73-614c-4590-99de-bbd58113a1e9" returned: 0 in 0.370s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4da706da-2784-4e79-aae5-99dac2c7ac62 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2af76e73-614c-4590-99de-bbd58113a1e9.4da6c44c-b93c-475e-8d6a-5b0248c41a9d {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:37 devstack sudo[109457]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:37 devstack sudo[109468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2af76e73-614c-4590-99de-bbd58113a1e9.4da6c44c-b93c-475e-8d6a-5b0248c41a9d Aug 10 16:16:37 devstack sudo[109468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-2152e29e-f922-4941-8f2a-85682d84f7a3 tempest-ProjectReaderTests-1586271177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-02731fe7-e32d-40df-a68f-b4eb03471def 1073741824" returned: 0 in 0.418s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-2152e29e-f922-4941-8f2a-85682d84f7a3 tempest-ProjectReaderTests-1586271177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-02731fe7-e32d-40df-a68f-b4eb03471def {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:37 devstack sudo[109470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-02731fe7-e32d-40df-a68f-b4eb03471def Aug 10 16:16:37 devstack sudo[109470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:37 devstack sudo[109470]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-2152e29e-f922-4941-8f2a-85682d84f7a3 tempest-ProjectReaderTests-1586271177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-02731fe7-e32d-40df-a68f-b4eb03471def" returned: 0 in 0.252s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:37 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-2152e29e-f922-4941-8f2a-85682d84f7a3 tempest-ProjectReaderTests-1586271177 None] <== create_volume: return (713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:16:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-2152e29e-f922-4941-8f2a-85682d84f7a3 tempest-ProjectReaderTests-1586271177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.716s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:16:37 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2152e29e-f922-4941-8f2a-85682d84f7a3 tempest-ProjectReaderTests-1586271177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dee82af-4733-4a79-ab19-76bb713ea06e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02731fe7-e32d-40df-a68f-b4eb03471def', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:16:37 devstack sudo[109468]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:37 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2152e29e-f922-4941-8f2a-85682d84f7a3 tempest-ProjectReaderTests-1586271177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0618681-15ef-46e3-8abd-13785780c5af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:16:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4da706da-2784-4e79-aae5-99dac2c7ac62 tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2af76e73-614c-4590-99de-bbd58113a1e9.4da6c44c-b93c-475e-8d6a-5b0248c41a9d" returned: 0 in 0.349s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:37 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4da706da-2784-4e79-aae5-99dac2c7ac62 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2af76e73-614c-4590-99de-bbd58113a1e9.4da6c44c-b93c-475e-8d6a-5b0248c41a9d {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:37 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-2152e29e-f922-4941-8f2a-85682d84f7a3 tempest-ProjectReaderTests-1586271177 None] Volume volume-02731fe7-e32d-40df-a68f-b4eb03471def (02731fe7-e32d-40df-a68f-b4eb03471def): created successfully Aug 10 16:16:37 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2152e29e-f922-4941-8f2a-85682d84f7a3 tempest-ProjectReaderTests-1586271177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0618681-15ef-46e3-8abd-13785780c5af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:16:37 devstack sudo[109476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2af76e73-614c-4590-99de-bbd58113a1e9.4da6c44c-b93c-475e-8d6a-5b0248c41a9d Aug 10 16:16:37 devstack sudo[109476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:37 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-2152e29e-f922-4941-8f2a-85682d84f7a3 tempest-ProjectReaderTests-1586271177 None] Flow 'volume_create_manager' (bcaa1c9c-807f-4f16-9fef-5c5059a50158) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:16:37 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-2152e29e-f922-4941-8f2a-85682d84f7a3 tempest-ProjectReaderTests-1586271177 None] Created volume successfully. Aug 10 16:16:38 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-1703ee28-6fad-413d-9f6a-1c559f1e6588 tempest-ProjectReaderTests-1586271177 None] Acquiring lock "cinder-02731fe7-e32d-40df-a68f-b4eb03471def-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:16:38 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-1703ee28-6fad-413d-9f6a-1c559f1e6588 tempest-ProjectReaderTests-1586271177 None] Lock "cinder-02731fe7-e32d-40df-a68f-b4eb03471def-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:16:38 devstack sudo[109476]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:38 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-1703ee28-6fad-413d-9f6a-1c559f1e6588 tempest-ProjectReaderTests-1586271177 None] Acquiring lock "cinder-quobyte-02731fe7-e32d-40df-a68f-b4eb03471def" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:16:38 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-4da706da-2784-4e79-aae5-99dac2c7ac62 tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2af76e73-614c-4590-99de-bbd58113a1e9.4da6c44c-b93c-475e-8d6a-5b0248c41a9d" returned: 0 in 0.313s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:38 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-4da706da-2784-4e79-aae5-99dac2c7ac62 tempest-ProjectMemberTests-715789302 None] Lock "cinder-quobyte-4da6c44c-b93c-475e-8d6a-5b0248c41a9d" released by "_delete_snapshot" :: held 1.644s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:16:38 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-1703ee28-6fad-413d-9f6a-1c559f1e6588 tempest-ProjectReaderTests-1586271177 None] Lock "cinder-quobyte-02731fe7-e32d-40df-a68f-b4eb03471def" acquired by "delete_volume" :: waited 0.040s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:16:38 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-4da706da-2784-4e79-aae5-99dac2c7ac62 tempest-ProjectMemberTests-715789302 None] Lock "cinder-quobyte-2af76e73-614c-4590-99de-bbd58113a1e9" released by "delete_snapshot" :: held 1.686s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:16:38 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f95e690-8ed4-4266-9144-0aeca35e008f]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:16:38 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-1703ee28-6fad-413d-9f6a-1c559f1e6588 tempest-ProjectReaderTests-1586271177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-02731fe7-e32d-40df-a68f-b4eb03471def {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:38 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-4da706da-2784-4e79-aae5-99dac2c7ac62 tempest-ProjectMemberTests-715789302 None] Created reservations ['3763db49-27d3-4837-a38f-8155fda4cef1', '037adc8d-4fb2-4699-9319-7bfc754e587a', '0dbea701-98b2-4ac9-8bdf-9442bdb9cc05', '3cbf650b-62e9-4e87-97a6-82f4a995117d'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:16:38 devstack sudo[109479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-02731fe7-e32d-40df-a68f-b4eb03471def Aug 10 16:16:38 devstack sudo[109479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:38 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-4da706da-2784-4e79-aae5-99dac2c7ac62 tempest-ProjectMemberTests-715789302 None] Delete snapshot completed successfully. Aug 10 16:16:38 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-4da706da-2784-4e79-aae5-99dac2c7ac62 tempest-ProjectMemberTests-715789302 None] Lock "cinder-4da6c44c-b93c-475e-8d6a-5b0248c41a9d-delete_snapshot" released by "delete_snapshot" :: held 1.861s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:16:38 devstack sudo[109479]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:38 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-1703ee28-6fad-413d-9f6a-1c559f1e6588 tempest-ProjectReaderTests-1586271177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-02731fe7-e32d-40df-a68f-b4eb03471def" returned: 0 in 0.375s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:38 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-1703ee28-6fad-413d-9f6a-1c559f1e6588 tempest-ProjectReaderTests-1586271177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-02731fe7-e32d-40df-a68f-b4eb03471def {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:38 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-461dee04-f66d-4cb9-ba3a-98e5257afe47 tempest-ProjectMemberTests-715789302 None] Acquiring lock "cinder-2af76e73-614c-4590-99de-bbd58113a1e9-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:16:38 devstack sudo[109484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-02731fe7-e32d-40df-a68f-b4eb03471def Aug 10 16:16:38 devstack sudo[109484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:38 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-461dee04-f66d-4cb9-ba3a-98e5257afe47 tempest-ProjectMemberTests-715789302 None] Lock "cinder-2af76e73-614c-4590-99de-bbd58113a1e9-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:16:38 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-461dee04-f66d-4cb9-ba3a-98e5257afe47 tempest-ProjectMemberTests-715789302 None] Acquiring lock "cinder-quobyte-2af76e73-614c-4590-99de-bbd58113a1e9" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:16:38 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-461dee04-f66d-4cb9-ba3a-98e5257afe47 tempest-ProjectMemberTests-715789302 None] Lock "cinder-quobyte-2af76e73-614c-4590-99de-bbd58113a1e9" acquired by "delete_volume" :: waited 0.020s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:16:38 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c4ff95-4ebe-4cec-876a-8beff0f8c719]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:16:38 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-461dee04-f66d-4cb9-ba3a-98e5257afe47 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2af76e73-614c-4590-99de-bbd58113a1e9 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:38 devstack sudo[109486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2af76e73-614c-4590-99de-bbd58113a1e9 Aug 10 16:16:38 devstack sudo[109486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:38 devstack sudo[109484]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:38 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-1703ee28-6fad-413d-9f6a-1c559f1e6588 tempest-ProjectReaderTests-1586271177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-02731fe7-e32d-40df-a68f-b4eb03471def" returned: 0 in 0.274s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:38 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-1703ee28-6fad-413d-9f6a-1c559f1e6588 tempest-ProjectReaderTests-1586271177 None] Lock "cinder-quobyte-02731fe7-e32d-40df-a68f-b4eb03471def" released by "delete_volume" :: held 0.695s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:16:39 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-1703ee28-6fad-413d-9f6a-1c559f1e6588 tempest-ProjectReaderTests-1586271177 None] Created reservations ['5728da26-d513-4ca0-b861-1a4d94168c1e', '79123129-c27f-4f20-a7f7-24fd21f5cc14', '76de5398-95b4-4c1c-b506-5a3c9d125ce9', 'c35d1e2a-1fc2-4040-a2a1-cb1b1a2c4a86'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:16:39 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-1703ee28-6fad-413d-9f6a-1c559f1e6588 tempest-ProjectReaderTests-1586271177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:16:39 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-1703ee28-6fad-413d-9f6a-1c559f1e6588 tempest-ProjectReaderTests-1586271177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:16:39 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-1703ee28-6fad-413d-9f6a-1c559f1e6588 tempest-ProjectReaderTests-1586271177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:16:39 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-1703ee28-6fad-413d-9f6a-1c559f1e6588 tempest-ProjectReaderTests-1586271177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:16:39 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-1703ee28-6fad-413d-9f6a-1c559f1e6588 tempest-ProjectReaderTests-1586271177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:16:39 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-1703ee28-6fad-413d-9f6a-1c559f1e6588 tempest-ProjectReaderTests-1586271177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:39 devstack sudo[109489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:16:39 devstack sudo[109489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:39 devstack sudo[109486]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:39 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-461dee04-f66d-4cb9-ba3a-98e5257afe47 tempest-ProjectMemberTests-715789302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2af76e73-614c-4590-99de-bbd58113a1e9" returned: 0 in 0.373s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:39 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-461dee04-f66d-4cb9-ba3a-98e5257afe47 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2af76e73-614c-4590-99de-bbd58113a1e9 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:39 devstack sudo[109494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2af76e73-614c-4590-99de-bbd58113a1e9 Aug 10 16:16:39 devstack sudo[109494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:39 devstack sudo[109489]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:39 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-1703ee28-6fad-413d-9f6a-1c559f1e6588 tempest-ProjectReaderTests-1586271177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.267s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:39 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-1703ee28-6fad-413d-9f6a-1c559f1e6588 tempest-ProjectReaderTests-1586271177 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:16:39 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-1703ee28-6fad-413d-9f6a-1c559f1e6588 tempest-ProjectReaderTests-1586271177 None] Deleted volume successfully. Aug 10 16:16:39 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-1703ee28-6fad-413d-9f6a-1c559f1e6588 tempest-ProjectReaderTests-1586271177 None] Lock "cinder-02731fe7-e32d-40df-a68f-b4eb03471def-delete_volume" released by "delete_volume" :: held 1.197s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:16:39 devstack sudo[109494]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:39 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-461dee04-f66d-4cb9-ba3a-98e5257afe47 tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-2af76e73-614c-4590-99de-bbd58113a1e9" returned: 0 in 0.261s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:39 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-461dee04-f66d-4cb9-ba3a-98e5257afe47 tempest-ProjectMemberTests-715789302 None] Lock "cinder-quobyte-2af76e73-614c-4590-99de-bbd58113a1e9" released by "delete_volume" :: held 0.687s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:16:39 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-461dee04-f66d-4cb9-ba3a-98e5257afe47 tempest-ProjectMemberTests-715789302 None] Created reservations ['c3a6d614-c922-4cd0-8871-8d298d9e3778', '4208d239-b511-41d9-af8b-7b882c7438ad', '084f6b49-a0b6-4eae-9758-44697b5aea62', '8c39ba94-6c74-47dd-bd2e-7dd0af727db9'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:16:39 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-461dee04-f66d-4cb9-ba3a-98e5257afe47 tempest-ProjectMemberTests-715789302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:16:39 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-461dee04-f66d-4cb9-ba3a-98e5257afe47 tempest-ProjectMemberTests-715789302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:16:39 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-461dee04-f66d-4cb9-ba3a-98e5257afe47 tempest-ProjectMemberTests-715789302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:16:39 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-461dee04-f66d-4cb9-ba3a-98e5257afe47 tempest-ProjectMemberTests-715789302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:16:39 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-461dee04-f66d-4cb9-ba3a-98e5257afe47 tempest-ProjectMemberTests-715789302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:16:39 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-461dee04-f66d-4cb9-ba3a-98e5257afe47 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:39 devstack sudo[109498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:16:39 devstack sudo[109498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:39 devstack sudo[109498]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:39 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-461dee04-f66d-4cb9-ba3a-98e5257afe47 tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.264s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:39 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-461dee04-f66d-4cb9-ba3a-98e5257afe47 tempest-ProjectMemberTests-715789302 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:16:39 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-461dee04-f66d-4cb9-ba3a-98e5257afe47 tempest-ProjectMemberTests-715789302 None] Deleted volume successfully. Aug 10 16:16:39 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-461dee04-f66d-4cb9-ba3a-98e5257afe47 tempest-ProjectMemberTests-715789302 None] Lock "cinder-2af76e73-614c-4590-99de-bbd58113a1e9-delete_volume" released by "delete_volume" :: held 1.173s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:16:40 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-738a76d8-3917-47c4-8dbb-c87aa577ec06 tempest-ProjectMemberTests-715789302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:16:40 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-738a76d8-3917-47c4-8dbb-c87aa577ec06 tempest-ProjectMemberTests-715789302 None] Flow 'volume_create_manager' (4654bbd1-218e-403f-98b1-78c5419bcd28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:16:40 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-738a76d8-3917-47c4-8dbb-c87aa577ec06 tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7f9dddd-734f-4e02-a346-f134fb9c289f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:16:40 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-738a76d8-3917-47c4-8dbb-c87aa577ec06 tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7f9dddd-734f-4e02-a346-f134fb9c289f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:16:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1474773760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07b4defc-7ccf-440c-9441-d3049a9ac3a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8408ad471876405b8109f4d45d4a242d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:16:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:16:40Z,use_quota=True,user_id='dc958e8abfdb43a69a4609f15eb8d6d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:16:40 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-738a76d8-3917-47c4-8dbb-c87aa577ec06 tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32463edf-22ee-4f43-bf16-b5f4f706dd59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:16:40 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-738a76d8-3917-47c4-8dbb-c87aa577ec06 tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32463edf-22ee-4f43-bf16-b5f4f706dd59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:16:40 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-738a76d8-3917-47c4-8dbb-c87aa577ec06 tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (895773d6-39ab-4f21-a665-c9611d693d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:16:40 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-738a76d8-3917-47c4-8dbb-c87aa577ec06 tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (895773d6-39ab-4f21-a665-c9611d693d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07b4defc-7ccf-440c-9441-d3049a9ac3a1', 'volume_name': 'volume-07b4defc-7ccf-440c-9441-d3049a9ac3a1', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:16:40 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-738a76d8-3917-47c4-8dbb-c87aa577ec06 tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51585cf1-673f-4303-964e-a988a699edbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:16:40 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-738a76d8-3917-47c4-8dbb-c87aa577ec06 tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51585cf1-673f-4303-964e-a988a699edbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:16:40 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-738a76d8-3917-47c4-8dbb-c87aa577ec06 tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2123173f-ebe7-41fe-b545-730846e4193b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:16:40 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-738a76d8-3917-47c4-8dbb-c87aa577ec06 tempest-ProjectMemberTests-715789302 None] Volume 07b4defc-7ccf-440c-9441-d3049a9ac3a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07b4defc-7ccf-440c-9441-d3049a9ac3a1', 'volume_size': 1} Aug 10 16:16:40 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-738a76d8-3917-47c4-8dbb-c87aa577ec06 tempest-ProjectMemberTests-715789302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:16:40 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-738a76d8-3917-47c4-8dbb-c87aa577ec06 tempest-ProjectMemberTests-715789302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:16:40 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-738a76d8-3917-47c4-8dbb-c87aa577ec06 tempest-ProjectMemberTests-715789302 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:16:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1474773760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07b4defc-7ccf-440c-9441-d3049a9ac3a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8408ad471876405b8109f4d45d4a242d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:16:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:16:40Z,use_quota=True,user_id='dc958e8abfdb43a69a4609f15eb8d6d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:16:40 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-738a76d8-3917-47c4-8dbb-c87aa577ec06 tempest-ProjectMemberTests-715789302 None] Creating volume 07b4defc-7ccf-440c-9441-d3049a9ac3a1 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:16:40 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-738a76d8-3917-47c4-8dbb-c87aa577ec06 tempest-ProjectMemberTests-715789302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:16:40 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-738a76d8-3917-47c4-8dbb-c87aa577ec06 tempest-ProjectMemberTests-715789302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:16:40 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-738a76d8-3917-47c4-8dbb-c87aa577ec06 tempest-ProjectMemberTests-715789302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:16:40 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-738a76d8-3917-47c4-8dbb-c87aa577ec06 tempest-ProjectMemberTests-715789302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:16:40 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-738a76d8-3917-47c4-8dbb-c87aa577ec06 tempest-ProjectMemberTests-715789302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:16:40 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-738a76d8-3917-47c4-8dbb-c87aa577ec06 tempest-ProjectMemberTests-715789302 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:16:40 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-738a76d8-3917-47c4-8dbb-c87aa577ec06 tempest-ProjectMemberTests-715789302 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:16:40 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-738a76d8-3917-47c4-8dbb-c87aa577ec06 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-07b4defc-7ccf-440c-9441-d3049a9ac3a1 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:40 devstack sudo[109501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-07b4defc-7ccf-440c-9441-d3049a9ac3a1 1073741824 Aug 10 16:16:40 devstack sudo[109501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:40 devstack sudo[109501]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:40 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-738a76d8-3917-47c4-8dbb-c87aa577ec06 tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-07b4defc-7ccf-440c-9441-d3049a9ac3a1 1073741824" returned: 0 in 0.458s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:40 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-738a76d8-3917-47c4-8dbb-c87aa577ec06 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-07b4defc-7ccf-440c-9441-d3049a9ac3a1 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:41 devstack sudo[109507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-07b4defc-7ccf-440c-9441-d3049a9ac3a1 Aug 10 16:16:41 devstack sudo[109507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:41 devstack sudo[109507]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:41 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-738a76d8-3917-47c4-8dbb-c87aa577ec06 tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-07b4defc-7ccf-440c-9441-d3049a9ac3a1" returned: 0 in 0.241s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:41 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-738a76d8-3917-47c4-8dbb-c87aa577ec06 tempest-ProjectMemberTests-715789302 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:16:41 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-738a76d8-3917-47c4-8dbb-c87aa577ec06 tempest-ProjectMemberTests-715789302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:16:41 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-738a76d8-3917-47c4-8dbb-c87aa577ec06 tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2123173f-ebe7-41fe-b545-730846e4193b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07b4defc-7ccf-440c-9441-d3049a9ac3a1', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:16:41 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-738a76d8-3917-47c4-8dbb-c87aa577ec06 tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9585bfea-6a5b-4cb8-885a-9a0dcb5aa58c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:16:41 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-738a76d8-3917-47c4-8dbb-c87aa577ec06 tempest-ProjectMemberTests-715789302 None] Volume volume-07b4defc-7ccf-440c-9441-d3049a9ac3a1 (07b4defc-7ccf-440c-9441-d3049a9ac3a1): created successfully Aug 10 16:16:41 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-738a76d8-3917-47c4-8dbb-c87aa577ec06 tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9585bfea-6a5b-4cb8-885a-9a0dcb5aa58c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:16:41 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-738a76d8-3917-47c4-8dbb-c87aa577ec06 tempest-ProjectMemberTests-715789302 None] Flow 'volume_create_manager' (4654bbd1-218e-403f-98b1-78c5419bcd28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:16:41 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-738a76d8-3917-47c4-8dbb-c87aa577ec06 tempest-ProjectMemberTests-715789302 None] Created volume successfully. Aug 10 16:16:42 devstack cinder-volume[88641]: DEBUG dbcounter [-] [88641] Writing DB stats cinder:INSERT=59,cinder:UPDATE=211,cinder:SELECT=165,cinder:DELETE=22 {{(pid=88641) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 16:16:42 devstack cinder-volume[88641]: DEBUG dbcounter [-] [88641] Writing DB stats cinder:SELECT=171,cinder:INSERT=56,cinder:UPDATE=223,cinder:DELETE=15 {{(pid=88641) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 16:16:42 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-b6a05b51-81fe-4a97-a290-e1e067a32486 tempest-ProjectMemberTests-715789302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:16:42 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-b6a05b51-81fe-4a97-a290-e1e067a32486 tempest-ProjectMemberTests-715789302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:16:42 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-b6a05b51-81fe-4a97-a290-e1e067a32486 tempest-ProjectMemberTests-715789302 None] Creating offline snapshot afde5e63-68cc-44c7-9488-fd00233f37b6 of volume 07b4defc-7ccf-440c-9441-d3049a9ac3a1 {{(pid=88641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 16:16:42 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[390b2f85-d55c-4e86-9817-0779fa33c5d7]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:16:42 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b6a05b51-81fe-4a97-a290-e1e067a32486 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-07b4defc-7ccf-440c-9441-d3049a9ac3a1 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:42 devstack sudo[109512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-07b4defc-7ccf-440c-9441-d3049a9ac3a1 Aug 10 16:16:42 devstack sudo[109512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:42 devstack sudo[109512]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:42 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b6a05b51-81fe-4a97-a290-e1e067a32486 tempest-ProjectMemberTests-715789302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-07b4defc-7ccf-440c-9441-d3049a9ac3a1" returned: 0 in 0.355s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:42 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b6a05b51-81fe-4a97-a290-e1e067a32486 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-07b4defc-7ccf-440c-9441-d3049a9ac3a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-07b4defc-7ccf-440c-9441-d3049a9ac3a1.afde5e63-68cc-44c7-9488-fd00233f37b6 1G {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:42 devstack sudo[109517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-07b4defc-7ccf-440c-9441-d3049a9ac3a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-07b4defc-7ccf-440c-9441-d3049a9ac3a1.afde5e63-68cc-44c7-9488-fd00233f37b6 1G Aug 10 16:16:42 devstack sudo[109517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:43 devstack sudo[109517]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:43 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b6a05b51-81fe-4a97-a290-e1e067a32486 tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-07b4defc-7ccf-440c-9441-d3049a9ac3a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-07b4defc-7ccf-440c-9441-d3049a9ac3a1.afde5e63-68cc-44c7-9488-fd00233f37b6 1G" returned: 0 in 0.376s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:43 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b6a05b51-81fe-4a97-a290-e1e067a32486 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07b4defc-7ccf-440c-9441-d3049a9ac3a1 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-07b4defc-7ccf-440c-9441-d3049a9ac3a1.afde5e63-68cc-44c7-9488-fd00233f37b6 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:43 devstack sudo[109522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07b4defc-7ccf-440c-9441-d3049a9ac3a1 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-07b4defc-7ccf-440c-9441-d3049a9ac3a1.afde5e63-68cc-44c7-9488-fd00233f37b6 Aug 10 16:16:43 devstack sudo[109522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:43 devstack sudo[109522]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:43 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b6a05b51-81fe-4a97-a290-e1e067a32486 tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07b4defc-7ccf-440c-9441-d3049a9ac3a1 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-07b4defc-7ccf-440c-9441-d3049a9ac3a1.afde5e63-68cc-44c7-9488-fd00233f37b6" returned: 0 in 0.281s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:43 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-b6a05b51-81fe-4a97-a290-e1e067a32486 tempest-ProjectMemberTests-715789302 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-07b4defc-7ccf-440c-9441-d3049a9ac3a1.afde5e63-68cc-44c7-9488-fd00233f37b6 is being set with open permissions: ugo+rw Aug 10 16:16:43 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b6a05b51-81fe-4a97-a290-e1e067a32486 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-07b4defc-7ccf-440c-9441-d3049a9ac3a1.afde5e63-68cc-44c7-9488-fd00233f37b6 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:43 devstack sudo[109527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-07b4defc-7ccf-440c-9441-d3049a9ac3a1.afde5e63-68cc-44c7-9488-fd00233f37b6 Aug 10 16:16:43 devstack sudo[109527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:43 devstack sudo[109527]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:43 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b6a05b51-81fe-4a97-a290-e1e067a32486 tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-07b4defc-7ccf-440c-9441-d3049a9ac3a1.afde5e63-68cc-44c7-9488-fd00233f37b6" returned: 0 in 0.237s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:43 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b6a05b51-81fe-4a97-a290-e1e067a32486 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-07b4defc-7ccf-440c-9441-d3049a9ac3a1.info {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:43 devstack sudo[109530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-07b4defc-7ccf-440c-9441-d3049a9ac3a1.info Aug 10 16:16:43 devstack sudo[109530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:44 devstack sudo[109530]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:44 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b6a05b51-81fe-4a97-a290-e1e067a32486 tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-07b4defc-7ccf-440c-9441-d3049a9ac3a1.info" returned: 0 in 0.256s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:44 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-b6a05b51-81fe-4a97-a290-e1e067a32486 tempest-ProjectMemberTests-715789302 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-07b4defc-7ccf-440c-9441-d3049a9ac3a1.info is being set with open permissions: ugo+rw Aug 10 16:16:44 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b6a05b51-81fe-4a97-a290-e1e067a32486 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-07b4defc-7ccf-440c-9441-d3049a9ac3a1.info {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:44 devstack sudo[109533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-07b4defc-7ccf-440c-9441-d3049a9ac3a1.info Aug 10 16:16:44 devstack sudo[109533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:44 devstack sudo[109533]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:44 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-b6a05b51-81fe-4a97-a290-e1e067a32486 tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-07b4defc-7ccf-440c-9441-d3049a9ac3a1.info" returned: 0 in 0.233s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:44 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-b6a05b51-81fe-4a97-a290-e1e067a32486 tempest-ProjectMemberTests-715789302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.812s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:16:44 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-b6a05b51-81fe-4a97-a290-e1e067a32486 tempest-ProjectMemberTests-715789302 None] Create snapshot completed successfully Aug 10 16:16:44 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-d7f5e60f-ff88-4b5b-946c-0ab45e785bf8 tempest-ProjectMemberTests-715789302 None] Acquiring lock "cinder-afde5e63-68cc-44c7-9488-fd00233f37b6-delete_snapshot" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:16:44 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-d7f5e60f-ff88-4b5b-946c-0ab45e785bf8 tempest-ProjectMemberTests-715789302 None] Lock "cinder-afde5e63-68cc-44c7-9488-fd00233f37b6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:16:44 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-d7f5e60f-ff88-4b5b-946c-0ab45e785bf8 tempest-ProjectMemberTests-715789302 None] Acquiring lock "cinder-quobyte-07b4defc-7ccf-440c-9441-d3049a9ac3a1" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:16:44 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-d7f5e60f-ff88-4b5b-946c-0ab45e785bf8 tempest-ProjectMemberTests-715789302 None] Lock "cinder-quobyte-07b4defc-7ccf-440c-9441-d3049a9ac3a1" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:16:44 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-d7f5e60f-ff88-4b5b-946c-0ab45e785bf8 tempest-ProjectMemberTests-715789302 None] Acquiring lock "cinder-quobyte-afde5e63-68cc-44c7-9488-fd00233f37b6" by "_delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:16:44 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-d7f5e60f-ff88-4b5b-946c-0ab45e785bf8 tempest-ProjectMemberTests-715789302 None] Lock "cinder-quobyte-afde5e63-68cc-44c7-9488-fd00233f37b6" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:16:44 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-d7f5e60f-ff88-4b5b-946c-0ab45e785bf8 tempest-ProjectMemberTests-715789302 None] Deleting offline snapshot afde5e63-68cc-44c7-9488-fd00233f37b6 of volume 07b4defc-7ccf-440c-9441-d3049a9ac3a1 {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 16:16:44 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-d7f5e60f-ff88-4b5b-946c-0ab45e785bf8 tempest-ProjectMemberTests-715789302 None] snapshot_file for this snap is: volume-07b4defc-7ccf-440c-9441-d3049a9ac3a1.afde5e63-68cc-44c7-9488-fd00233f37b6 {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 16:16:44 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f324cf1-64cd-4fe2-99b8-fcf6086ff5e9]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:16:44 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d7f5e60f-ff88-4b5b-946c-0ab45e785bf8 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-07b4defc-7ccf-440c-9441-d3049a9ac3a1.afde5e63-68cc-44c7-9488-fd00233f37b6 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:44 devstack sudo[109536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-07b4defc-7ccf-440c-9441-d3049a9ac3a1.afde5e63-68cc-44c7-9488-fd00233f37b6 Aug 10 16:16:44 devstack sudo[109536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:45 devstack sudo[109536]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:45 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d7f5e60f-ff88-4b5b-946c-0ab45e785bf8 tempest-ProjectMemberTests-715789302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-07b4defc-7ccf-440c-9441-d3049a9ac3a1.afde5e63-68cc-44c7-9488-fd00233f37b6" returned: 0 in 0.355s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:45 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-d7f5e60f-ff88-4b5b-946c-0ab45e785bf8 tempest-ProjectMemberTests-715789302 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-07b4defc-7ccf-440c-9441-d3049a9ac3a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 16:16:45 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa0df8c-add0-4435-b5e3-3dd15dc002e1]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:16:45 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d7f5e60f-ff88-4b5b-946c-0ab45e785bf8 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-07b4defc-7ccf-440c-9441-d3049a9ac3a1 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:45 devstack sudo[109541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-07b4defc-7ccf-440c-9441-d3049a9ac3a1 Aug 10 16:16:45 devstack sudo[109541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:45 devstack sudo[109541]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:45 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d7f5e60f-ff88-4b5b-946c-0ab45e785bf8 tempest-ProjectMemberTests-715789302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-07b4defc-7ccf-440c-9441-d3049a9ac3a1" returned: 0 in 0.346s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:45 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d7f5e60f-ff88-4b5b-946c-0ab45e785bf8 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-07b4defc-7ccf-440c-9441-d3049a9ac3a1.afde5e63-68cc-44c7-9488-fd00233f37b6 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:45 devstack sudo[109547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-07b4defc-7ccf-440c-9441-d3049a9ac3a1.afde5e63-68cc-44c7-9488-fd00233f37b6 Aug 10 16:16:45 devstack sudo[109547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:45 devstack sudo[109547]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:45 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d7f5e60f-ff88-4b5b-946c-0ab45e785bf8 tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-07b4defc-7ccf-440c-9441-d3049a9ac3a1.afde5e63-68cc-44c7-9488-fd00233f37b6" returned: 0 in 0.324s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:45 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d7f5e60f-ff88-4b5b-946c-0ab45e785bf8 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-07b4defc-7ccf-440c-9441-d3049a9ac3a1.afde5e63-68cc-44c7-9488-fd00233f37b6 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:45 devstack sudo[109553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-07b4defc-7ccf-440c-9441-d3049a9ac3a1.afde5e63-68cc-44c7-9488-fd00233f37b6 Aug 10 16:16:45 devstack sudo[109553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:46 devstack sudo[109553]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:46 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-d7f5e60f-ff88-4b5b-946c-0ab45e785bf8 tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-07b4defc-7ccf-440c-9441-d3049a9ac3a1.afde5e63-68cc-44c7-9488-fd00233f37b6" returned: 0 in 0.237s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:46 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-d7f5e60f-ff88-4b5b-946c-0ab45e785bf8 tempest-ProjectMemberTests-715789302 None] Lock "cinder-quobyte-afde5e63-68cc-44c7-9488-fd00233f37b6" released by "_delete_snapshot" :: held 1.345s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:16:46 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-d7f5e60f-ff88-4b5b-946c-0ab45e785bf8 tempest-ProjectMemberTests-715789302 None] Lock "cinder-quobyte-07b4defc-7ccf-440c-9441-d3049a9ac3a1" released by "delete_snapshot" :: held 1.367s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:16:46 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-d7f5e60f-ff88-4b5b-946c-0ab45e785bf8 tempest-ProjectMemberTests-715789302 None] Created reservations ['d2a91f28-1e86-42ca-b5f8-e3e36f4ab913', 'f81b3213-46c9-4414-aad4-d989e540de49', '601544c4-1972-4fbd-bc6b-fd6d1c96ca13', '0286c69b-3c7f-45a8-8455-264b08345cfe'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:16:46 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-d7f5e60f-ff88-4b5b-946c-0ab45e785bf8 tempest-ProjectMemberTests-715789302 None] Delete snapshot completed successfully. Aug 10 16:16:46 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-d7f5e60f-ff88-4b5b-946c-0ab45e785bf8 tempest-ProjectMemberTests-715789302 None] Lock "cinder-afde5e63-68cc-44c7-9488-fd00233f37b6-delete_snapshot" released by "delete_snapshot" :: held 1.501s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:16:46 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-17cb22fb-1968-4eff-8518-c167cb110f6f tempest-ProjectMemberTests-715789302 None] Acquiring lock "cinder-07b4defc-7ccf-440c-9441-d3049a9ac3a1-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:16:46 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-17cb22fb-1968-4eff-8518-c167cb110f6f tempest-ProjectMemberTests-715789302 None] Lock "cinder-07b4defc-7ccf-440c-9441-d3049a9ac3a1-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:16:46 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-17cb22fb-1968-4eff-8518-c167cb110f6f tempest-ProjectMemberTests-715789302 None] Acquiring lock "cinder-quobyte-07b4defc-7ccf-440c-9441-d3049a9ac3a1" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:16:46 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-17cb22fb-1968-4eff-8518-c167cb110f6f tempest-ProjectMemberTests-715789302 None] Lock "cinder-quobyte-07b4defc-7ccf-440c-9441-d3049a9ac3a1" acquired by "delete_volume" :: waited 0.015s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:16:46 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbfad831-709f-4057-a69a-066b95ba9eff]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:16:46 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-17cb22fb-1968-4eff-8518-c167cb110f6f tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-07b4defc-7ccf-440c-9441-d3049a9ac3a1 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:47 devstack sudo[109556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-07b4defc-7ccf-440c-9441-d3049a9ac3a1 Aug 10 16:16:47 devstack sudo[109556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:47 devstack sudo[109556]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:47 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-17cb22fb-1968-4eff-8518-c167cb110f6f tempest-ProjectMemberTests-715789302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-07b4defc-7ccf-440c-9441-d3049a9ac3a1" returned: 0 in 0.361s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:47 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-17cb22fb-1968-4eff-8518-c167cb110f6f tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-07b4defc-7ccf-440c-9441-d3049a9ac3a1 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:47 devstack sudo[109561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-07b4defc-7ccf-440c-9441-d3049a9ac3a1 Aug 10 16:16:47 devstack sudo[109561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:47 devstack sudo[109561]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:47 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-17cb22fb-1968-4eff-8518-c167cb110f6f tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-07b4defc-7ccf-440c-9441-d3049a9ac3a1" returned: 0 in 0.257s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:47 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-17cb22fb-1968-4eff-8518-c167cb110f6f tempest-ProjectMemberTests-715789302 None] Lock "cinder-quobyte-07b4defc-7ccf-440c-9441-d3049a9ac3a1" released by "delete_volume" :: held 0.677s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:16:47 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-17cb22fb-1968-4eff-8518-c167cb110f6f tempest-ProjectMemberTests-715789302 None] Created reservations ['3f1b5975-3d60-412c-8f2e-e7eca04c1c33', 'd5dac33f-890a-4f77-8a00-ed4c957dbac4', 'aa037f38-58d1-4f5a-992e-f34019a66f04', 'd1ef135a-b55c-45a2-9eab-c29e26200db5'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:16:47 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-17cb22fb-1968-4eff-8518-c167cb110f6f tempest-ProjectMemberTests-715789302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:16:47 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-17cb22fb-1968-4eff-8518-c167cb110f6f tempest-ProjectMemberTests-715789302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:16:47 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-17cb22fb-1968-4eff-8518-c167cb110f6f tempest-ProjectMemberTests-715789302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:16:47 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-17cb22fb-1968-4eff-8518-c167cb110f6f tempest-ProjectMemberTests-715789302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:16:47 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-17cb22fb-1968-4eff-8518-c167cb110f6f tempest-ProjectMemberTests-715789302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:16:47 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-17cb22fb-1968-4eff-8518-c167cb110f6f tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:47 devstack sudo[109564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:16:47 devstack sudo[109564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:47 devstack sudo[109564]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:47 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-17cb22fb-1968-4eff-8518-c167cb110f6f tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.268s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:47 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-17cb22fb-1968-4eff-8518-c167cb110f6f tempest-ProjectMemberTests-715789302 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:16:47 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-17cb22fb-1968-4eff-8518-c167cb110f6f tempest-ProjectMemberTests-715789302 None] Deleted volume successfully. Aug 10 16:16:48 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-17cb22fb-1968-4eff-8518-c167cb110f6f tempest-ProjectMemberTests-715789302 None] Lock "cinder-07b4defc-7ccf-440c-9441-d3049a9ac3a1-delete_volume" released by "delete_volume" :: held 1.140s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:16:48 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a2df984-281b-43a0-bf9c-399a39a6ee20 tempest-ProjectMemberTests-715789302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:16:48 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-1a2df984-281b-43a0-bf9c-399a39a6ee20 tempest-ProjectMemberTests-715789302 None] Flow 'volume_create_manager' (65f21d4b-302f-4db6-bcb5-0363f4726442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:16:48 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-1a2df984-281b-43a0-bf9c-399a39a6ee20 tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c07c0be-ed56-400d-a2a5-dda1e1f3f9fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:16:48 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-1a2df984-281b-43a0-bf9c-399a39a6ee20 tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c07c0be-ed56-400d-a2a5-dda1e1f3f9fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:16:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-228730769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccb3754d-0627-436f-8c09-d7359c6ed31f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8408ad471876405b8109f4d45d4a242d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:16:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:16:48Z,use_quota=True,user_id='dc958e8abfdb43a69a4609f15eb8d6d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:16:48 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-1a2df984-281b-43a0-bf9c-399a39a6ee20 tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd6a910a-d31d-4601-89f0-3a25ee5f1aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:16:48 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-1a2df984-281b-43a0-bf9c-399a39a6ee20 tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd6a910a-d31d-4601-89f0-3a25ee5f1aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:16:48 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-1a2df984-281b-43a0-bf9c-399a39a6ee20 tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (300963e2-136f-411a-8176-cb91b53f8a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:16:48 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-1a2df984-281b-43a0-bf9c-399a39a6ee20 tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (300963e2-136f-411a-8176-cb91b53f8a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccb3754d-0627-436f-8c09-d7359c6ed31f', 'volume_name': 'volume-ccb3754d-0627-436f-8c09-d7359c6ed31f', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:16:48 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-1a2df984-281b-43a0-bf9c-399a39a6ee20 tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6618a8d9-5ed7-47c2-9bf0-cf86217c2da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:16:48 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-1a2df984-281b-43a0-bf9c-399a39a6ee20 tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6618a8d9-5ed7-47c2-9bf0-cf86217c2da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:16:48 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-1a2df984-281b-43a0-bf9c-399a39a6ee20 tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3706517e-5bf1-44f5-9ba8-69789a7a8d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:16:48 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-1a2df984-281b-43a0-bf9c-399a39a6ee20 tempest-ProjectMemberTests-715789302 None] Volume ccb3754d-0627-436f-8c09-d7359c6ed31f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccb3754d-0627-436f-8c09-d7359c6ed31f', 'volume_size': 1} Aug 10 16:16:48 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-1a2df984-281b-43a0-bf9c-399a39a6ee20 tempest-ProjectMemberTests-715789302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:16:48 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-1a2df984-281b-43a0-bf9c-399a39a6ee20 tempest-ProjectMemberTests-715789302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:16:48 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-1a2df984-281b-43a0-bf9c-399a39a6ee20 tempest-ProjectMemberTests-715789302 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:16:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-228730769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccb3754d-0627-436f-8c09-d7359c6ed31f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8408ad471876405b8109f4d45d4a242d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:16:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:16:48Z,use_quota=True,user_id='dc958e8abfdb43a69a4609f15eb8d6d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:16:48 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-1a2df984-281b-43a0-bf9c-399a39a6ee20 tempest-ProjectMemberTests-715789302 None] Creating volume ccb3754d-0627-436f-8c09-d7359c6ed31f {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:16:48 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-1a2df984-281b-43a0-bf9c-399a39a6ee20 tempest-ProjectMemberTests-715789302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:16:48 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-1a2df984-281b-43a0-bf9c-399a39a6ee20 tempest-ProjectMemberTests-715789302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:16:48 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-1a2df984-281b-43a0-bf9c-399a39a6ee20 tempest-ProjectMemberTests-715789302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:16:48 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-1a2df984-281b-43a0-bf9c-399a39a6ee20 tempest-ProjectMemberTests-715789302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:16:48 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-1a2df984-281b-43a0-bf9c-399a39a6ee20 tempest-ProjectMemberTests-715789302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:16:48 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-1a2df984-281b-43a0-bf9c-399a39a6ee20 tempest-ProjectMemberTests-715789302 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:16:48 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-1a2df984-281b-43a0-bf9c-399a39a6ee20 tempest-ProjectMemberTests-715789302 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:16:48 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-1a2df984-281b-43a0-bf9c-399a39a6ee20 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-ccb3754d-0627-436f-8c09-d7359c6ed31f 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:48 devstack sudo[109567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-ccb3754d-0627-436f-8c09-d7359c6ed31f 1073741824 Aug 10 16:16:48 devstack sudo[109567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:49 devstack sudo[109567]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:49 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-1a2df984-281b-43a0-bf9c-399a39a6ee20 tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-ccb3754d-0627-436f-8c09-d7359c6ed31f 1073741824" returned: 0 in 0.519s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:49 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-1a2df984-281b-43a0-bf9c-399a39a6ee20 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-ccb3754d-0627-436f-8c09-d7359c6ed31f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:49 devstack sudo[109573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-ccb3754d-0627-436f-8c09-d7359c6ed31f Aug 10 16:16:49 devstack sudo[109573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:49 devstack sudo[109573]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:49 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-1a2df984-281b-43a0-bf9c-399a39a6ee20 tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-ccb3754d-0627-436f-8c09-d7359c6ed31f" returned: 0 in 0.248s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:49 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-1a2df984-281b-43a0-bf9c-399a39a6ee20 tempest-ProjectMemberTests-715789302 None] <== create_volume: return (808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:16:49 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-1a2df984-281b-43a0-bf9c-399a39a6ee20 tempest-ProjectMemberTests-715789302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:16:49 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-1a2df984-281b-43a0-bf9c-399a39a6ee20 tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3706517e-5bf1-44f5-9ba8-69789a7a8d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccb3754d-0627-436f-8c09-d7359c6ed31f', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:16:49 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-1a2df984-281b-43a0-bf9c-399a39a6ee20 tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a62e4a1-361e-4bd5-98e1-e77ad646fd9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:16:49 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-1a2df984-281b-43a0-bf9c-399a39a6ee20 tempest-ProjectMemberTests-715789302 None] Volume volume-ccb3754d-0627-436f-8c09-d7359c6ed31f (ccb3754d-0627-436f-8c09-d7359c6ed31f): created successfully Aug 10 16:16:49 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-1a2df984-281b-43a0-bf9c-399a39a6ee20 tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a62e4a1-361e-4bd5-98e1-e77ad646fd9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:16:49 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-1a2df984-281b-43a0-bf9c-399a39a6ee20 tempest-ProjectMemberTests-715789302 None] Flow 'volume_create_manager' (65f21d4b-302f-4db6-bcb5-0363f4726442) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:16:49 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-1a2df984-281b-43a0-bf9c-399a39a6ee20 tempest-ProjectMemberTests-715789302 None] Created volume successfully. Aug 10 16:16:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-29960986-0734-4e96-9779-388828fa0a9a tempest-ProjectMemberTests-715789302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:16:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-29960986-0734-4e96-9779-388828fa0a9a tempest-ProjectMemberTests-715789302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:16:50 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-29960986-0734-4e96-9779-388828fa0a9a tempest-ProjectMemberTests-715789302 None] Creating offline snapshot 14d36c0f-abab-4525-8114-045cec4974b3 of volume ccb3754d-0627-436f-8c09-d7359c6ed31f {{(pid=88641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 16:16:50 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d32e772-67eb-4c13-94c5-a240a83c93f3]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:16:50 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-29960986-0734-4e96-9779-388828fa0a9a tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-ccb3754d-0627-436f-8c09-d7359c6ed31f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:50 devstack sudo[109576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-ccb3754d-0627-436f-8c09-d7359c6ed31f Aug 10 16:16:50 devstack sudo[109576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:51 devstack sudo[109576]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-29960986-0734-4e96-9779-388828fa0a9a tempest-ProjectMemberTests-715789302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-ccb3754d-0627-436f-8c09-d7359c6ed31f" returned: 0 in 0.371s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-29960986-0734-4e96-9779-388828fa0a9a tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-ccb3754d-0627-436f-8c09-d7359c6ed31f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-ccb3754d-0627-436f-8c09-d7359c6ed31f.14d36c0f-abab-4525-8114-045cec4974b3 1G {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:51 devstack sudo[109581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-ccb3754d-0627-436f-8c09-d7359c6ed31f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-ccb3754d-0627-436f-8c09-d7359c6ed31f.14d36c0f-abab-4525-8114-045cec4974b3 1G Aug 10 16:16:51 devstack sudo[109581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:51 devstack sudo[109581]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-29960986-0734-4e96-9779-388828fa0a9a tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-ccb3754d-0627-436f-8c09-d7359c6ed31f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-ccb3754d-0627-436f-8c09-d7359c6ed31f.14d36c0f-abab-4525-8114-045cec4974b3 1G" returned: 0 in 0.385s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-29960986-0734-4e96-9779-388828fa0a9a tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ccb3754d-0627-436f-8c09-d7359c6ed31f -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-ccb3754d-0627-436f-8c09-d7359c6ed31f.14d36c0f-abab-4525-8114-045cec4974b3 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:51 devstack sudo[109587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ccb3754d-0627-436f-8c09-d7359c6ed31f -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-ccb3754d-0627-436f-8c09-d7359c6ed31f.14d36c0f-abab-4525-8114-045cec4974b3 Aug 10 16:16:51 devstack sudo[109587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:51 devstack sudo[109587]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-29960986-0734-4e96-9779-388828fa0a9a tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ccb3754d-0627-436f-8c09-d7359c6ed31f -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-ccb3754d-0627-436f-8c09-d7359c6ed31f.14d36c0f-abab-4525-8114-045cec4974b3" returned: 0 in 0.291s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:51 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-29960986-0734-4e96-9779-388828fa0a9a tempest-ProjectMemberTests-715789302 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-ccb3754d-0627-436f-8c09-d7359c6ed31f.14d36c0f-abab-4525-8114-045cec4974b3 is being set with open permissions: ugo+rw Aug 10 16:16:51 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-29960986-0734-4e96-9779-388828fa0a9a tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-ccb3754d-0627-436f-8c09-d7359c6ed31f.14d36c0f-abab-4525-8114-045cec4974b3 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:51 devstack sudo[109593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-ccb3754d-0627-436f-8c09-d7359c6ed31f.14d36c0f-abab-4525-8114-045cec4974b3 Aug 10 16:16:51 devstack sudo[109593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:52 devstack sudo[109593]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-29960986-0734-4e96-9779-388828fa0a9a tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-ccb3754d-0627-436f-8c09-d7359c6ed31f.14d36c0f-abab-4525-8114-045cec4974b3" returned: 0 in 0.247s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-29960986-0734-4e96-9779-388828fa0a9a tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-ccb3754d-0627-436f-8c09-d7359c6ed31f.info {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:52 devstack sudo[109596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-ccb3754d-0627-436f-8c09-d7359c6ed31f.info Aug 10 16:16:52 devstack sudo[109596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:52 devstack sudo[109596]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-29960986-0734-4e96-9779-388828fa0a9a tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-ccb3754d-0627-436f-8c09-d7359c6ed31f.info" returned: 0 in 0.253s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:52 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-29960986-0734-4e96-9779-388828fa0a9a tempest-ProjectMemberTests-715789302 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-ccb3754d-0627-436f-8c09-d7359c6ed31f.info is being set with open permissions: ugo+rw Aug 10 16:16:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-29960986-0734-4e96-9779-388828fa0a9a tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-ccb3754d-0627-436f-8c09-d7359c6ed31f.info {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:52 devstack sudo[109599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-ccb3754d-0627-436f-8c09-d7359c6ed31f.info Aug 10 16:16:52 devstack sudo[109599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:52 devstack sudo[109599]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-29960986-0734-4e96-9779-388828fa0a9a tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-ccb3754d-0627-436f-8c09-d7359c6ed31f.info" returned: 0 in 0.254s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-29960986-0734-4e96-9779-388828fa0a9a tempest-ProjectMemberTests-715789302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.879s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:16:52 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-29960986-0734-4e96-9779-388828fa0a9a tempest-ProjectMemberTests-715789302 None] Create snapshot completed successfully Aug 10 16:16:52 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-0599a725-d0da-487f-b70b-172ced496ecd tempest-ProjectMemberTests-715789302 None] Acquiring lock "cinder-14d36c0f-abab-4525-8114-045cec4974b3-delete_snapshot" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:16:52 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-0599a725-d0da-487f-b70b-172ced496ecd tempest-ProjectMemberTests-715789302 None] Lock "cinder-14d36c0f-abab-4525-8114-045cec4974b3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:16:52 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-0599a725-d0da-487f-b70b-172ced496ecd tempest-ProjectMemberTests-715789302 None] Acquiring lock "cinder-quobyte-ccb3754d-0627-436f-8c09-d7359c6ed31f" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:16:52 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-0599a725-d0da-487f-b70b-172ced496ecd tempest-ProjectMemberTests-715789302 None] Lock "cinder-quobyte-ccb3754d-0627-436f-8c09-d7359c6ed31f" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:16:52 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-0599a725-d0da-487f-b70b-172ced496ecd tempest-ProjectMemberTests-715789302 None] Acquiring lock "cinder-quobyte-14d36c0f-abab-4525-8114-045cec4974b3" by "_delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:16:52 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-0599a725-d0da-487f-b70b-172ced496ecd tempest-ProjectMemberTests-715789302 None] Lock "cinder-quobyte-14d36c0f-abab-4525-8114-045cec4974b3" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:16:52 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-0599a725-d0da-487f-b70b-172ced496ecd tempest-ProjectMemberTests-715789302 None] Deleting offline snapshot 14d36c0f-abab-4525-8114-045cec4974b3 of volume ccb3754d-0627-436f-8c09-d7359c6ed31f {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 16:16:52 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-0599a725-d0da-487f-b70b-172ced496ecd tempest-ProjectMemberTests-715789302 None] snapshot_file for this snap is: volume-ccb3754d-0627-436f-8c09-d7359c6ed31f.14d36c0f-abab-4525-8114-045cec4974b3 {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 16:16:52 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c0432be-3ce2-4310-a352-d044b50b8f4e]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:16:52 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0599a725-d0da-487f-b70b-172ced496ecd tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-ccb3754d-0627-436f-8c09-d7359c6ed31f.14d36c0f-abab-4525-8114-045cec4974b3 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:53 devstack sudo[109603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-ccb3754d-0627-436f-8c09-d7359c6ed31f.14d36c0f-abab-4525-8114-045cec4974b3 Aug 10 16:16:53 devstack sudo[109603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:53 devstack sudo[109603]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0599a725-d0da-487f-b70b-172ced496ecd tempest-ProjectMemberTests-715789302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-ccb3754d-0627-436f-8c09-d7359c6ed31f.14d36c0f-abab-4525-8114-045cec4974b3" returned: 0 in 0.342s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:53 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-0599a725-d0da-487f-b70b-172ced496ecd tempest-ProjectMemberTests-715789302 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ccb3754d-0627-436f-8c09-d7359c6ed31f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 16:16:53 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbfcbfce-53bd-433f-a9c5-2320b59463cc]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:16:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0599a725-d0da-487f-b70b-172ced496ecd tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-ccb3754d-0627-436f-8c09-d7359c6ed31f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:53 devstack sudo[109608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-ccb3754d-0627-436f-8c09-d7359c6ed31f Aug 10 16:16:53 devstack sudo[109608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:53 devstack sudo[109608]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0599a725-d0da-487f-b70b-172ced496ecd tempest-ProjectMemberTests-715789302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-ccb3754d-0627-436f-8c09-d7359c6ed31f" returned: 0 in 0.348s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0599a725-d0da-487f-b70b-172ced496ecd tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-ccb3754d-0627-436f-8c09-d7359c6ed31f.14d36c0f-abab-4525-8114-045cec4974b3 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:53 devstack sudo[109613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-ccb3754d-0627-436f-8c09-d7359c6ed31f.14d36c0f-abab-4525-8114-045cec4974b3 Aug 10 16:16:53 devstack sudo[109613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:53 devstack sudo[109613]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0599a725-d0da-487f-b70b-172ced496ecd tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-ccb3754d-0627-436f-8c09-d7359c6ed31f.14d36c0f-abab-4525-8114-045cec4974b3" returned: 0 in 0.331s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:53 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0599a725-d0da-487f-b70b-172ced496ecd tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-ccb3754d-0627-436f-8c09-d7359c6ed31f.14d36c0f-abab-4525-8114-045cec4974b3 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:53 devstack sudo[109618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-ccb3754d-0627-436f-8c09-d7359c6ed31f.14d36c0f-abab-4525-8114-045cec4974b3 Aug 10 16:16:53 devstack sudo[109618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:54 devstack sudo[109618]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:54 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-0599a725-d0da-487f-b70b-172ced496ecd tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-ccb3754d-0627-436f-8c09-d7359c6ed31f.14d36c0f-abab-4525-8114-045cec4974b3" returned: 0 in 0.238s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:54 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-0599a725-d0da-487f-b70b-172ced496ecd tempest-ProjectMemberTests-715789302 None] Lock "cinder-quobyte-14d36c0f-abab-4525-8114-045cec4974b3" released by "_delete_snapshot" :: held 1.344s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:16:54 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-0599a725-d0da-487f-b70b-172ced496ecd tempest-ProjectMemberTests-715789302 None] Lock "cinder-quobyte-ccb3754d-0627-436f-8c09-d7359c6ed31f" released by "delete_snapshot" :: held 1.365s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:16:54 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-0599a725-d0da-487f-b70b-172ced496ecd tempest-ProjectMemberTests-715789302 None] Created reservations ['8187d648-b697-4df2-9b6f-b76f3b73642a', '62bc0666-1d7e-4b4c-9c48-7027cc454020', 'aedc73de-fcfd-4864-b022-c0eb97b62d02', '24df1ab7-6435-42fa-8a63-d3230644d01d'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:16:54 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-0599a725-d0da-487f-b70b-172ced496ecd tempest-ProjectMemberTests-715789302 None] Delete snapshot completed successfully. Aug 10 16:16:54 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-0599a725-d0da-487f-b70b-172ced496ecd tempest-ProjectMemberTests-715789302 None] Lock "cinder-14d36c0f-abab-4525-8114-045cec4974b3-delete_snapshot" released by "delete_snapshot" :: held 1.495s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:16:54 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-e49d50db-dd85-498e-83ab-f2ad0a1d0da6 tempest-ProjectMemberTests-715789302 None] Acquiring lock "cinder-ccb3754d-0627-436f-8c09-d7359c6ed31f-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:16:54 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-e49d50db-dd85-498e-83ab-f2ad0a1d0da6 tempest-ProjectMemberTests-715789302 None] Lock "cinder-ccb3754d-0627-436f-8c09-d7359c6ed31f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:16:55 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-e49d50db-dd85-498e-83ab-f2ad0a1d0da6 tempest-ProjectMemberTests-715789302 None] Acquiring lock "cinder-quobyte-ccb3754d-0627-436f-8c09-d7359c6ed31f" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:16:55 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-e49d50db-dd85-498e-83ab-f2ad0a1d0da6 tempest-ProjectMemberTests-715789302 None] Lock "cinder-quobyte-ccb3754d-0627-436f-8c09-d7359c6ed31f" acquired by "delete_volume" :: waited 0.016s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:16:55 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f9ed50-25fd-4420-a34e-2e203210883d]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:16:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e49d50db-dd85-498e-83ab-f2ad0a1d0da6 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-ccb3754d-0627-436f-8c09-d7359c6ed31f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:55 devstack sudo[109621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-ccb3754d-0627-436f-8c09-d7359c6ed31f Aug 10 16:16:55 devstack sudo[109621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:55 devstack sudo[109621]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e49d50db-dd85-498e-83ab-f2ad0a1d0da6 tempest-ProjectMemberTests-715789302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-ccb3754d-0627-436f-8c09-d7359c6ed31f" returned: 0 in 0.364s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e49d50db-dd85-498e-83ab-f2ad0a1d0da6 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-ccb3754d-0627-436f-8c09-d7359c6ed31f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:55 devstack sudo[109626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-ccb3754d-0627-436f-8c09-d7359c6ed31f Aug 10 16:16:55 devstack sudo[109626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:55 devstack sudo[109626]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e49d50db-dd85-498e-83ab-f2ad0a1d0da6 tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-ccb3754d-0627-436f-8c09-d7359c6ed31f" returned: 0 in 0.247s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:55 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-e49d50db-dd85-498e-83ab-f2ad0a1d0da6 tempest-ProjectMemberTests-715789302 None] Lock "cinder-quobyte-ccb3754d-0627-436f-8c09-d7359c6ed31f" released by "delete_volume" :: held 0.678s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:16:55 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-e49d50db-dd85-498e-83ab-f2ad0a1d0da6 tempest-ProjectMemberTests-715789302 None] Created reservations ['35cc42cd-d979-4650-9e84-5b2b80350d4e', '89096cb6-e849-4fb6-ac54-c13e6e05f6cd', '5f5d9191-02db-41ca-8126-019208832e7e', 'cb5f3490-9ba6-43f8-8e5f-36c64d5ebc7e'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:16:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-e49d50db-dd85-498e-83ab-f2ad0a1d0da6 tempest-ProjectMemberTests-715789302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:16:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-e49d50db-dd85-498e-83ab-f2ad0a1d0da6 tempest-ProjectMemberTests-715789302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:16:55 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-e49d50db-dd85-498e-83ab-f2ad0a1d0da6 tempest-ProjectMemberTests-715789302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:16:55 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-e49d50db-dd85-498e-83ab-f2ad0a1d0da6 tempest-ProjectMemberTests-715789302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:16:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-e49d50db-dd85-498e-83ab-f2ad0a1d0da6 tempest-ProjectMemberTests-715789302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:16:55 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e49d50db-dd85-498e-83ab-f2ad0a1d0da6 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:55 devstack sudo[109629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:16:55 devstack sudo[109629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:56 devstack sudo[109629]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-e49d50db-dd85-498e-83ab-f2ad0a1d0da6 tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.246s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:56 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-e49d50db-dd85-498e-83ab-f2ad0a1d0da6 tempest-ProjectMemberTests-715789302 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:16:56 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-e49d50db-dd85-498e-83ab-f2ad0a1d0da6 tempest-ProjectMemberTests-715789302 None] Deleted volume successfully. Aug 10 16:16:56 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-e49d50db-dd85-498e-83ab-f2ad0a1d0da6 tempest-ProjectMemberTests-715789302 None] Lock "cinder-ccb3754d-0627-436f-8c09-d7359c6ed31f-delete_volume" released by "delete_volume" :: held 1.128s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:16:56 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dd1c741-3bc4-4da8-8985-994d4f232fff tempest-ProjectMemberTests-715789302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:16:56 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-6dd1c741-3bc4-4da8-8985-994d4f232fff tempest-ProjectMemberTests-715789302 None] Flow 'volume_create_manager' (c1466368-da85-45b1-a80a-bfd7b3a07aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:16:56 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-6dd1c741-3bc4-4da8-8985-994d4f232fff tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8643e30f-0d51-48aa-8883-f39a11d0dda1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:16:56 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-6dd1c741-3bc4-4da8-8985-994d4f232fff tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8643e30f-0d51-48aa-8883-f39a11d0dda1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:16:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-355625987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b5f8d0a-7f48-40ba-afce-0ac2f5b51a9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8408ad471876405b8109f4d45d4a242d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:16:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:16:57Z,use_quota=True,user_id='dc958e8abfdb43a69a4609f15eb8d6d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:16:56 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-6dd1c741-3bc4-4da8-8985-994d4f232fff tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (750d6226-63ee-478d-b91a-8bb51f62c8b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:16:56 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-6dd1c741-3bc4-4da8-8985-994d4f232fff tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (750d6226-63ee-478d-b91a-8bb51f62c8b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:16:56 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-6dd1c741-3bc4-4da8-8985-994d4f232fff tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92ee68ce-0061-45df-9970-6375b45c9ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:16:56 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-6dd1c741-3bc4-4da8-8985-994d4f232fff tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92ee68ce-0061-45df-9970-6375b45c9ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b5f8d0a-7f48-40ba-afce-0ac2f5b51a9b', 'volume_name': 'volume-6b5f8d0a-7f48-40ba-afce-0ac2f5b51a9b', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:16:56 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-6dd1c741-3bc4-4da8-8985-994d4f232fff tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09117c0f-384b-4826-890e-194782c18542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:16:56 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-6dd1c741-3bc4-4da8-8985-994d4f232fff tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09117c0f-384b-4826-890e-194782c18542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:16:56 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-6dd1c741-3bc4-4da8-8985-994d4f232fff tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d314412-b449-412d-9f54-4981a49547c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:16:56 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-6dd1c741-3bc4-4da8-8985-994d4f232fff tempest-ProjectMemberTests-715789302 None] Volume 6b5f8d0a-7f48-40ba-afce-0ac2f5b51a9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b5f8d0a-7f48-40ba-afce-0ac2f5b51a9b', 'volume_size': 1} Aug 10 16:16:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-6dd1c741-3bc4-4da8-8985-994d4f232fff tempest-ProjectMemberTests-715789302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:16:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-6dd1c741-3bc4-4da8-8985-994d4f232fff tempest-ProjectMemberTests-715789302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:16:56 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-6dd1c741-3bc4-4da8-8985-994d4f232fff tempest-ProjectMemberTests-715789302 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:16:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-355625987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b5f8d0a-7f48-40ba-afce-0ac2f5b51a9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8408ad471876405b8109f4d45d4a242d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:16:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:16:57Z,use_quota=True,user_id='dc958e8abfdb43a69a4609f15eb8d6d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:16:56 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-6dd1c741-3bc4-4da8-8985-994d4f232fff tempest-ProjectMemberTests-715789302 None] Creating volume 6b5f8d0a-7f48-40ba-afce-0ac2f5b51a9b {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:16:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-6dd1c741-3bc4-4da8-8985-994d4f232fff tempest-ProjectMemberTests-715789302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:16:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-6dd1c741-3bc4-4da8-8985-994d4f232fff tempest-ProjectMemberTests-715789302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:16:56 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-6dd1c741-3bc4-4da8-8985-994d4f232fff tempest-ProjectMemberTests-715789302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:16:56 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-6dd1c741-3bc4-4da8-8985-994d4f232fff tempest-ProjectMemberTests-715789302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:16:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-6dd1c741-3bc4-4da8-8985-994d4f232fff tempest-ProjectMemberTests-715789302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:16:56 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-6dd1c741-3bc4-4da8-8985-994d4f232fff tempest-ProjectMemberTests-715789302 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:16:56 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-6dd1c741-3bc4-4da8-8985-994d4f232fff tempest-ProjectMemberTests-715789302 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:16:56 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6dd1c741-3bc4-4da8-8985-994d4f232fff tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6b5f8d0a-7f48-40ba-afce-0ac2f5b51a9b 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:56 devstack sudo[109632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6b5f8d0a-7f48-40ba-afce-0ac2f5b51a9b 1073741824 Aug 10 16:16:56 devstack sudo[109632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:57 devstack sudo[109632]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6dd1c741-3bc4-4da8-8985-994d4f232fff tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6b5f8d0a-7f48-40ba-afce-0ac2f5b51a9b 1073741824" returned: 0 in 0.419s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6dd1c741-3bc4-4da8-8985-994d4f232fff tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6b5f8d0a-7f48-40ba-afce-0ac2f5b51a9b {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:57 devstack sudo[109638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6b5f8d0a-7f48-40ba-afce-0ac2f5b51a9b Aug 10 16:16:57 devstack sudo[109638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:57 devstack sudo[109638]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-6dd1c741-3bc4-4da8-8985-994d4f232fff tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6b5f8d0a-7f48-40ba-afce-0ac2f5b51a9b" returned: 0 in 0.252s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:57 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-6dd1c741-3bc4-4da8-8985-994d4f232fff tempest-ProjectMemberTests-715789302 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:16:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-6dd1c741-3bc4-4da8-8985-994d4f232fff tempest-ProjectMemberTests-715789302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:16:57 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-6dd1c741-3bc4-4da8-8985-994d4f232fff tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d314412-b449-412d-9f54-4981a49547c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b5f8d0a-7f48-40ba-afce-0ac2f5b51a9b', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:16:57 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-6dd1c741-3bc4-4da8-8985-994d4f232fff tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9dc781d-2713-450e-b02a-8c7fbc31a659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:16:57 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-6dd1c741-3bc4-4da8-8985-994d4f232fff tempest-ProjectMemberTests-715789302 None] Volume volume-6b5f8d0a-7f48-40ba-afce-0ac2f5b51a9b (6b5f8d0a-7f48-40ba-afce-0ac2f5b51a9b): created successfully Aug 10 16:16:57 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-6dd1c741-3bc4-4da8-8985-994d4f232fff tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9dc781d-2713-450e-b02a-8c7fbc31a659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:16:57 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-6dd1c741-3bc4-4da8-8985-994d4f232fff tempest-ProjectMemberTests-715789302 None] Flow 'volume_create_manager' (c1466368-da85-45b1-a80a-bfd7b3a07aad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:16:57 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-6dd1c741-3bc4-4da8-8985-994d4f232fff tempest-ProjectMemberTests-715789302 None] Created volume successfully. Aug 10 16:16:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-48ff5cc3-f108-498c-8edd-242c7a2035d9 tempest-ProjectMemberTests-715789302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:16:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-48ff5cc3-f108-498c-8edd-242c7a2035d9 tempest-ProjectMemberTests-715789302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:16:57 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-48ff5cc3-f108-498c-8edd-242c7a2035d9 tempest-ProjectMemberTests-715789302 None] Creating offline snapshot 662cbd9e-d45d-4978-91cc-d31bc1f46dbd of volume 6b5f8d0a-7f48-40ba-afce-0ac2f5b51a9b {{(pid=88641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 16:16:57 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fdc47b1-e567-4e98-8d0c-b2abe7c25c01]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:16:57 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-48ff5cc3-f108-498c-8edd-242c7a2035d9 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6b5f8d0a-7f48-40ba-afce-0ac2f5b51a9b {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:57 devstack sudo[109641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6b5f8d0a-7f48-40ba-afce-0ac2f5b51a9b Aug 10 16:16:57 devstack sudo[109641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:58 devstack sudo[109641]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-48ff5cc3-f108-498c-8edd-242c7a2035d9 tempest-ProjectMemberTests-715789302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6b5f8d0a-7f48-40ba-afce-0ac2f5b51a9b" returned: 0 in 0.371s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-48ff5cc3-f108-498c-8edd-242c7a2035d9 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6b5f8d0a-7f48-40ba-afce-0ac2f5b51a9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6b5f8d0a-7f48-40ba-afce-0ac2f5b51a9b.662cbd9e-d45d-4978-91cc-d31bc1f46dbd 1G {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:58 devstack sudo[109646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6b5f8d0a-7f48-40ba-afce-0ac2f5b51a9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6b5f8d0a-7f48-40ba-afce-0ac2f5b51a9b.662cbd9e-d45d-4978-91cc-d31bc1f46dbd 1G Aug 10 16:16:58 devstack sudo[109646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:58 devstack sudo[109646]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-48ff5cc3-f108-498c-8edd-242c7a2035d9 tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6b5f8d0a-7f48-40ba-afce-0ac2f5b51a9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6b5f8d0a-7f48-40ba-afce-0ac2f5b51a9b.662cbd9e-d45d-4978-91cc-d31bc1f46dbd 1G" returned: 0 in 0.406s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-48ff5cc3-f108-498c-8edd-242c7a2035d9 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b5f8d0a-7f48-40ba-afce-0ac2f5b51a9b -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6b5f8d0a-7f48-40ba-afce-0ac2f5b51a9b.662cbd9e-d45d-4978-91cc-d31bc1f46dbd {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:58 devstack sudo[109651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b5f8d0a-7f48-40ba-afce-0ac2f5b51a9b -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6b5f8d0a-7f48-40ba-afce-0ac2f5b51a9b.662cbd9e-d45d-4978-91cc-d31bc1f46dbd Aug 10 16:16:58 devstack sudo[109651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:58 devstack sudo[109651]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-48ff5cc3-f108-498c-8edd-242c7a2035d9 tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b5f8d0a-7f48-40ba-afce-0ac2f5b51a9b -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6b5f8d0a-7f48-40ba-afce-0ac2f5b51a9b.662cbd9e-d45d-4978-91cc-d31bc1f46dbd" returned: 0 in 0.280s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:58 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-48ff5cc3-f108-498c-8edd-242c7a2035d9 tempest-ProjectMemberTests-715789302 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6b5f8d0a-7f48-40ba-afce-0ac2f5b51a9b.662cbd9e-d45d-4978-91cc-d31bc1f46dbd is being set with open permissions: ugo+rw Aug 10 16:16:58 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-48ff5cc3-f108-498c-8edd-242c7a2035d9 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6b5f8d0a-7f48-40ba-afce-0ac2f5b51a9b.662cbd9e-d45d-4978-91cc-d31bc1f46dbd {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:58 devstack sudo[109656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6b5f8d0a-7f48-40ba-afce-0ac2f5b51a9b.662cbd9e-d45d-4978-91cc-d31bc1f46dbd Aug 10 16:16:58 devstack sudo[109656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:59 devstack sudo[109656]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:59 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-48ff5cc3-f108-498c-8edd-242c7a2035d9 tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6b5f8d0a-7f48-40ba-afce-0ac2f5b51a9b.662cbd9e-d45d-4978-91cc-d31bc1f46dbd" returned: 0 in 0.234s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:59 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-48ff5cc3-f108-498c-8edd-242c7a2035d9 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6b5f8d0a-7f48-40ba-afce-0ac2f5b51a9b.info {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:59 devstack sudo[109659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6b5f8d0a-7f48-40ba-afce-0ac2f5b51a9b.info Aug 10 16:16:59 devstack sudo[109659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:59 devstack sudo[109659]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:59 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-48ff5cc3-f108-498c-8edd-242c7a2035d9 tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6b5f8d0a-7f48-40ba-afce-0ac2f5b51a9b.info" returned: 0 in 0.244s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:59 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-48ff5cc3-f108-498c-8edd-242c7a2035d9 tempest-ProjectMemberTests-715789302 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6b5f8d0a-7f48-40ba-afce-0ac2f5b51a9b.info is being set with open permissions: ugo+rw Aug 10 16:16:59 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-48ff5cc3-f108-498c-8edd-242c7a2035d9 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6b5f8d0a-7f48-40ba-afce-0ac2f5b51a9b.info {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:16:59 devstack sudo[109662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6b5f8d0a-7f48-40ba-afce-0ac2f5b51a9b.info Aug 10 16:16:59 devstack sudo[109662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:16:59 devstack sudo[109662]: pam_unix(sudo:session): session closed for user root Aug 10 16:16:59 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-48ff5cc3-f108-498c-8edd-242c7a2035d9 tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6b5f8d0a-7f48-40ba-afce-0ac2f5b51a9b.info" returned: 0 in 0.240s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:16:59 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-48ff5cc3-f108-498c-8edd-242c7a2035d9 tempest-ProjectMemberTests-715789302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.859s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:16:59 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-48ff5cc3-f108-498c-8edd-242c7a2035d9 tempest-ProjectMemberTests-715789302 None] Create snapshot completed successfully Aug 10 16:16:59 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-9763cec4-f43b-4e64-b401-866962251326 tempest-ProjectMemberTests-715789302 None] Acquiring lock "cinder-662cbd9e-d45d-4978-91cc-d31bc1f46dbd-delete_snapshot" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:16:59 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-9763cec4-f43b-4e64-b401-866962251326 tempest-ProjectMemberTests-715789302 None] Lock "cinder-662cbd9e-d45d-4978-91cc-d31bc1f46dbd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:16:59 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-9763cec4-f43b-4e64-b401-866962251326 tempest-ProjectMemberTests-715789302 None] Acquiring lock "cinder-quobyte-6b5f8d0a-7f48-40ba-afce-0ac2f5b51a9b" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:16:59 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-9763cec4-f43b-4e64-b401-866962251326 tempest-ProjectMemberTests-715789302 None] Lock "cinder-quobyte-6b5f8d0a-7f48-40ba-afce-0ac2f5b51a9b" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:16:59 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-9763cec4-f43b-4e64-b401-866962251326 tempest-ProjectMemberTests-715789302 None] Acquiring lock "cinder-quobyte-662cbd9e-d45d-4978-91cc-d31bc1f46dbd" by "_delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:16:59 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-9763cec4-f43b-4e64-b401-866962251326 tempest-ProjectMemberTests-715789302 None] Lock "cinder-quobyte-662cbd9e-d45d-4978-91cc-d31bc1f46dbd" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:16:59 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-9763cec4-f43b-4e64-b401-866962251326 tempest-ProjectMemberTests-715789302 None] Deleting offline snapshot 662cbd9e-d45d-4978-91cc-d31bc1f46dbd of volume 6b5f8d0a-7f48-40ba-afce-0ac2f5b51a9b {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 16:16:59 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-9763cec4-f43b-4e64-b401-866962251326 tempest-ProjectMemberTests-715789302 None] snapshot_file for this snap is: volume-6b5f8d0a-7f48-40ba-afce-0ac2f5b51a9b.662cbd9e-d45d-4978-91cc-d31bc1f46dbd {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 16:16:59 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c05fe91-0a3e-453d-98f0-545c4e90e5e5]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:16:59 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9763cec4-f43b-4e64-b401-866962251326 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6b5f8d0a-7f48-40ba-afce-0ac2f5b51a9b.662cbd9e-d45d-4978-91cc-d31bc1f46dbd {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:17:00 devstack sudo[109701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6b5f8d0a-7f48-40ba-afce-0ac2f5b51a9b.662cbd9e-d45d-4978-91cc-d31bc1f46dbd Aug 10 16:17:00 devstack sudo[109701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:17:00 devstack sudo[109701]: pam_unix(sudo:session): session closed for user root Aug 10 16:17:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9763cec4-f43b-4e64-b401-866962251326 tempest-ProjectMemberTests-715789302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6b5f8d0a-7f48-40ba-afce-0ac2f5b51a9b.662cbd9e-d45d-4978-91cc-d31bc1f46dbd" returned: 0 in 0.349s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:17:00 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-9763cec4-f43b-4e64-b401-866962251326 tempest-ProjectMemberTests-715789302 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b5f8d0a-7f48-40ba-afce-0ac2f5b51a9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 16:17:00 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e3bf6a-2067-4a56-881a-32d37a63e886]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:17:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9763cec4-f43b-4e64-b401-866962251326 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6b5f8d0a-7f48-40ba-afce-0ac2f5b51a9b {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:17:00 devstack sudo[109706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6b5f8d0a-7f48-40ba-afce-0ac2f5b51a9b Aug 10 16:17:00 devstack sudo[109706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:17:00 devstack sudo[109706]: pam_unix(sudo:session): session closed for user root Aug 10 16:17:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9763cec4-f43b-4e64-b401-866962251326 tempest-ProjectMemberTests-715789302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6b5f8d0a-7f48-40ba-afce-0ac2f5b51a9b" returned: 0 in 0.351s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:17:00 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9763cec4-f43b-4e64-b401-866962251326 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6b5f8d0a-7f48-40ba-afce-0ac2f5b51a9b.662cbd9e-d45d-4978-91cc-d31bc1f46dbd {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:17:00 devstack sudo[109711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6b5f8d0a-7f48-40ba-afce-0ac2f5b51a9b.662cbd9e-d45d-4978-91cc-d31bc1f46dbd Aug 10 16:17:00 devstack sudo[109711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:17:01 devstack sudo[109711]: pam_unix(sudo:session): session closed for user root Aug 10 16:17:01 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9763cec4-f43b-4e64-b401-866962251326 tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6b5f8d0a-7f48-40ba-afce-0ac2f5b51a9b.662cbd9e-d45d-4978-91cc-d31bc1f46dbd" returned: 0 in 0.338s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:17:01 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9763cec4-f43b-4e64-b401-866962251326 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6b5f8d0a-7f48-40ba-afce-0ac2f5b51a9b.662cbd9e-d45d-4978-91cc-d31bc1f46dbd {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:17:01 devstack sudo[109716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6b5f8d0a-7f48-40ba-afce-0ac2f5b51a9b.662cbd9e-d45d-4978-91cc-d31bc1f46dbd Aug 10 16:17:01 devstack sudo[109716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:17:01 devstack sudo[109716]: pam_unix(sudo:session): session closed for user root Aug 10 16:17:01 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-9763cec4-f43b-4e64-b401-866962251326 tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6b5f8d0a-7f48-40ba-afce-0ac2f5b51a9b.662cbd9e-d45d-4978-91cc-d31bc1f46dbd" returned: 0 in 0.238s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:17:01 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-9763cec4-f43b-4e64-b401-866962251326 tempest-ProjectMemberTests-715789302 None] Lock "cinder-quobyte-662cbd9e-d45d-4978-91cc-d31bc1f46dbd" released by "_delete_snapshot" :: held 1.364s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:17:01 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-9763cec4-f43b-4e64-b401-866962251326 tempest-ProjectMemberTests-715789302 None] Lock "cinder-quobyte-6b5f8d0a-7f48-40ba-afce-0ac2f5b51a9b" released by "delete_snapshot" :: held 1.385s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:17:01 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-9763cec4-f43b-4e64-b401-866962251326 tempest-ProjectMemberTests-715789302 None] Created reservations ['6b99a735-2868-40ef-8045-774e301ae978', '216c5a04-90ba-4142-b8a0-d571dd5a3ed0', '8bd41e76-8305-4a8e-85d0-ee6495173183', 'af73957a-5328-4112-9b43-c412ff7db78f'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:17:01 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-9763cec4-f43b-4e64-b401-866962251326 tempest-ProjectMemberTests-715789302 None] Delete snapshot completed successfully. Aug 10 16:17:01 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-9763cec4-f43b-4e64-b401-866962251326 tempest-ProjectMemberTests-715789302 None] Lock "cinder-662cbd9e-d45d-4978-91cc-d31bc1f46dbd-delete_snapshot" released by "delete_snapshot" :: held 1.511s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:17:02 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-ef7a63fc-b620-4815-939b-b0074d5dee8f tempest-ProjectMemberTests-715789302 None] Acquiring lock "cinder-6b5f8d0a-7f48-40ba-afce-0ac2f5b51a9b-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:17:02 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-ef7a63fc-b620-4815-939b-b0074d5dee8f tempest-ProjectMemberTests-715789302 None] Lock "cinder-6b5f8d0a-7f48-40ba-afce-0ac2f5b51a9b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:17:02 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-ef7a63fc-b620-4815-939b-b0074d5dee8f tempest-ProjectMemberTests-715789302 None] Acquiring lock "cinder-quobyte-6b5f8d0a-7f48-40ba-afce-0ac2f5b51a9b" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:17:02 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-ef7a63fc-b620-4815-939b-b0074d5dee8f tempest-ProjectMemberTests-715789302 None] Lock "cinder-quobyte-6b5f8d0a-7f48-40ba-afce-0ac2f5b51a9b" acquired by "delete_volume" :: waited 0.015s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:17:02 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6383df7-8a2d-4469-ba74-2350fe175c72]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:17:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ef7a63fc-b620-4815-939b-b0074d5dee8f tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6b5f8d0a-7f48-40ba-afce-0ac2f5b51a9b {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:17:02 devstack sudo[109722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6b5f8d0a-7f48-40ba-afce-0ac2f5b51a9b Aug 10 16:17:02 devstack sudo[109722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:17:02 devstack sudo[109722]: pam_unix(sudo:session): session closed for user root Aug 10 16:17:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ef7a63fc-b620-4815-939b-b0074d5dee8f tempest-ProjectMemberTests-715789302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6b5f8d0a-7f48-40ba-afce-0ac2f5b51a9b" returned: 0 in 0.354s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:17:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ef7a63fc-b620-4815-939b-b0074d5dee8f tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6b5f8d0a-7f48-40ba-afce-0ac2f5b51a9b {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:17:02 devstack sudo[109728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6b5f8d0a-7f48-40ba-afce-0ac2f5b51a9b Aug 10 16:17:02 devstack sudo[109728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:17:02 devstack sudo[109728]: pam_unix(sudo:session): session closed for user root Aug 10 16:17:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ef7a63fc-b620-4815-939b-b0074d5dee8f tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-6b5f8d0a-7f48-40ba-afce-0ac2f5b51a9b" returned: 0 in 0.248s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:17:02 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-ef7a63fc-b620-4815-939b-b0074d5dee8f tempest-ProjectMemberTests-715789302 None] Lock "cinder-quobyte-6b5f8d0a-7f48-40ba-afce-0ac2f5b51a9b" released by "delete_volume" :: held 0.658s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:17:02 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-ef7a63fc-b620-4815-939b-b0074d5dee8f tempest-ProjectMemberTests-715789302 None] Created reservations ['e3ecc9de-d405-4896-86f8-2d29136e43cb', 'a78e7ec9-ce75-42cc-a5a0-39ee9a126532', '5febebc5-dad0-4795-894c-386b47be5264', 'd0767f75-1e87-4f09-879e-74996d976d2b'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:17:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-ef7a63fc-b620-4815-939b-b0074d5dee8f tempest-ProjectMemberTests-715789302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:17:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-ef7a63fc-b620-4815-939b-b0074d5dee8f tempest-ProjectMemberTests-715789302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:17:02 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-ef7a63fc-b620-4815-939b-b0074d5dee8f tempest-ProjectMemberTests-715789302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:17:02 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-ef7a63fc-b620-4815-939b-b0074d5dee8f tempest-ProjectMemberTests-715789302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:17:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-ef7a63fc-b620-4815-939b-b0074d5dee8f tempest-ProjectMemberTests-715789302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:17:02 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ef7a63fc-b620-4815-939b-b0074d5dee8f tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:17:02 devstack sudo[109731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:17:02 devstack sudo[109731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:17:03 devstack sudo[109731]: pam_unix(sudo:session): session closed for user root Aug 10 16:17:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-ef7a63fc-b620-4815-939b-b0074d5dee8f tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.259s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:17:03 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-ef7a63fc-b620-4815-939b-b0074d5dee8f tempest-ProjectMemberTests-715789302 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:17:03 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-ef7a63fc-b620-4815-939b-b0074d5dee8f tempest-ProjectMemberTests-715789302 None] Deleted volume successfully. Aug 10 16:17:03 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-ef7a63fc-b620-4815-939b-b0074d5dee8f tempest-ProjectMemberTests-715789302 None] Lock "cinder-6b5f8d0a-7f48-40ba-afce-0ac2f5b51a9b-delete_volume" released by "delete_volume" :: held 1.112s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:17:03 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c6b8f86-b369-46c0-8756-4c5369fc6b84 tempest-ProjectMemberTests-715789302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:17:03 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-1c6b8f86-b369-46c0-8756-4c5369fc6b84 tempest-ProjectMemberTests-715789302 None] Flow 'volume_create_manager' (08ea90f2-cf4f-49ac-b1ef-d9226cbfc869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:17:03 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-1c6b8f86-b369-46c0-8756-4c5369fc6b84 tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a94a081c-2971-442d-8bbd-01c30ac4ea9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:17:03 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-1c6b8f86-b369-46c0-8756-4c5369fc6b84 tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a94a081c-2971-442d-8bbd-01c30ac4ea9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:17:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1255911773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f060d50-45e6-431b-af4b-2c9eee609cc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8408ad471876405b8109f4d45d4a242d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:17:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:17:04Z,use_quota=True,user_id='dc958e8abfdb43a69a4609f15eb8d6d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:17:03 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-1c6b8f86-b369-46c0-8756-4c5369fc6b84 tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24f1969f-b9f3-4f89-bb1b-888b734b363a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:17:03 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-1c6b8f86-b369-46c0-8756-4c5369fc6b84 tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24f1969f-b9f3-4f89-bb1b-888b734b363a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:17:03 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-1c6b8f86-b369-46c0-8756-4c5369fc6b84 tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0197b810-c1c2-4125-8115-3347144e9911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:17:03 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-1c6b8f86-b369-46c0-8756-4c5369fc6b84 tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0197b810-c1c2-4125-8115-3347144e9911) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f060d50-45e6-431b-af4b-2c9eee609cc3', 'volume_name': 'volume-5f060d50-45e6-431b-af4b-2c9eee609cc3', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:17:03 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-1c6b8f86-b369-46c0-8756-4c5369fc6b84 tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a10d74b-758d-49c2-ad50-466030fa3f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:17:03 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-1c6b8f86-b369-46c0-8756-4c5369fc6b84 tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a10d74b-758d-49c2-ad50-466030fa3f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:17:03 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-1c6b8f86-b369-46c0-8756-4c5369fc6b84 tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b460cbae-be4b-417e-942f-8ec3a8ad45c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:17:03 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-1c6b8f86-b369-46c0-8756-4c5369fc6b84 tempest-ProjectMemberTests-715789302 None] Volume 5f060d50-45e6-431b-af4b-2c9eee609cc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f060d50-45e6-431b-af4b-2c9eee609cc3', 'volume_size': 1} Aug 10 16:17:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-1c6b8f86-b369-46c0-8756-4c5369fc6b84 tempest-ProjectMemberTests-715789302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:17:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-1c6b8f86-b369-46c0-8756-4c5369fc6b84 tempest-ProjectMemberTests-715789302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:17:03 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-1c6b8f86-b369-46c0-8756-4c5369fc6b84 tempest-ProjectMemberTests-715789302 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:17:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1255911773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f060d50-45e6-431b-af4b-2c9eee609cc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8408ad471876405b8109f4d45d4a242d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:17:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:17:04Z,use_quota=True,user_id='dc958e8abfdb43a69a4609f15eb8d6d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:17:03 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-1c6b8f86-b369-46c0-8756-4c5369fc6b84 tempest-ProjectMemberTests-715789302 None] Creating volume 5f060d50-45e6-431b-af4b-2c9eee609cc3 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:17:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-1c6b8f86-b369-46c0-8756-4c5369fc6b84 tempest-ProjectMemberTests-715789302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:17:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-1c6b8f86-b369-46c0-8756-4c5369fc6b84 tempest-ProjectMemberTests-715789302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:17:03 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-1c6b8f86-b369-46c0-8756-4c5369fc6b84 tempest-ProjectMemberTests-715789302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:17:03 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-1c6b8f86-b369-46c0-8756-4c5369fc6b84 tempest-ProjectMemberTests-715789302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:17:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-1c6b8f86-b369-46c0-8756-4c5369fc6b84 tempest-ProjectMemberTests-715789302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:17:03 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-1c6b8f86-b369-46c0-8756-4c5369fc6b84 tempest-ProjectMemberTests-715789302 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:17:03 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-1c6b8f86-b369-46c0-8756-4c5369fc6b84 tempest-ProjectMemberTests-715789302 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:17:03 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-1c6b8f86-b369-46c0-8756-4c5369fc6b84 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-5f060d50-45e6-431b-af4b-2c9eee609cc3 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:17:03 devstack sudo[109735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-5f060d50-45e6-431b-af4b-2c9eee609cc3 1073741824 Aug 10 16:17:03 devstack sudo[109735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:17:04 devstack sudo[109735]: pam_unix(sudo:session): session closed for user root Aug 10 16:17:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-1c6b8f86-b369-46c0-8756-4c5369fc6b84 tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-5f060d50-45e6-431b-af4b-2c9eee609cc3 1073741824" returned: 0 in 0.419s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:17:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-1c6b8f86-b369-46c0-8756-4c5369fc6b84 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-5f060d50-45e6-431b-af4b-2c9eee609cc3 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:17:04 devstack sudo[109740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-5f060d50-45e6-431b-af4b-2c9eee609cc3 Aug 10 16:17:04 devstack sudo[109740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:17:04 devstack sudo[109740]: pam_unix(sudo:session): session closed for user root Aug 10 16:17:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-1c6b8f86-b369-46c0-8756-4c5369fc6b84 tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-5f060d50-45e6-431b-af4b-2c9eee609cc3" returned: 0 in 0.246s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:17:04 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-1c6b8f86-b369-46c0-8756-4c5369fc6b84 tempest-ProjectMemberTests-715789302 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:17:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-1c6b8f86-b369-46c0-8756-4c5369fc6b84 tempest-ProjectMemberTests-715789302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:17:04 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-1c6b8f86-b369-46c0-8756-4c5369fc6b84 tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b460cbae-be4b-417e-942f-8ec3a8ad45c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f060d50-45e6-431b-af4b-2c9eee609cc3', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:17:04 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-1c6b8f86-b369-46c0-8756-4c5369fc6b84 tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32b1193f-84dc-4e25-8b82-55f62a42b40f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:17:04 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-1c6b8f86-b369-46c0-8756-4c5369fc6b84 tempest-ProjectMemberTests-715789302 None] Volume volume-5f060d50-45e6-431b-af4b-2c9eee609cc3 (5f060d50-45e6-431b-af4b-2c9eee609cc3): created successfully Aug 10 16:17:04 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-1c6b8f86-b369-46c0-8756-4c5369fc6b84 tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32b1193f-84dc-4e25-8b82-55f62a42b40f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:17:04 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-1c6b8f86-b369-46c0-8756-4c5369fc6b84 tempest-ProjectMemberTests-715789302 None] Flow 'volume_create_manager' (08ea90f2-cf4f-49ac-b1ef-d9226cbfc869) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:17:04 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-1c6b8f86-b369-46c0-8756-4c5369fc6b84 tempest-ProjectMemberTests-715789302 None] Created volume successfully. Aug 10 16:17:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-fc0bbd4e-f5f0-45e2-9a6d-454bb8a764f6 tempest-ProjectMemberTests-715789302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:17:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-fc0bbd4e-f5f0-45e2-9a6d-454bb8a764f6 tempest-ProjectMemberTests-715789302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:17:04 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-fc0bbd4e-f5f0-45e2-9a6d-454bb8a764f6 tempest-ProjectMemberTests-715789302 None] Creating offline snapshot 3592f1ac-c36a-4efd-aa0a-c1ba76505244 of volume 5f060d50-45e6-431b-af4b-2c9eee609cc3 {{(pid=88641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 16:17:04 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e16d30-e2fc-41f5-9d5f-fbf09e8842af]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:17:04 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fc0bbd4e-f5f0-45e2-9a6d-454bb8a764f6 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-5f060d50-45e6-431b-af4b-2c9eee609cc3 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:17:04 devstack sudo[109743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-5f060d50-45e6-431b-af4b-2c9eee609cc3 Aug 10 16:17:04 devstack sudo[109743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:17:05 devstack sudo[109743]: pam_unix(sudo:session): session closed for user root Aug 10 16:17:05 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fc0bbd4e-f5f0-45e2-9a6d-454bb8a764f6 tempest-ProjectMemberTests-715789302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-5f060d50-45e6-431b-af4b-2c9eee609cc3" returned: 0 in 0.357s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:17:05 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fc0bbd4e-f5f0-45e2-9a6d-454bb8a764f6 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-5f060d50-45e6-431b-af4b-2c9eee609cc3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-5f060d50-45e6-431b-af4b-2c9eee609cc3.3592f1ac-c36a-4efd-aa0a-c1ba76505244 1G {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:17:05 devstack sudo[109748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-5f060d50-45e6-431b-af4b-2c9eee609cc3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-5f060d50-45e6-431b-af4b-2c9eee609cc3.3592f1ac-c36a-4efd-aa0a-c1ba76505244 1G Aug 10 16:17:05 devstack sudo[109748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:17:05 devstack sudo[109748]: pam_unix(sudo:session): session closed for user root Aug 10 16:17:05 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fc0bbd4e-f5f0-45e2-9a6d-454bb8a764f6 tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-5f060d50-45e6-431b-af4b-2c9eee609cc3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-5f060d50-45e6-431b-af4b-2c9eee609cc3.3592f1ac-c36a-4efd-aa0a-c1ba76505244 1G" returned: 0 in 0.391s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:17:05 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fc0bbd4e-f5f0-45e2-9a6d-454bb8a764f6 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f060d50-45e6-431b-af4b-2c9eee609cc3 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-5f060d50-45e6-431b-af4b-2c9eee609cc3.3592f1ac-c36a-4efd-aa0a-c1ba76505244 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:17:05 devstack sudo[109754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f060d50-45e6-431b-af4b-2c9eee609cc3 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-5f060d50-45e6-431b-af4b-2c9eee609cc3.3592f1ac-c36a-4efd-aa0a-c1ba76505244 Aug 10 16:17:05 devstack sudo[109754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:17:05 devstack sudo[109754]: pam_unix(sudo:session): session closed for user root Aug 10 16:17:05 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fc0bbd4e-f5f0-45e2-9a6d-454bb8a764f6 tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f060d50-45e6-431b-af4b-2c9eee609cc3 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-5f060d50-45e6-431b-af4b-2c9eee609cc3.3592f1ac-c36a-4efd-aa0a-c1ba76505244" returned: 0 in 0.310s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:17:05 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-fc0bbd4e-f5f0-45e2-9a6d-454bb8a764f6 tempest-ProjectMemberTests-715789302 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-5f060d50-45e6-431b-af4b-2c9eee609cc3.3592f1ac-c36a-4efd-aa0a-c1ba76505244 is being set with open permissions: ugo+rw Aug 10 16:17:05 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fc0bbd4e-f5f0-45e2-9a6d-454bb8a764f6 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-5f060d50-45e6-431b-af4b-2c9eee609cc3.3592f1ac-c36a-4efd-aa0a-c1ba76505244 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:17:05 devstack sudo[109759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-5f060d50-45e6-431b-af4b-2c9eee609cc3.3592f1ac-c36a-4efd-aa0a-c1ba76505244 Aug 10 16:17:05 devstack sudo[109759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:17:06 devstack sudo[109759]: pam_unix(sudo:session): session closed for user root Aug 10 16:17:06 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fc0bbd4e-f5f0-45e2-9a6d-454bb8a764f6 tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-5f060d50-45e6-431b-af4b-2c9eee609cc3.3592f1ac-c36a-4efd-aa0a-c1ba76505244" returned: 0 in 0.240s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:17:06 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fc0bbd4e-f5f0-45e2-9a6d-454bb8a764f6 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-5f060d50-45e6-431b-af4b-2c9eee609cc3.info {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:17:06 devstack sudo[109762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-5f060d50-45e6-431b-af4b-2c9eee609cc3.info Aug 10 16:17:06 devstack sudo[109762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:17:06 devstack sudo[109762]: pam_unix(sudo:session): session closed for user root Aug 10 16:17:06 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fc0bbd4e-f5f0-45e2-9a6d-454bb8a764f6 tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-5f060d50-45e6-431b-af4b-2c9eee609cc3.info" returned: 0 in 0.247s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:17:06 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-fc0bbd4e-f5f0-45e2-9a6d-454bb8a764f6 tempest-ProjectMemberTests-715789302 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-5f060d50-45e6-431b-af4b-2c9eee609cc3.info is being set with open permissions: ugo+rw Aug 10 16:17:06 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fc0bbd4e-f5f0-45e2-9a6d-454bb8a764f6 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-5f060d50-45e6-431b-af4b-2c9eee609cc3.info {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:17:06 devstack sudo[109771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-5f060d50-45e6-431b-af4b-2c9eee609cc3.info Aug 10 16:17:06 devstack sudo[109771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:17:06 devstack sudo[109771]: pam_unix(sudo:session): session closed for user root Aug 10 16:17:06 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fc0bbd4e-f5f0-45e2-9a6d-454bb8a764f6 tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-5f060d50-45e6-431b-af4b-2c9eee609cc3.info" returned: 0 in 0.256s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:17:06 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-fc0bbd4e-f5f0-45e2-9a6d-454bb8a764f6 tempest-ProjectMemberTests-715789302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.880s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:17:06 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-fc0bbd4e-f5f0-45e2-9a6d-454bb8a764f6 tempest-ProjectMemberTests-715789302 None] Create snapshot completed successfully Aug 10 16:17:06 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-602f89b9-3a4b-4ddb-81b7-30f8172c0a87 tempest-ProjectMemberTests-715789302 None] Acquiring lock "cinder-3592f1ac-c36a-4efd-aa0a-c1ba76505244-delete_snapshot" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:17:06 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-602f89b9-3a4b-4ddb-81b7-30f8172c0a87 tempest-ProjectMemberTests-715789302 None] Lock "cinder-3592f1ac-c36a-4efd-aa0a-c1ba76505244-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:17:06 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-602f89b9-3a4b-4ddb-81b7-30f8172c0a87 tempest-ProjectMemberTests-715789302 None] Acquiring lock "cinder-quobyte-5f060d50-45e6-431b-af4b-2c9eee609cc3" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:17:07 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-602f89b9-3a4b-4ddb-81b7-30f8172c0a87 tempest-ProjectMemberTests-715789302 None] Lock "cinder-quobyte-5f060d50-45e6-431b-af4b-2c9eee609cc3" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:17:07 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-602f89b9-3a4b-4ddb-81b7-30f8172c0a87 tempest-ProjectMemberTests-715789302 None] Acquiring lock "cinder-quobyte-3592f1ac-c36a-4efd-aa0a-c1ba76505244" by "_delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:17:07 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-602f89b9-3a4b-4ddb-81b7-30f8172c0a87 tempest-ProjectMemberTests-715789302 None] Lock "cinder-quobyte-3592f1ac-c36a-4efd-aa0a-c1ba76505244" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:17:07 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-602f89b9-3a4b-4ddb-81b7-30f8172c0a87 tempest-ProjectMemberTests-715789302 None] Deleting offline snapshot 3592f1ac-c36a-4efd-aa0a-c1ba76505244 of volume 5f060d50-45e6-431b-af4b-2c9eee609cc3 {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 16:17:07 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-602f89b9-3a4b-4ddb-81b7-30f8172c0a87 tempest-ProjectMemberTests-715789302 None] snapshot_file for this snap is: volume-5f060d50-45e6-431b-af4b-2c9eee609cc3.3592f1ac-c36a-4efd-aa0a-c1ba76505244 {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 16:17:07 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba4c72f-f95a-4bf2-91e2-ce2aa8fc849d]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:17:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-602f89b9-3a4b-4ddb-81b7-30f8172c0a87 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-5f060d50-45e6-431b-af4b-2c9eee609cc3.3592f1ac-c36a-4efd-aa0a-c1ba76505244 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:17:07 devstack sudo[109774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-5f060d50-45e6-431b-af4b-2c9eee609cc3.3592f1ac-c36a-4efd-aa0a-c1ba76505244 Aug 10 16:17:07 devstack sudo[109774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:17:07 devstack sudo[109774]: pam_unix(sudo:session): session closed for user root Aug 10 16:17:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-602f89b9-3a4b-4ddb-81b7-30f8172c0a87 tempest-ProjectMemberTests-715789302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-5f060d50-45e6-431b-af4b-2c9eee609cc3.3592f1ac-c36a-4efd-aa0a-c1ba76505244" returned: 0 in 0.362s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:17:07 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-602f89b9-3a4b-4ddb-81b7-30f8172c0a87 tempest-ProjectMemberTests-715789302 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5f060d50-45e6-431b-af4b-2c9eee609cc3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 16:17:07 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a30178-d0ea-41e4-abd0-de32424a8160]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:17:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-602f89b9-3a4b-4ddb-81b7-30f8172c0a87 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-5f060d50-45e6-431b-af4b-2c9eee609cc3 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:17:07 devstack sudo[109779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-5f060d50-45e6-431b-af4b-2c9eee609cc3 Aug 10 16:17:07 devstack sudo[109779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:17:07 devstack sudo[109779]: pam_unix(sudo:session): session closed for user root Aug 10 16:17:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-602f89b9-3a4b-4ddb-81b7-30f8172c0a87 tempest-ProjectMemberTests-715789302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-5f060d50-45e6-431b-af4b-2c9eee609cc3" returned: 0 in 0.350s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:17:07 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-602f89b9-3a4b-4ddb-81b7-30f8172c0a87 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-5f060d50-45e6-431b-af4b-2c9eee609cc3.3592f1ac-c36a-4efd-aa0a-c1ba76505244 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:17:07 devstack sudo[109784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-5f060d50-45e6-431b-af4b-2c9eee609cc3.3592f1ac-c36a-4efd-aa0a-c1ba76505244 Aug 10 16:17:07 devstack sudo[109784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:17:08 devstack sudo[109784]: pam_unix(sudo:session): session closed for user root Aug 10 16:17:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-602f89b9-3a4b-4ddb-81b7-30f8172c0a87 tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-5f060d50-45e6-431b-af4b-2c9eee609cc3.3592f1ac-c36a-4efd-aa0a-c1ba76505244" returned: 0 in 0.330s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:17:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-602f89b9-3a4b-4ddb-81b7-30f8172c0a87 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-5f060d50-45e6-431b-af4b-2c9eee609cc3.3592f1ac-c36a-4efd-aa0a-c1ba76505244 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:17:08 devstack sudo[109789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-5f060d50-45e6-431b-af4b-2c9eee609cc3.3592f1ac-c36a-4efd-aa0a-c1ba76505244 Aug 10 16:17:08 devstack sudo[109789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:17:08 devstack sudo[109789]: pam_unix(sudo:session): session closed for user root Aug 10 16:17:08 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-602f89b9-3a4b-4ddb-81b7-30f8172c0a87 tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-5f060d50-45e6-431b-af4b-2c9eee609cc3.3592f1ac-c36a-4efd-aa0a-c1ba76505244" returned: 0 in 0.235s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:17:08 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-602f89b9-3a4b-4ddb-81b7-30f8172c0a87 tempest-ProjectMemberTests-715789302 None] Lock "cinder-quobyte-3592f1ac-c36a-4efd-aa0a-c1ba76505244" released by "_delete_snapshot" :: held 1.366s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:17:08 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-602f89b9-3a4b-4ddb-81b7-30f8172c0a87 tempest-ProjectMemberTests-715789302 None] Lock "cinder-quobyte-5f060d50-45e6-431b-af4b-2c9eee609cc3" released by "delete_snapshot" :: held 1.388s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:17:08 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-602f89b9-3a4b-4ddb-81b7-30f8172c0a87 tempest-ProjectMemberTests-715789302 None] Created reservations ['40ab6407-62ae-4a7d-9100-cffb9f467a8b', '923d6a7c-ae75-4715-b071-2211afc16e35', 'feefe0b4-2b08-4c91-9819-d92159f56b4a', 'cebb5815-dfcc-42ce-8fff-02d0eb0ddb0f'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:17:08 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-602f89b9-3a4b-4ddb-81b7-30f8172c0a87 tempest-ProjectMemberTests-715789302 None] Delete snapshot completed successfully. Aug 10 16:17:08 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-602f89b9-3a4b-4ddb-81b7-30f8172c0a87 tempest-ProjectMemberTests-715789302 None] Lock "cinder-3592f1ac-c36a-4efd-aa0a-c1ba76505244-delete_snapshot" released by "delete_snapshot" :: held 1.540s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:17:09 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-752abeed-764f-4876-b3f1-f146e108831c tempest-ProjectMemberTests-715789302 None] Acquiring lock "cinder-5f060d50-45e6-431b-af4b-2c9eee609cc3-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:17:09 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-752abeed-764f-4876-b3f1-f146e108831c tempest-ProjectMemberTests-715789302 None] Lock "cinder-5f060d50-45e6-431b-af4b-2c9eee609cc3-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:17:09 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-752abeed-764f-4876-b3f1-f146e108831c tempest-ProjectMemberTests-715789302 None] Acquiring lock "cinder-quobyte-5f060d50-45e6-431b-af4b-2c9eee609cc3" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:17:09 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-752abeed-764f-4876-b3f1-f146e108831c tempest-ProjectMemberTests-715789302 None] Lock "cinder-quobyte-5f060d50-45e6-431b-af4b-2c9eee609cc3" acquired by "delete_volume" :: waited 0.020s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:17:09 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[8482915b-acb4-497e-901d-567e0c2fa374]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:17:09 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-752abeed-764f-4876-b3f1-f146e108831c tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-5f060d50-45e6-431b-af4b-2c9eee609cc3 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:17:09 devstack sudo[109792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-5f060d50-45e6-431b-af4b-2c9eee609cc3 Aug 10 16:17:09 devstack sudo[109792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:17:09 devstack sudo[109792]: pam_unix(sudo:session): session closed for user root Aug 10 16:17:09 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-752abeed-764f-4876-b3f1-f146e108831c tempest-ProjectMemberTests-715789302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-5f060d50-45e6-431b-af4b-2c9eee609cc3" returned: 0 in 0.364s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:17:09 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-752abeed-764f-4876-b3f1-f146e108831c tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-5f060d50-45e6-431b-af4b-2c9eee609cc3 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:17:09 devstack sudo[109797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-5f060d50-45e6-431b-af4b-2c9eee609cc3 Aug 10 16:17:09 devstack sudo[109797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:17:09 devstack sudo[109797]: pam_unix(sudo:session): session closed for user root Aug 10 16:17:09 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-752abeed-764f-4876-b3f1-f146e108831c tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-5f060d50-45e6-431b-af4b-2c9eee609cc3" returned: 0 in 0.267s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:17:09 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-752abeed-764f-4876-b3f1-f146e108831c tempest-ProjectMemberTests-715789302 None] Lock "cinder-quobyte-5f060d50-45e6-431b-af4b-2c9eee609cc3" released by "delete_volume" :: held 0.685s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:17:09 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-752abeed-764f-4876-b3f1-f146e108831c tempest-ProjectMemberTests-715789302 None] Created reservations ['aa8a40a4-1d72-4835-b2bf-7b6c6befa3ff', '0455fed7-5485-4308-8fd8-8ac41977434a', '9242786e-97fa-4e64-bf35-225d31da3a08', '0ead920f-996c-41d7-9fc9-49f7ffabfc1e'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:17:10 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-752abeed-764f-4876-b3f1-f146e108831c tempest-ProjectMemberTests-715789302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:17:10 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-752abeed-764f-4876-b3f1-f146e108831c tempest-ProjectMemberTests-715789302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:17:10 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-752abeed-764f-4876-b3f1-f146e108831c tempest-ProjectMemberTests-715789302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:17:10 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-752abeed-764f-4876-b3f1-f146e108831c tempest-ProjectMemberTests-715789302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:17:10 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-752abeed-764f-4876-b3f1-f146e108831c tempest-ProjectMemberTests-715789302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:17:10 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-752abeed-764f-4876-b3f1-f146e108831c tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:17:10 devstack sudo[109800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:17:10 devstack sudo[109800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:17:10 devstack sudo[109800]: pam_unix(sudo:session): session closed for user root Aug 10 16:17:10 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-752abeed-764f-4876-b3f1-f146e108831c tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.250s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:17:10 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-752abeed-764f-4876-b3f1-f146e108831c tempest-ProjectMemberTests-715789302 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:17:10 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-752abeed-764f-4876-b3f1-f146e108831c tempest-ProjectMemberTests-715789302 None] Deleted volume successfully. Aug 10 16:17:10 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-752abeed-764f-4876-b3f1-f146e108831c tempest-ProjectMemberTests-715789302 None] Lock "cinder-5f060d50-45e6-431b-af4b-2c9eee609cc3-delete_volume" released by "delete_volume" :: held 1.177s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:17:10 devstack cinder-volume[88641]: DEBUG cinder.volume.flows.manager.create_volume [None req-86195dbb-9466-4795-b82c-87eb1a9312a6 tempest-ProjectMemberTests-715789302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 10 16:17:10 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-86195dbb-9466-4795-b82c-87eb1a9312a6 tempest-ProjectMemberTests-715789302 None] Flow 'volume_create_manager' (5bcc50e6-0431-4ddf-a1be-cdf48f380273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:17:10 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-86195dbb-9466-4795-b82c-87eb1a9312a6 tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d3e72ad-5498-43f6-a6a6-fc08914eaedd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:17:10 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-86195dbb-9466-4795-b82c-87eb1a9312a6 tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d3e72ad-5498-43f6-a6a6-fc08914eaedd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:17:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-886552672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a559abf2-3970-48eb-9c9c-60cf033055f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8408ad471876405b8109f4d45d4a242d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:17:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:17:11Z,use_quota=True,user_id='dc958e8abfdb43a69a4609f15eb8d6d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:17:10 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-86195dbb-9466-4795-b82c-87eb1a9312a6 tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e5df55d-1ac8-44a7-a0ae-784fc4db31e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:17:10 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-86195dbb-9466-4795-b82c-87eb1a9312a6 tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e5df55d-1ac8-44a7-a0ae-784fc4db31e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:17:10 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-86195dbb-9466-4795-b82c-87eb1a9312a6 tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ceeaeba-86e4-47df-b745-242231d3a48f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:17:10 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-86195dbb-9466-4795-b82c-87eb1a9312a6 tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ceeaeba-86e4-47df-b745-242231d3a48f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a559abf2-3970-48eb-9c9c-60cf033055f3', 'volume_name': 'volume-a559abf2-3970-48eb-9c9c-60cf033055f3', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:17:10 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-86195dbb-9466-4795-b82c-87eb1a9312a6 tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5411d1aa-a7bc-456c-af94-b47e90445f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:17:10 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-86195dbb-9466-4795-b82c-87eb1a9312a6 tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5411d1aa-a7bc-456c-af94-b47e90445f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:17:10 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-86195dbb-9466-4795-b82c-87eb1a9312a6 tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90638439-bfbd-45bd-9ebb-c72b0fb2d442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:17:10 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-86195dbb-9466-4795-b82c-87eb1a9312a6 tempest-ProjectMemberTests-715789302 None] Volume a559abf2-3970-48eb-9c9c-60cf033055f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a559abf2-3970-48eb-9c9c-60cf033055f3', 'volume_size': 1} Aug 10 16:17:10 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-86195dbb-9466-4795-b82c-87eb1a9312a6 tempest-ProjectMemberTests-715789302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:17:10 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-86195dbb-9466-4795-b82c-87eb1a9312a6 tempest-ProjectMemberTests-715789302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:17:10 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-86195dbb-9466-4795-b82c-87eb1a9312a6 tempest-ProjectMemberTests-715789302 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-10T14:17:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-886552672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a559abf2-3970-48eb-9c9c-60cf033055f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8408ad471876405b8109f4d45d4a242d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-10T14:17:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-10T14:17:11Z,use_quota=True,user_id='dc958e8abfdb43a69a4609f15eb8d6d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31ce84fb-e569-491d-9418-4fddedf66caf),volume_type_id=31ce84fb-e569-491d-9418-4fddedf66caf)}" {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 10 16:17:10 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-86195dbb-9466-4795-b82c-87eb1a9312a6 tempest-ProjectMemberTests-715789302 None] Creating volume a559abf2-3970-48eb-9c9c-60cf033055f3 {{(pid=88641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 10 16:17:10 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-86195dbb-9466-4795-b82c-87eb1a9312a6 tempest-ProjectMemberTests-715789302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:17:10 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-86195dbb-9466-4795-b82c-87eb1a9312a6 tempest-ProjectMemberTests-715789302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:17:10 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-86195dbb-9466-4795-b82c-87eb1a9312a6 tempest-ProjectMemberTests-715789302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:17:10 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-86195dbb-9466-4795-b82c-87eb1a9312a6 tempest-ProjectMemberTests-715789302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:17:10 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-86195dbb-9466-4795-b82c-87eb1a9312a6 tempest-ProjectMemberTests-715789302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:17:10 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-86195dbb-9466-4795-b82c-87eb1a9312a6 tempest-ProjectMemberTests-715789302 None] Selected osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc as target Quobyte volume. {{(pid=88641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 10 16:17:10 devstack cinder-volume[88641]: INFO cinder.volume.drivers.remotefs [None req-86195dbb-9466-4795-b82c-87eb1a9312a6 tempest-ProjectMemberTests-715789302 None] casted to osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc Aug 10 16:17:10 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-86195dbb-9466-4795-b82c-87eb1a9312a6 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a559abf2-3970-48eb-9c9c-60cf033055f3 1073741824 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:17:10 devstack sudo[109803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a559abf2-3970-48eb-9c9c-60cf033055f3 1073741824 Aug 10 16:17:10 devstack sudo[109803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:17:11 devstack sudo[109803]: pam_unix(sudo:session): session closed for user root Aug 10 16:17:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-86195dbb-9466-4795-b82c-87eb1a9312a6 tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a559abf2-3970-48eb-9c9c-60cf033055f3 1073741824" returned: 0 in 0.410s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:17:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-86195dbb-9466-4795-b82c-87eb1a9312a6 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a559abf2-3970-48eb-9c9c-60cf033055f3 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:17:11 devstack sudo[109809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a559abf2-3970-48eb-9c9c-60cf033055f3 Aug 10 16:17:11 devstack sudo[109809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:17:11 devstack sudo[109809]: pam_unix(sudo:session): session closed for user root Aug 10 16:17:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-86195dbb-9466-4795-b82c-87eb1a9312a6 tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a559abf2-3970-48eb-9c9c-60cf033055f3" returned: 0 in 0.245s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:17:11 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-86195dbb-9466-4795-b82c-87eb1a9312a6 tempest-ProjectMemberTests-715789302 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'} {{(pid=88641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 10 16:17:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-86195dbb-9466-4795-b82c-87eb1a9312a6 tempest-ProjectMemberTests-715789302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:17:11 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-86195dbb-9466-4795-b82c-87eb1a9312a6 tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90638439-bfbd-45bd-9ebb-c72b0fb2d442) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a559abf2-3970-48eb-9c9c-60cf033055f3', 'volume_size': 1}' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:17:11 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-86195dbb-9466-4795-b82c-87eb1a9312a6 tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f9aee71-8248-4ba8-bd3a-599754465dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 10 16:17:11 devstack cinder-volume[88641]: INFO cinder.volume.flows.manager.create_volume [None req-86195dbb-9466-4795-b82c-87eb1a9312a6 tempest-ProjectMemberTests-715789302 None] Volume volume-a559abf2-3970-48eb-9c9c-60cf033055f3 (a559abf2-3970-48eb-9c9c-60cf033055f3): created successfully Aug 10 16:17:11 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-86195dbb-9466-4795-b82c-87eb1a9312a6 tempest-ProjectMemberTests-715789302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f9aee71-8248-4ba8-bd3a-599754465dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88641) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 10 16:17:11 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-86195dbb-9466-4795-b82c-87eb1a9312a6 tempest-ProjectMemberTests-715789302 None] Flow 'volume_create_manager' (5bcc50e6-0431-4ddf-a1be-cdf48f380273) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88641) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 10 16:17:11 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-86195dbb-9466-4795-b82c-87eb1a9312a6 tempest-ProjectMemberTests-715789302 None] Created volume successfully. Aug 10 16:17:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-62ee1873-e05e-4f44-a6d0-ccb093fd47d0 tempest-ProjectMemberTests-715789302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:17:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-62ee1873-e05e-4f44-a6d0-ccb093fd47d0 tempest-ProjectMemberTests-715789302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:17:11 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-62ee1873-e05e-4f44-a6d0-ccb093fd47d0 tempest-ProjectMemberTests-715789302 None] Creating offline snapshot 4ad5b912-aeb3-4a90-b234-ec37ed3f45ed of volume a559abf2-3970-48eb-9c9c-60cf033055f3 {{(pid=88641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 10 16:17:11 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc1c8239-07aa-419a-a297-eb3ae37a5dfb]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:17:11 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-62ee1873-e05e-4f44-a6d0-ccb093fd47d0 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a559abf2-3970-48eb-9c9c-60cf033055f3 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:17:12 devstack sudo[109812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a559abf2-3970-48eb-9c9c-60cf033055f3 Aug 10 16:17:12 devstack sudo[109812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:17:12 devstack sudo[109812]: pam_unix(sudo:session): session closed for user root Aug 10 16:17:12 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-62ee1873-e05e-4f44-a6d0-ccb093fd47d0 tempest-ProjectMemberTests-715789302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a559abf2-3970-48eb-9c9c-60cf033055f3" returned: 0 in 0.352s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:17:12 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-62ee1873-e05e-4f44-a6d0-ccb093fd47d0 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a559abf2-3970-48eb-9c9c-60cf033055f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a559abf2-3970-48eb-9c9c-60cf033055f3.4ad5b912-aeb3-4a90-b234-ec37ed3f45ed 1G {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:17:12 devstack sudo[109817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a559abf2-3970-48eb-9c9c-60cf033055f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a559abf2-3970-48eb-9c9c-60cf033055f3.4ad5b912-aeb3-4a90-b234-ec37ed3f45ed 1G Aug 10 16:17:12 devstack sudo[109817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:17:12 devstack sudo[109817]: pam_unix(sudo:session): session closed for user root Aug 10 16:17:12 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-62ee1873-e05e-4f44-a6d0-ccb093fd47d0 tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a559abf2-3970-48eb-9c9c-60cf033055f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a559abf2-3970-48eb-9c9c-60cf033055f3.4ad5b912-aeb3-4a90-b234-ec37ed3f45ed 1G" returned: 0 in 0.422s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:17:12 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-62ee1873-e05e-4f44-a6d0-ccb093fd47d0 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a559abf2-3970-48eb-9c9c-60cf033055f3 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a559abf2-3970-48eb-9c9c-60cf033055f3.4ad5b912-aeb3-4a90-b234-ec37ed3f45ed {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:17:12 devstack sudo[109823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a559abf2-3970-48eb-9c9c-60cf033055f3 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a559abf2-3970-48eb-9c9c-60cf033055f3.4ad5b912-aeb3-4a90-b234-ec37ed3f45ed Aug 10 16:17:12 devstack sudo[109823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:17:13 devstack sudo[109823]: pam_unix(sudo:session): session closed for user root Aug 10 16:17:13 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-62ee1873-e05e-4f44-a6d0-ccb093fd47d0 tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a559abf2-3970-48eb-9c9c-60cf033055f3 -F qcow2 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a559abf2-3970-48eb-9c9c-60cf033055f3.4ad5b912-aeb3-4a90-b234-ec37ed3f45ed" returned: 0 in 0.301s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:17:13 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-62ee1873-e05e-4f44-a6d0-ccb093fd47d0 tempest-ProjectMemberTests-715789302 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a559abf2-3970-48eb-9c9c-60cf033055f3.4ad5b912-aeb3-4a90-b234-ec37ed3f45ed is being set with open permissions: ugo+rw Aug 10 16:17:13 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-62ee1873-e05e-4f44-a6d0-ccb093fd47d0 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a559abf2-3970-48eb-9c9c-60cf033055f3.4ad5b912-aeb3-4a90-b234-ec37ed3f45ed {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:17:13 devstack sudo[109828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a559abf2-3970-48eb-9c9c-60cf033055f3.4ad5b912-aeb3-4a90-b234-ec37ed3f45ed Aug 10 16:17:13 devstack sudo[109828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:17:13 devstack sudo[109828]: pam_unix(sudo:session): session closed for user root Aug 10 16:17:13 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-62ee1873-e05e-4f44-a6d0-ccb093fd47d0 tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a559abf2-3970-48eb-9c9c-60cf033055f3.4ad5b912-aeb3-4a90-b234-ec37ed3f45ed" returned: 0 in 0.243s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:17:13 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-62ee1873-e05e-4f44-a6d0-ccb093fd47d0 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a559abf2-3970-48eb-9c9c-60cf033055f3.info {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:17:13 devstack sudo[109831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a559abf2-3970-48eb-9c9c-60cf033055f3.info Aug 10 16:17:13 devstack sudo[109831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:17:13 devstack sudo[109831]: pam_unix(sudo:session): session closed for user root Aug 10 16:17:13 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-62ee1873-e05e-4f44-a6d0-ccb093fd47d0 tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a559abf2-3970-48eb-9c9c-60cf033055f3.info" returned: 0 in 0.276s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:17:13 devstack cinder-volume[88641]: WARNING cinder.volume.drivers.remotefs [None req-62ee1873-e05e-4f44-a6d0-ccb093fd47d0 tempest-ProjectMemberTests-715789302 None] /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a559abf2-3970-48eb-9c9c-60cf033055f3.info is being set with open permissions: ugo+rw Aug 10 16:17:13 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-62ee1873-e05e-4f44-a6d0-ccb093fd47d0 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a559abf2-3970-48eb-9c9c-60cf033055f3.info {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:17:13 devstack sudo[109834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a559abf2-3970-48eb-9c9c-60cf033055f3.info Aug 10 16:17:13 devstack sudo[109834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:17:13 devstack sudo[109834]: pam_unix(sudo:session): session closed for user root Aug 10 16:17:13 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-62ee1873-e05e-4f44-a6d0-ccb093fd47d0 tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a559abf2-3970-48eb-9c9c-60cf033055f3.info" returned: 0 in 0.274s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:17:13 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-62ee1873-e05e-4f44-a6d0-ccb093fd47d0 tempest-ProjectMemberTests-715789302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.954s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:17:13 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-62ee1873-e05e-4f44-a6d0-ccb093fd47d0 tempest-ProjectMemberTests-715789302 None] Create snapshot completed successfully Aug 10 16:17:14 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-fe6187f2-3a93-4be9-9f3d-573da61ce509 tempest-ProjectMemberTests-715789302 None] Acquiring lock "cinder-4ad5b912-aeb3-4a90-b234-ec37ed3f45ed-delete_snapshot" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:17:14 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-fe6187f2-3a93-4be9-9f3d-573da61ce509 tempest-ProjectMemberTests-715789302 None] Lock "cinder-4ad5b912-aeb3-4a90-b234-ec37ed3f45ed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:17:14 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-fe6187f2-3a93-4be9-9f3d-573da61ce509 tempest-ProjectMemberTests-715789302 None] Acquiring lock "cinder-quobyte-a559abf2-3970-48eb-9c9c-60cf033055f3" by "delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:17:14 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-fe6187f2-3a93-4be9-9f3d-573da61ce509 tempest-ProjectMemberTests-715789302 None] Lock "cinder-quobyte-a559abf2-3970-48eb-9c9c-60cf033055f3" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:17:14 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-fe6187f2-3a93-4be9-9f3d-573da61ce509 tempest-ProjectMemberTests-715789302 None] Acquiring lock "cinder-quobyte-4ad5b912-aeb3-4a90-b234-ec37ed3f45ed" by "_delete_snapshot" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:17:14 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-fe6187f2-3a93-4be9-9f3d-573da61ce509 tempest-ProjectMemberTests-715789302 None] Lock "cinder-quobyte-4ad5b912-aeb3-4a90-b234-ec37ed3f45ed" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:17:14 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-fe6187f2-3a93-4be9-9f3d-573da61ce509 tempest-ProjectMemberTests-715789302 None] Deleting offline snapshot 4ad5b912-aeb3-4a90-b234-ec37ed3f45ed of volume a559abf2-3970-48eb-9c9c-60cf033055f3 {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 10 16:17:14 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-fe6187f2-3a93-4be9-9f3d-573da61ce509 tempest-ProjectMemberTests-715789302 None] snapshot_file for this snap is: volume-a559abf2-3970-48eb-9c9c-60cf033055f3.4ad5b912-aeb3-4a90-b234-ec37ed3f45ed {{(pid=88641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 10 16:17:14 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b259085-5deb-4f31-a8d6-80390f5d2180]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:17:14 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fe6187f2-3a93-4be9-9f3d-573da61ce509 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a559abf2-3970-48eb-9c9c-60cf033055f3.4ad5b912-aeb3-4a90-b234-ec37ed3f45ed {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:17:14 devstack sudo[109837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a559abf2-3970-48eb-9c9c-60cf033055f3.4ad5b912-aeb3-4a90-b234-ec37ed3f45ed Aug 10 16:17:14 devstack sudo[109837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:17:14 devstack sudo[109837]: pam_unix(sudo:session): session closed for user root Aug 10 16:17:14 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fe6187f2-3a93-4be9-9f3d-573da61ce509 tempest-ProjectMemberTests-715789302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a559abf2-3970-48eb-9c9c-60cf033055f3.4ad5b912-aeb3-4a90-b234-ec37ed3f45ed" returned: 0 in 0.371s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:17:14 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.remotefs [None req-fe6187f2-3a93-4be9-9f3d-573da61ce509 tempest-ProjectMemberTests-715789302 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a559abf2-3970-48eb-9c9c-60cf033055f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 10 16:17:14 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[a13f3fd8-e277-4848-af79-aadb6b48abbf]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:17:14 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fe6187f2-3a93-4be9-9f3d-573da61ce509 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a559abf2-3970-48eb-9c9c-60cf033055f3 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:17:14 devstack sudo[109842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a559abf2-3970-48eb-9c9c-60cf033055f3 Aug 10 16:17:14 devstack sudo[109842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:17:15 devstack sudo[109842]: pam_unix(sudo:session): session closed for user root Aug 10 16:17:15 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fe6187f2-3a93-4be9-9f3d-573da61ce509 tempest-ProjectMemberTests-715789302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a559abf2-3970-48eb-9c9c-60cf033055f3" returned: 0 in 0.374s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:17:15 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fe6187f2-3a93-4be9-9f3d-573da61ce509 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a559abf2-3970-48eb-9c9c-60cf033055f3.4ad5b912-aeb3-4a90-b234-ec37ed3f45ed {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:17:15 devstack sudo[109847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a559abf2-3970-48eb-9c9c-60cf033055f3.4ad5b912-aeb3-4a90-b234-ec37ed3f45ed Aug 10 16:17:15 devstack sudo[109847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:17:15 devstack sudo[109847]: pam_unix(sudo:session): session closed for user root Aug 10 16:17:15 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fe6187f2-3a93-4be9-9f3d-573da61ce509 tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a559abf2-3970-48eb-9c9c-60cf033055f3.4ad5b912-aeb3-4a90-b234-ec37ed3f45ed" returned: 0 in 0.339s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:17:15 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fe6187f2-3a93-4be9-9f3d-573da61ce509 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a559abf2-3970-48eb-9c9c-60cf033055f3.4ad5b912-aeb3-4a90-b234-ec37ed3f45ed {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:17:15 devstack sudo[109852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a559abf2-3970-48eb-9c9c-60cf033055f3.4ad5b912-aeb3-4a90-b234-ec37ed3f45ed Aug 10 16:17:15 devstack sudo[109852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:17:15 devstack sudo[109852]: pam_unix(sudo:session): session closed for user root Aug 10 16:17:15 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-fe6187f2-3a93-4be9-9f3d-573da61ce509 tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a559abf2-3970-48eb-9c9c-60cf033055f3.4ad5b912-aeb3-4a90-b234-ec37ed3f45ed" returned: 0 in 0.256s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:17:15 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-fe6187f2-3a93-4be9-9f3d-573da61ce509 tempest-ProjectMemberTests-715789302 None] Lock "cinder-quobyte-4ad5b912-aeb3-4a90-b234-ec37ed3f45ed" released by "_delete_snapshot" :: held 1.427s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:17:15 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-fe6187f2-3a93-4be9-9f3d-573da61ce509 tempest-ProjectMemberTests-715789302 None] Lock "cinder-quobyte-a559abf2-3970-48eb-9c9c-60cf033055f3" released by "delete_snapshot" :: held 1.452s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:17:15 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-fe6187f2-3a93-4be9-9f3d-573da61ce509 tempest-ProjectMemberTests-715789302 None] Created reservations ['6788cda4-da51-4479-9158-46e27c59b4e1', '76487ed8-3ecb-4131-b567-4eea99a8e6bf', 'ca5edf6c-4223-4a63-b34d-248afca478af', '2e344753-0641-48fd-9701-ebdc9da90859'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:17:15 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-fe6187f2-3a93-4be9-9f3d-573da61ce509 tempest-ProjectMemberTests-715789302 None] Delete snapshot completed successfully. Aug 10 16:17:15 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-fe6187f2-3a93-4be9-9f3d-573da61ce509 tempest-ProjectMemberTests-715789302 None] Lock "cinder-4ad5b912-aeb3-4a90-b234-ec37ed3f45ed-delete_snapshot" released by "delete_snapshot" :: held 1.598s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:17:16 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-add55dc1-805b-4f7c-a563-5483e630de89 tempest-ProjectMemberTests-715789302 None] Acquiring lock "cinder-a559abf2-3970-48eb-9c9c-60cf033055f3-delete_volume" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:17:16 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-add55dc1-805b-4f7c-a563-5483e630de89 tempest-ProjectMemberTests-715789302 None] Lock "cinder-a559abf2-3970-48eb-9c9c-60cf033055f3-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:17:16 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-add55dc1-805b-4f7c-a563-5483e630de89 tempest-ProjectMemberTests-715789302 None] Acquiring lock "cinder-quobyte-a559abf2-3970-48eb-9c9c-60cf033055f3" by "delete_volume" {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 10 16:17:16 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-add55dc1-805b-4f7c-a563-5483e630de89 tempest-ProjectMemberTests-715789302 None] Lock "cinder-quobyte-a559abf2-3970-48eb-9c9c-60cf033055f3" acquired by "delete_volume" :: waited 0.014s {{(pid=88641) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 10 16:17:16 devstack cinder-volume[88641]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd79256-c896-4fb5-b34f-1a24c57c4281]: (4, 'qcow2') {{(pid=90565) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 10 16:17:16 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-add55dc1-805b-4f7c-a563-5483e630de89 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a559abf2-3970-48eb-9c9c-60cf033055f3 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:17:16 devstack sudo[109855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a559abf2-3970-48eb-9c9c-60cf033055f3 Aug 10 16:17:16 devstack sudo[109855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:17:16 devstack sudo[109855]: pam_unix(sudo:session): session closed for user root Aug 10 16:17:16 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-add55dc1-805b-4f7c-a563-5483e630de89 tempest-ProjectMemberTests-715789302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a559abf2-3970-48eb-9c9c-60cf033055f3" returned: 0 in 0.372s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:17:16 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-add55dc1-805b-4f7c-a563-5483e630de89 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a559abf2-3970-48eb-9c9c-60cf033055f3 {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:17:16 devstack sudo[109860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a559abf2-3970-48eb-9c9c-60cf033055f3 Aug 10 16:17:16 devstack sudo[109860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:17:17 devstack sudo[109860]: pam_unix(sudo:session): session closed for user root Aug 10 16:17:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-add55dc1-805b-4f7c-a563-5483e630de89 tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f/volume-a559abf2-3970-48eb-9c9c-60cf033055f3" returned: 0 in 0.250s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:17:17 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-add55dc1-805b-4f7c-a563-5483e630de89 tempest-ProjectMemberTests-715789302 None] Lock "cinder-quobyte-a559abf2-3970-48eb-9c9c-60cf033055f3" released by "delete_volume" :: held 0.678s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:17:17 devstack cinder-volume[88641]: DEBUG cinder.quota [None req-add55dc1-805b-4f7c-a563-5483e630de89 tempest-ProjectMemberTests-715789302 None] Created reservations ['a12607f1-fd79-4edf-8ea8-4bc5cbddb3b9', '2a15539c-27fd-4c2b-a593-5177e0634961', 'ae14453a-b776-4f52-9822-1aae52d7f4ea', '2e910856-28e7-47e2-a70c-173576d20c1d'] {{(pid=88641) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 10 16:17:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-add55dc1-805b-4f7c-a563-5483e630de89 tempest-ProjectMemberTests-715789302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:17:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-add55dc1-805b-4f7c-a563-5483e630de89 tempest-ProjectMemberTests-715789302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:17:17 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-add55dc1-805b-4f7c-a563-5483e630de89 tempest-ProjectMemberTests-715789302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:17:17 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-add55dc1-805b-4f7c-a563-5483e630de89 tempest-ProjectMemberTests-715789302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:17:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-add55dc1-805b-4f7c-a563-5483e630de89 tempest-ProjectMemberTests-715789302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:17:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-add55dc1-805b-4f7c-a563-5483e630de89 tempest-ProjectMemberTests-715789302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:17:17 devstack sudo[109863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:17:17 devstack sudo[109863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:17:17 devstack sudo[109863]: pam_unix(sudo:session): session closed for user root Aug 10 16:17:17 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-add55dc1-805b-4f7c-a563-5483e630de89 tempest-ProjectMemberTests-715789302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.265s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:17:17 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-add55dc1-805b-4f7c-a563-5483e630de89 tempest-ProjectMemberTests-715789302 None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:17:17 devstack cinder-volume[88641]: INFO cinder.volume.manager [None req-add55dc1-805b-4f7c-a563-5483e630de89 tempest-ProjectMemberTests-715789302 None] Deleted volume successfully. Aug 10 16:17:17 devstack cinder-volume[88641]: DEBUG cinder.coordination [None req-add55dc1-805b-4f7c-a563-5483e630de89 tempest-ProjectMemberTests-715789302 None] Lock "cinder-a559abf2-3970-48eb-9c9c-60cf033055f3-delete_volume" released by "delete_volume" :: held 1.152s {{(pid=88641) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 10 16:17:27 devstack cinder-volume[88641]: DEBUG dbcounter [-] [88641] Writing DB stats cinder:SELECT=71,cinder:UPDATE=82,cinder:INSERT=25,cinder:DELETE=6 {{(pid=88641) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 16:17:27 devstack cinder-volume[88641]: DEBUG dbcounter [-] [88641] Writing DB stats cinder:SELECT=64,cinder:UPDATE=91,cinder:INSERT=24,cinder:DELETE=8 {{(pid=88641) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 16:17:36 devstack cinder-volume[88641]: DEBUG oslo_service.periodic_task [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88641) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 16:17:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 10 16:17:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 10 16:17:36 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc': None} {{(pid=88641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 10 16:17:36 devstack cinder-volume[88641]: DEBUG cinder.volume.drivers.quobyte [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-92def67d-6d14-4b3e-b6d4-44c2a0d3e5dc'] {{(pid=88641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 10 16:17:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.lockutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88641) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 10 16:17:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 10 16:17:36 devstack sudo[109876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f Aug 10 16:17:36 devstack sudo[109876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 10 16:17:36 devstack sudo[109876]: pam_unix(sudo:session): session closed for user root Aug 10 16:17:36 devstack cinder-volume[88641]: DEBUG oslo_concurrency.processutils [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a6daaeaf6559c2cef9d9258f254a9e1f" returned: 0 in 0.266s {{(pid=88641) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 10 16:17:36 devstack cinder-volume[88641]: DEBUG cinder.manager [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Notifying Schedulers of capabilities ... {{(pid=88641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 10 16:17:36 devstack cinder-volume[88641]: DEBUG oslo_service.periodic_task [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] Running periodic task VolumeManager._thread_info {{(pid=88641) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 10 16:17:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] thread count: 28 {{(pid=88641) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 10 16:17:36 devstack cinder-volume[88641]: DEBUG cinder.volume.manager [None req-bbe75761-dc3e-44dc-858c-8bf3ea1dcf4f None None] thread info: [<_MainThread(MainThread, started 127361545748608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88641) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 10 16:17:39 devstack cinder-volume[88641]: DEBUG dbcounter [-] [88641] Writing DB stats cinder:SELECT=1 {{(pid=88641) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 10 16:17:39 devstack cinder-volume[88641]: DEBUG dbcounter [-] [88641] Writing DB stats cinder:UPDATE=1 {{(pid=88641) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}